2024-09-21T08:56:55.616 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T08:56:55.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T08:56:55.721 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225 branch: squid description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} email: ceph-qa@ceph.com first_in_suite: false job_id: '7913225' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 rgw: frontend: beast s3tests: force-branch: ceph-squid thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9490 sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyQOu/sQRjcX9OY/oYMPuHxd/BdCx0jEw2Wdegr5pP8iy0lAGRPdKV/esDjngl13QUPQRpDth1UH9+VzWTZWXM= smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBRezow6Dxv/aoklxbG7gTRAQ2kvo1PXUVMstZNelt8cHUaUwEvVLYf7yQN41USSzJy1he3G4RpfJ+ROgBhGc5w= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_user_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_21:40:05 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T08:56:55.721 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-21T08:56:55.721 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-21T08:56:55.722 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T08:56:55.723 INFO:teuthology.task.internal:Checking packages... 2024-09-21T08:56:55.744 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9e2ac70bb7aea67d34f0d50002344abbe7803736' 2024-09-21T08:56:55.744 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T08:56:55.745 INFO:teuthology.packaging:ref: None 2024-09-21T08:56:55.745 INFO:teuthology.packaging:tag: None 2024-09-21T08:56:55.745 INFO:teuthology.packaging:branch: squid 2024-09-21T08:56:55.745 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T08:56:55.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-21T08:56:55.950 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373-g4e45e6b4-1jammy 2024-09-21T08:56:55.952 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T08:56:55.959 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T08:56:55.960 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T08:56:55.993 INFO:teuthology.task.internal:Saving configuration 2024-09-21T08:56:56.005 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T08:56:56.012 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T08:56:56.037 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 08:51:30.830054', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM7/Tps13hQmBmne+80ui3SO3UpORBMbbwPyRILUrwgy'} 2024-09-21T08:56:56.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 08:51:30.831976', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGek2T7RxPjAySb44NNCoDbtCJg7tXSHruHGemNnzOzr'} 2024-09-21T08:56:56.059 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T08:56:56.066 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-21T08:56:56.066 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-21T08:56:56.066 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T08:56:56.175 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1510beb880>, signals=[15]) 2024-09-21T08:56:56.175 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T08:56:56.181 INFO:teuthology.task.internal:Opening connections... 2024-09-21T08:56:56.182 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T08:56:56.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:56:56.266 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T08:56:56.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:56:56.351 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T08:56:56.359 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-09-21T08:56:56.364 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-09-21T08:56:56.364 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-09-21T08:56:56.413 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-21T08:56:56.413 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Ubuntu" 2024-09-21T08:56:56.413 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="22.04" 2024-09-21T08:56:56.413 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-21T08:56:56.413 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_CODENAME=jammy 2024-09-21T08:56:56.413 INFO:teuthology.orchestra.run.smithi007.stdout:ID=ubuntu 2024-09-21T08:56:56.413 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE=debian 2024-09-21T08:56:56.414 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-21T08:56:56.414 INFO:teuthology.orchestra.run.smithi007.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-21T08:56:56.414 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-21T08:56:56.414 INFO:teuthology.orchestra.run.smithi007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-21T08:56:56.414 INFO:teuthology.orchestra.run.smithi007.stdout:UBUNTU_CODENAME=jammy 2024-09-21T08:56:56.414 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-09-21T08:56:56.439 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-09-21T08:56:56.445 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-09-21T08:56:56.445 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-09-21T08:56:56.492 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-21T08:56:56.492 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2024-09-21T08:56:56.492 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04" 2024-09-21T08:56:56.493 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-21T08:56:56.493 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy 2024-09-21T08:56:56.493 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2024-09-21T08:56:56.493 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2024-09-21T08:56:56.493 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-21T08:56:56.493 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-21T08:56:56.493 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-21T08:56:56.493 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-21T08:56:56.493 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy 2024-09-21T08:56:56.493 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-09-21T08:56:56.514 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T08:56:56.523 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T08:56:56.529 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T08:56:56.530 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-09-21T08:56:56.532 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-09-21T08:56:56.540 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T08:56:56.546 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T08:56:56.546 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-09-21T08:56:56.579 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-09-21T08:56:56.598 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T08:56:56.655 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T08:56:56.670 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T08:56:56.670 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T08:56:56.670 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T08:56:56.671 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T08:56:56.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:56:56.676 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-21T08:56:56.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:56:56.677 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-21T08:56:56.722 INFO:teuthology.orchestra.run.smithi007.stdout:5.15.0-56-generic 2024-09-21T08:56:56.722 INFO:teuthology.task.kernel:Running kernel on smithi007: 5.15.0-56-generic 2024-09-21T08:56:56.723 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get clean 2024-09-21T08:56:56.725 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-56-generic 2024-09-21T08:56:56.725 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.15.0-56-generic 2024-09-21T08:56:56.726 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2024-09-21T08:56:56.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2024-09-21T08:56:56.876 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-09-21T08:56:57.002 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T08:56:57.018 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-21T08:56:57.018 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-21T08:56:57.024 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-21T08:56:57.080 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-21T08:56:57.129 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T08:56:57.211 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-21T08:56:57.234 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-21T08:56:57.241 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-21T08:56:57.315 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-21T08:56:57.333 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-21T08:56:57.343 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-21T08:56:57.348 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-21T08:56:57.349 INFO:teuthology.orchestra.run.smithi007.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-21T08:56:57.350 INFO:teuthology.orchestra.run.smithi007.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-21T08:56:57.351 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-21T08:56:57.356 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-21T08:56:57.358 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-21T08:56:57.359 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-21T08:56:57.370 INFO:teuthology.orchestra.run.smithi007.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-21T08:56:57.379 INFO:teuthology.orchestra.run.smithi007.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-21T08:56:57.380 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-21T08:56:57.380 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-21T08:56:57.382 INFO:teuthology.orchestra.run.smithi007.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-21T08:56:57.382 INFO:teuthology.orchestra.run.smithi007.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-21T08:56:57.384 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-21T08:56:57.384 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-21T08:56:57.388 INFO:teuthology.orchestra.run.smithi007.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-21T08:56:57.390 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-21T08:56:57.396 INFO:teuthology.orchestra.run.smithi007.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-21T08:56:57.397 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-21T08:56:57.398 INFO:teuthology.orchestra.run.smithi007.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-21T08:56:57.400 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-21T08:56:57.400 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-21T08:56:57.400 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-21T08:56:57.411 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-21T08:56:57.411 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-21T08:56:57.429 INFO:teuthology.orchestra.run.smithi007.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-21T08:56:57.430 INFO:teuthology.orchestra.run.smithi007.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-21T08:56:57.430 INFO:teuthology.orchestra.run.smithi007.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-21T08:56:57.430 INFO:teuthology.orchestra.run.smithi007.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-21T08:56:57.431 INFO:teuthology.orchestra.run.smithi007.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-21T08:56:57.431 INFO:teuthology.orchestra.run.smithi007.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-21T08:56:57.431 INFO:teuthology.orchestra.run.smithi007.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-21T08:56:57.434 INFO:teuthology.orchestra.run.smithi007.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-21T08:56:57.434 INFO:teuthology.orchestra.run.smithi007.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-21T08:56:57.434 INFO:teuthology.orchestra.run.smithi007.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-21T08:56:57.434 INFO:teuthology.orchestra.run.smithi007.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-21T08:56:57.434 INFO:teuthology.orchestra.run.smithi007.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-21T08:56:57.447 INFO:teuthology.orchestra.run.smithi007.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-21T08:56:57.449 INFO:teuthology.orchestra.run.smithi007.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-21T08:56:57.452 INFO:teuthology.orchestra.run.smithi007.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-21T08:56:57.453 INFO:teuthology.orchestra.run.smithi007.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-21T08:56:57.456 INFO:teuthology.orchestra.run.smithi007.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-21T08:56:57.464 INFO:teuthology.orchestra.run.smithi007.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-21T08:56:57.465 INFO:teuthology.orchestra.run.smithi007.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-21T08:56:57.465 INFO:teuthology.orchestra.run.smithi007.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-21T08:56:57.468 INFO:teuthology.orchestra.run.smithi007.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-21T08:56:57.469 INFO:teuthology.orchestra.run.smithi007.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-21T08:56:57.469 INFO:teuthology.orchestra.run.smithi007.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-21T08:56:57.469 INFO:teuthology.orchestra.run.smithi007.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-21T08:56:57.470 INFO:teuthology.orchestra.run.smithi007.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-21T08:56:57.484 INFO:teuthology.orchestra.run.smithi007.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-21T08:56:57.565 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-21T08:56:57.704 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-21T08:56:57.898 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-21T08:56:58.057 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-21T08:56:58.071 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-21T08:56:58.072 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-21T08:56:58.073 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-21T08:56:58.142 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-21T08:56:58.159 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-21T08:56:58.159 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-21T08:56:58.193 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-21T08:56:58.210 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-21T08:56:58.216 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-21T08:56:58.221 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-21T08:56:58.222 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-21T08:56:58.223 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-21T08:56:58.298 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-21T08:56:58.299 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-21T08:56:58.300 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-21T08:56:58.302 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-21T08:56:58.302 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-21T08:56:58.302 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-21T08:56:58.303 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-21T08:56:58.383 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-21T08:56:58.384 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-21T08:57:04.072 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 16.3 MB in 2s (7,201 kB/s) 2024-09-21T08:57:04.195 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 16.3 MB in 2s (7,170 kB/s) 2024-09-21T08:57:05.548 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-21T08:57:05.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T08:57:05.601 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-21T08:57:05.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T08:57:05.631 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-21T08:57:05.676 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-21T08:57:05.849 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-09-21T08:57:05.849 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-09-21T08:57:05.869 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-21T08:57:05.870 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-21T08:57:06.048 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T08:57:06.048 INFO:teuthology.orchestra.run.smithi007.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T08:57:06.048 INFO:teuthology.orchestra.run.smithi007.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T08:57:06.049 INFO:teuthology.orchestra.run.smithi007.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T08:57:06.049 INFO:teuthology.orchestra.run.smithi007.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-21T08:57:06.049 INFO:teuthology.orchestra.run.smithi007.stdout: python2.7-minimal 2024-09-21T08:57:06.049 INFO:teuthology.orchestra.run.smithi007.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T08:57:06.049 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T08:57:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T08:57:06.049 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T08:57:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T08:57:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-21T08:57:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: python2.7-minimal 2024-09-21T08:57:06.050 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T08:57:06.050 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-09-21T08:57:06.050 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T08:57:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-21T08:57:06.051 INFO:teuthology.orchestra.run.smithi007.stdout:The following additional packages will be installed: 2024-09-21T08:57:06.051 INFO:teuthology.orchestra.run.smithi007.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T08:57:06.051 INFO:teuthology.orchestra.run.smithi007.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-21T08:57:06.051 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-21T08:57:06.051 INFO:teuthology.orchestra.run.smithi007.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-21T08:57:06.052 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-09-21T08:57:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-21T08:57:06.052 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-09-21T08:57:06.052 INFO:teuthology.orchestra.run.smithi050.stdout: thermald 2024-09-21T08:57:06.053 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2024-09-21T08:57:06.053 INFO:teuthology.orchestra.run.smithi007.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-21T08:57:06.053 INFO:teuthology.orchestra.run.smithi007.stdout:Recommended packages: 2024-09-21T08:57:06.053 INFO:teuthology.orchestra.run.smithi007.stdout: thermald 2024-09-21T08:57:06.101 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2024-09-21T08:57:06.102 INFO:teuthology.orchestra.run.smithi007.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T08:57:06.102 INFO:teuthology.orchestra.run.smithi007.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-21T08:57:06.102 INFO:teuthology.orchestra.run.smithi007.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-21T08:57:06.103 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages will be upgraded: 2024-09-21T08:57:06.104 INFO:teuthology.orchestra.run.smithi007.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-21T08:57:06.114 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-09-21T08:57:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T08:57:06.114 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-21T08:57:06.115 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-21T08:57:06.116 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2024-09-21T08:57:06.116 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-21T08:57:06.159 INFO:teuthology.orchestra.run.smithi007.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T08:57:06.159 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 113 MB of archives. 2024-09-21T08:57:06.159 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-21T08:57:06.159 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-21T08:57:06.296 INFO:teuthology.orchestra.run.smithi050.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T08:57:06.296 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 113 MB of archives. 2024-09-21T08:57:06.296 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-21T08:57:06.296 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-21T08:57:06.595 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-21T08:57:06.694 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-21T08:57:07.571 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-21T08:57:07.571 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-21T08:57:07.571 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-21T08:57:07.687 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-21T08:57:07.709 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-21T08:57:07.732 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-21T08:57:08.097 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-21T08:57:08.251 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 113 MB in 2s (67.2 MB/s) 2024-09-21T08:57:08.636 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-21T08:57:10.362 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-21T08:57:10.362 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-21T08:57:10.363 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-21T08:57:10.606 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-21T08:57:10.611 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T08:57:10.701 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:10.729 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-21T08:57:10.812 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-21T08:57:11.244 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 113 MB in 5s (24.2 MB/s) 2024-09-21T08:57:11.417 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-21T08:57:12.945 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-21T08:57:12.966 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T08:57:13.051 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:13.565 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-21T08:57:13.586 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T08:57:13.601 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-21T08:57:13.606 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T08:57:13.741 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:13.833 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:15.884 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-21T08:57:15.906 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T08:57:16.012 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:16.604 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-21T08:57:16.625 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T08:57:16.662 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:20.075 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T08:57:20.203 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T08:57:20.544 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T08:57:20.648 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T08:57:20.918 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-21T08:57:20.941 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-21T08:57:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T08:57:23.620 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T08:57:23.747 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T08:57:24.072 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T08:57:24.184 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T08:57:24.486 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-21T08:57:24.509 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-21T08:57:24.570 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T08:57:26.834 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-21T08:57:26.873 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T08:57:26.918 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:29.589 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T08:57:29.711 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T08:57:30.046 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T08:57:30.166 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:30.292 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-21T08:57:30.352 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-21T08:57:30.393 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T08:57:30.413 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:30.794 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:31.731 INFO:teuthology.orchestra.run.smithi007.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-21T08:57:31.731 INFO:teuthology.orchestra.run.smithi007.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-21T08:57:31.731 INFO:teuthology.orchestra.run.smithi007.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-21T08:57:31.731 INFO:teuthology.orchestra.run.smithi007.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-21T08:57:31.872 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:33.866 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-21T08:57:33.991 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-21T08:57:34.117 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:34.574 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T08:57:34.697 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T08:57:35.063 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T08:57:35.185 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:35.319 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-21T08:57:35.465 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:35.578 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:35.632 INFO:teuthology.orchestra.run.smithi007.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-21T08:57:35.633 INFO:teuthology.orchestra.run.smithi007.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-21T08:57:36.832 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-21T08:57:36.832 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-21T08:57:36.832 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-21T08:57:36.833 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-21T08:57:36.975 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-21T08:57:38.552 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-21T08:57:39.562 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:41.005 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T08:57:41.073 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-21T08:57:41.074 INFO:teuthology.orchestra.run.smithi050.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-21T08:57:50.296 INFO:teuthology.orchestra.run.smithi007.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-21T08:57:50.297 INFO:teuthology.orchestra.run.smithi007.stdout:Sourcing file `/etc/default/grub' 2024-09-21T08:57:50.307 INFO:teuthology.orchestra.run.smithi007.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T08:57:50.327 INFO:teuthology.orchestra.run.smithi007.stdout:Generating grub configuration file ... 2024-09-21T08:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T08:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T08:57:50.937 INFO:teuthology.orchestra.run.smithi007.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T08:57:50.943 INFO:teuthology.orchestra.run.smithi007.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T08:57:51.020 INFO:teuthology.orchestra.run.smithi007.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T08:57:51.026 INFO:teuthology.orchestra.run.smithi007.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T08:57:51.181 INFO:teuthology.orchestra.run.smithi007.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T08:57:51.181 INFO:teuthology.orchestra.run.smithi007.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T08:57:51.181 INFO:teuthology.orchestra.run.smithi007.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T08:57:51.215 INFO:teuthology.orchestra.run.smithi007.stdout:done 2024-09-21T08:57:51.704 DEBUG:teuthology.orchestra.run.smithi007:> dpkg -s linux-image-generic 2024-09-21T08:57:51.728 INFO:teuthology.orchestra.run.smithi007.stdout:Package: linux-image-generic 2024-09-21T08:57:51.728 INFO:teuthology.orchestra.run.smithi007.stdout:Status: install ok installed 2024-09-21T08:57:51.728 INFO:teuthology.orchestra.run.smithi007.stdout:Priority: optional 2024-09-21T08:57:51.728 INFO:teuthology.orchestra.run.smithi007.stdout:Section: kernel 2024-09-21T08:57:51.728 INFO:teuthology.orchestra.run.smithi007.stdout:Installed-Size: 21 2024-09-21T08:57:51.728 INFO:teuthology.orchestra.run.smithi007.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T08:57:51.728 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: amd64 2024-09-21T08:57:51.728 INFO:teuthology.orchestra.run.smithi007.stdout:Source: linux-meta 2024-09-21T08:57:51.729 INFO:teuthology.orchestra.run.smithi007.stdout:Version: 5.15.0.122.122 2024-09-21T08:57:51.729 INFO:teuthology.orchestra.run.smithi007.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T08:57:51.729 INFO:teuthology.orchestra.run.smithi007.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T08:57:51.729 INFO:teuthology.orchestra.run.smithi007.stdout:Recommends: thermald 2024-09-21T08:57:51.729 INFO:teuthology.orchestra.run.smithi007.stdout:Description: Generic Linux kernel image 2024-09-21T08:57:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: This package will always depend on the latest generic kernel image 2024-09-21T08:57:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: available. 2024-09-21T08:57:51.729 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-21T08:57:51.729 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T08:57:51.729 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T08:57:51.729 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T08:57:51.730 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T08:57:51.730 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get clean 2024-09-21T08:57:51.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2024-09-21T08:57:52.055 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T08:57:52.064 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T08:57:52.081 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T08:57:52.174 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T08:57:53.486 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-21T08:57:53.505 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T08:57:53.559 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-21T08:57:53.752 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-09-21T08:57:53.752 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-09-21T08:57:53.926 INFO:teuthology.orchestra.run.smithi007.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-21T08:57:53.926 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T08:57:53.926 INFO:teuthology.orchestra.run.smithi007.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T08:57:53.926 INFO:teuthology.orchestra.run.smithi007.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T08:57:53.926 INFO:teuthology.orchestra.run.smithi007.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T08:57:53.927 INFO:teuthology.orchestra.run.smithi007.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T08:57:53.927 INFO:teuthology.orchestra.run.smithi007.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T08:57:53.927 INFO:teuthology.orchestra.run.smithi007.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T08:57:53.967 INFO:teuthology.orchestra.run.smithi007.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T08:57:53.969 DEBUG:teuthology.orchestra.run.smithi007:> dpkg -s linux-image-generic 2024-09-21T08:57:54.028 INFO:teuthology.orchestra.run.smithi007.stdout:Package: linux-image-generic 2024-09-21T08:57:54.028 INFO:teuthology.orchestra.run.smithi007.stdout:Status: install ok installed 2024-09-21T08:57:54.028 INFO:teuthology.orchestra.run.smithi007.stdout:Priority: optional 2024-09-21T08:57:54.028 INFO:teuthology.orchestra.run.smithi007.stdout:Section: kernel 2024-09-21T08:57:54.028 INFO:teuthology.orchestra.run.smithi007.stdout:Installed-Size: 21 2024-09-21T08:57:54.029 INFO:teuthology.orchestra.run.smithi007.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T08:57:54.029 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: amd64 2024-09-21T08:57:54.029 INFO:teuthology.orchestra.run.smithi007.stdout:Source: linux-meta 2024-09-21T08:57:54.029 INFO:teuthology.orchestra.run.smithi007.stdout:Version: 5.15.0.122.122 2024-09-21T08:57:54.029 INFO:teuthology.orchestra.run.smithi007.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T08:57:54.029 INFO:teuthology.orchestra.run.smithi007.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T08:57:54.029 INFO:teuthology.orchestra.run.smithi007.stdout:Recommends: thermald 2024-09-21T08:57:54.029 INFO:teuthology.orchestra.run.smithi007.stdout:Description: Generic Linux kernel image 2024-09-21T08:57:54.029 INFO:teuthology.orchestra.run.smithi007.stdout: This package will always depend on the latest generic kernel image 2024-09-21T08:57:54.029 INFO:teuthology.orchestra.run.smithi007.stdout: available. 2024-09-21T08:57:54.030 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-21T08:57:54.073 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.uEWSTHG52X 2024-09-21T08:57:54.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub/grub.cfg /tmp/tmp.uEWSTHG52X 2024-09-21T08:57:54.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.uEWSTHG52X 2024-09-21T08:57:54.245 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.uEWSTHG52X is 10KB 2024-09-21T08:57:54.257 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.uEWSTHG52X 2024-09-21T08:57:54.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-21T08:57:54.316 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T08:57:54.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-21T08:57:54.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-21T08:57:54.407 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-21T08:57:54.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo update-grub 2024-09-21T08:57:55.635 INFO:teuthology.orchestra.run.smithi007.stderr:Sourcing file `/etc/default/grub' 2024-09-21T08:57:55.636 INFO:teuthology.orchestra.run.smithi007.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T08:57:55.638 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-09-21T08:57:55.664 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-21T08:57:55.664 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub' 2024-09-21T08:57:55.682 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T08:57:55.741 INFO:teuthology.orchestra.run.smithi050.stdout:Generating grub configuration file ... 2024-09-21T08:57:55.807 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T08:57:55.812 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T08:57:56.013 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T08:57:56.018 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T08:57:56.058 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T08:57:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T08:57:56.127 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T08:57:56.149 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T08:57:56.182 INFO:teuthology.orchestra.run.smithi007.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T08:57:56.182 INFO:teuthology.orchestra.run.smithi007.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T08:57:56.182 INFO:teuthology.orchestra.run.smithi007.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T08:57:56.193 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-09-21T08:57:56.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-09-21T08:57:56.530 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T08:57:56.537 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T08:57:56.611 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T08:57:56.617 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T08:57:56.788 INFO:teuthology.orchestra.run.smithi050.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T08:57:56.788 INFO:teuthology.orchestra.run.smithi050.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T08:57:56.788 INFO:teuthology.orchestra.run.smithi050.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T08:57:56.833 INFO:teuthology.orchestra.run.smithi050.stdout:done 2024-09-21T08:57:57.304 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2024-09-21T08:57:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2024-09-21T08:57:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2024-09-21T08:57:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 21 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.15.0.122.122 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2024-09-21T08:57:57.328 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2024-09-21T08:57:57.329 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-21T08:57:57.329 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T08:57:57.329 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T08:57:57.329 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T08:57:57.329 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T08:57:57.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2024-09-21T08:57:57.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-09-21T08:57:57.723 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T08:57:57.723 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T08:57:57.796 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T08:57:57.877 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T08:57:59.164 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-21T08:57:59.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T08:57:59.239 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-21T08:57:59.448 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-21T08:57:59.449 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-21T08:57:59.634 INFO:teuthology.orchestra.run.smithi050.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-21T08:57:59.634 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T08:57:59.634 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T08:57:59.634 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T08:57:59.634 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T08:57:59.635 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T08:57:59.635 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T08:57:59.635 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T08:57:59.675 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T08:57:59.677 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2024-09-21T08:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2024-09-21T08:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2024-09-21T08:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2024-09-21T08:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2024-09-21T08:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 21 2024-09-21T08:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T08:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2024-09-21T08:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2024-09-21T08:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.15.0.122.122 2024-09-21T08:57:59.689 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T08:57:59.690 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T08:57:59.690 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2024-09-21T08:57:59.690 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2024-09-21T08:57:59.690 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2024-09-21T08:57:59.690 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2024-09-21T08:57:59.690 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-21T08:57:59.738 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.0dOQURbkvf 2024-09-21T08:57:59.738 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub/grub.cfg /tmp/tmp.0dOQURbkvf 2024-09-21T08:57:59.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.0dOQURbkvf 2024-09-21T08:57:59.936 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.0dOQURbkvf is 10KB 2024-09-21T08:57:59.948 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.0dOQURbkvf 2024-09-21T08:57:59.953 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-21T08:58:00.007 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T08:58:00.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-21T08:58:00.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-21T08:58:00.086 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-21T08:58:00.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo update-grub 2024-09-21T08:58:01.360 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2024-09-21T08:58:01.361 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T08:58:01.364 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-09-21T08:58:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T08:58:01.541 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T08:58:01.798 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T08:58:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T08:58:01.846 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T08:58:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T08:58:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T08:58:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T08:58:02.011 INFO:teuthology.orchestra.run.smithi050.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T08:58:02.029 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-09-21T08:58:02.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-09-21T08:58:26.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T08:58:26.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T08:58:26.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:58:32.054 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T08:58:32.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-21T08:58:32.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:58:44.591 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-09-21T08:58:50.481 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-09-21T08:58:53.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T08:58:53.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:58:59.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-21T08:58:59.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T08:59:53.651 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T08:59:59.496 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T09:00:05.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T09:00:05.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T09:00:05.864 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-21T09:00:06.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T09:00:06.561 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-21T09:00:06.562 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-21T09:00:06.607 INFO:teuthology.orchestra.run.smithi007.stdout:5.15.0-122-generic 2024-09-21T09:00:06.607 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-21T09:00:06.607 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T09:00:06.607 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-21T09:00:07.609 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T09:00:07.609 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T09:00:07.677 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2024-09-21T09:00:07.713 DEBUG:teuthology.parallel:result is None 2024-09-21T09:00:11.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-21T09:00:11.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T09:00:11.759 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-21T09:00:12.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-21T09:00:12.416 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-21T09:00:12.417 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-21T09:00:12.464 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-122-generic 2024-09-21T09:00:12.465 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-21T09:00:12.465 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T09:00:12.465 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-21T09:00:13.466 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T09:00:13.466 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T09:00:13.560 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2024-09-21T09:00:13.591 DEBUG:teuthology.parallel:result is None 2024-09-21T09:00:13.591 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T09:00:13.597 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T09:00:13.597 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T09:00:13.600 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T09:00:13.606 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T09:00:13.613 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T09:00:13.620 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T09:00:13.620 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T09:00:13.648 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T09:00:13.663 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T09:00:13.669 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T09:00:13.669 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T09:00:13.700 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T09:00:13.716 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T09:00:13.725 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T09:00:13.725 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T09:00:13.734 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T09:00:13.736 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T09:00:13.742 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T09:00:13.742 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T09:00:13.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T09:00:13.792 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T09:00:13.800 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T09:00:13.800 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T09:00:13.828 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T09:00:13.840 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T09:00:13.879 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T09:00:13.928 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:00:13.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T09:00:13.998 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T09:00:14.004 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T09:00:14.052 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:00:14.052 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T09:00:14.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-09-21T09:00:14.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-09-21T09:00:14.186 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T09:00:14.193 INFO:teuthology.task.internal:Starting timer... 2024-09-21T09:00:14.193 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T09:00:14.204 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T09:00:14.212 DEBUG:teuthology.task.selinux:Excluding smithi007: OS 'ubuntu' does not support SELinux 2024-09-21T09:00:14.212 DEBUG:teuthology.task.selinux:Excluding smithi050: OS 'ubuntu' does not support SELinux 2024-09-21T09:00:14.213 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T09:00:14.213 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-21T09:00:14.213 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T09:00:14.213 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T09:00:14.220 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T09:00:14.222 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T09:00:14.324 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T09:00:14.335 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T09:00:14.336 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi050.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T09:07:55.396 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi050.front.sepia.ceph.com')] 2024-09-21T09:07:55.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T09:07:55.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T09:07:55.479 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-21T09:07:55.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T09:07:55.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-21T09:07:55.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T09:07:55.638 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-21T09:07:55.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-21T09:07:55.715 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T09:07:55.731 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T09:07:55.732 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T09:07:55.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T09:07:55.734 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T09:07:55.735 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T09:07:55.762 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-21T09:07:55.762 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: Command line: ntpd -gq 2024-09-21T09:07:55.762 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: ---------------------------------------------------- 2024-09-21T09:07:55.762 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: ntp-4 is maintained by Network Time Foundation, 2024-09-21T09:07:55.762 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-21T09:07:55.762 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: corporation. Support and training for ntp-4 are 2024-09-21T09:07:55.762 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: available at https://www.nwtime.org/support 2024-09-21T09:07:55.762 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: ---------------------------------------------------- 2024-09-21T09:07:55.763 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: proto: precision = 0.066 usec (-24) 2024-09-21T09:07:55.763 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: basedate set to 2022-02-04 2024-09-21T09:07:55.763 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: gps base set to 2022-02-06 (week 2196) 2024-09-21T09:07:55.763 INFO:teuthology.orchestra.run.smithi007.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T09:07:55.764 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T09:07:55.764 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: restrict ::: KOD does nothing without LIMITED. 2024-09-21T09:07:55.764 INFO:teuthology.orchestra.run.smithi007.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-21T09:07:55.765 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: Listen and drop on 0 v6wildcard [::]:123 2024-09-21T09:07:55.765 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-21T09:07:55.765 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: Listen normally on 2 lo 127.0.0.1:123 2024-09-21T09:07:55.765 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: Listen normally on 3 ens1f0 172.21.15.7:123 2024-09-21T09:07:55.765 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: Listen normally on 4 lo [::1]:123 2024-09-21T09:07:55.765 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15ea%4]:123 2024-09-21T09:07:55.765 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:07:55 ntpd[18406]: Listening on routing socket on fd #22 for interface updates 2024-09-21T09:07:55.782 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-21T09:07:55.782 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: Command line: ntpd -gq 2024-09-21T09:07:55.782 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: ---------------------------------------------------- 2024-09-21T09:07:55.782 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: ntp-4 is maintained by Network Time Foundation, 2024-09-21T09:07:55.783 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-21T09:07:55.783 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: corporation. Support and training for ntp-4 are 2024-09-21T09:07:55.783 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: available at https://www.nwtime.org/support 2024-09-21T09:07:55.783 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: ---------------------------------------------------- 2024-09-21T09:07:55.783 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: proto: precision = 0.046 usec (-24) 2024-09-21T09:07:55.784 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: basedate set to 2022-02-04 2024-09-21T09:07:55.784 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: gps base set to 2022-02-06 (week 2196) 2024-09-21T09:07:55.784 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T09:07:55.784 INFO:teuthology.orchestra.run.smithi050.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T09:07:55.784 INFO:teuthology.orchestra.run.smithi050.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-21T09:07:55.785 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: restrict ::: KOD does nothing without LIMITED. 2024-09-21T09:07:55.785 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: Listen and drop on 0 v6wildcard [::]:123 2024-09-21T09:07:55.785 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-21T09:07:55.785 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: Listen normally on 2 lo 127.0.0.1:123 2024-09-21T09:07:55.785 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: Listen normally on 3 ens1f0 172.21.15.50:123 2024-09-21T09:07:55.785 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: Listen normally on 4 lo [::1]:123 2024-09-21T09:07:55.785 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1584%3]:123 2024-09-21T09:07:55.785 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:07:55 ntpd[18355]: Listening on routing socket on fd #22 for interface updates 2024-09-21T09:07:56.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:56 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:56.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:56 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:56.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:56 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:56.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:56 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:56.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:56 ntpd[18406]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:56.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:56 ntpd[18406]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:07:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:56 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:56 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:56 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:56 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:56 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:56 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:56 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:56 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:07:57.762 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:57 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:57 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:57 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:57 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:57 ntpd[18406]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:57 ntpd[18406]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:07:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:57 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:07:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:58 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:58 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:58 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:58 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:58 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:58 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:58 ntpd[18406]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:58 ntpd[18406]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:07:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:58 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:58 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:58 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:58 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:58 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:58 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:07:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:07:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:07:59 ntpd[18406]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:07:59.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:07:59.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:07:59 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:08:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:00 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:00 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:00 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:00 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:00 ntpd[18406]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:08:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:00 ntpd[18406]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:08:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:00 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:00 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:00 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:00 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:00 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:08:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:00 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:08:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:01.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:01.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:01.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:01.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:01.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:01.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:08:01.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:08:01.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:01.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:01.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:08:01.765 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:01 ntpd[18406]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:08:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:01 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:08:02.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:02 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:02.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:02 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:02.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:02 ntpd[18406]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:02.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:02 ntpd[18406]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:02.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:02 ntpd[18406]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:08:02.763 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:02 ntpd[18406]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:08:02.763 INFO:teuthology.orchestra.run.smithi007.stdout:21 Sep 09:08:02 ntpd[18406]: ntpd: time slew -0.000474 s 2024-09-21T09:08:02.763 INFO:teuthology.orchestra.run.smithi007.stdout:ntpd: time slew -0.000474s 2024-09-21T09:08:02.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:02 ntpd[18406]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-21T09:08:02.764 INFO:teuthology.orchestra.run.smithi007.stderr:21 Sep 09:08:02 ntpd[18406]: can't open /var/log/ntpstats/loopstats.20240921: Permission denied 2024-09-21T09:08:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:02 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:02 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:02 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T09:08:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:02 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T09:08:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:02 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T09:08:02.783 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:02 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T09:08:02.784 INFO:teuthology.orchestra.run.smithi050.stdout:21 Sep 09:08:02 ntpd[18355]: ntpd: time slew -0.000715 s 2024-09-21T09:08:02.784 INFO:teuthology.orchestra.run.smithi050.stdout:ntpd: time slew -0.000715s 2024-09-21T09:08:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:02 ntpd[18355]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-21T09:08:02.784 INFO:teuthology.orchestra.run.smithi050.stderr:21 Sep 09:08:02 ntpd[18355]: can't open /var/log/ntpstats/loopstats.20240921: Permission denied 2024-09-21T09:08:02.813 INFO:teuthology.orchestra.run.smithi007.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T09:08:02.813 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================== 2024-09-21T09:08:02.813 INFO:teuthology.orchestra.run.smithi007.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T09:08:02.813 INFO:teuthology.orchestra.run.smithi007.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T09:08:02.813 INFO:teuthology.orchestra.run.smithi007.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T09:08:02.813 INFO:teuthology.orchestra.run.smithi007.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T09:08:02.942 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T09:08:02.942 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-09-21T09:08:02.942 INFO:teuthology.orchestra.run.smithi050.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T09:08:02.942 INFO:teuthology.orchestra.run.smithi050.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T09:08:02.942 INFO:teuthology.orchestra.run.smithi050.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T09:08:02.942 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T09:08:02.943 INFO:teuthology.run_tasks:Running task install... 2024-09-21T09:08:02.951 DEBUG:teuthology.task.install:project ceph 2024-09-21T09:08:02.951 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}} 2024-09-21T09:08:02.951 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'} 2024-09-21T09:08:02.951 INFO:teuthology.task.install:Using flavor: default 2024-09-21T09:08:02.956 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T09:08:02.956 INFO:teuthology.task.install:extra packages: [] 2024-09-21T09:08:02.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-key list | grep Ceph 2024-09-21T09:08:02.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-key list | grep Ceph 2024-09-21T09:08:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-21T09:08:03.050 INFO:teuthology.orchestra.run.smithi007.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-21T09:08:03.050 INFO:teuthology.orchestra.run.smithi007.stdout:uid [ unknown] Ceph.com (release key) 2024-09-21T09:08:03.050 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-21T09:08:03.051 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T09:08:03.057 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-21T09:08:03.090 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-21T09:08:03.090 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph.com (release key) 2024-09-21T09:08:03.091 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-21T09:08:03.091 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T09:08:03.193 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-21T09:08:03.193 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-21T09:08:03.227 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-21T09:08:03.227 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-21T09:08:03.303 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:08:03.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-21T09:08:03.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2024-09-21T09:08:03.332 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:08:03.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-21T09:08:03.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-09-21T09:08:03.515 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T09:08:03.546 INFO:teuthology.orchestra.run.smithi007.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-21T09:08:03.567 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-21T09:08:03.568 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-21T09:08:03.589 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-21T09:08:03.590 INFO:teuthology.orchestra.run.smithi007.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-21T09:08:03.610 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-21T09:08:03.611 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-21T09:08:03.631 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-21T09:08:03.637 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T09:08:03.639 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T09:08:03.639 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T09:08:03.642 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-21T09:08:03.659 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-21T09:08:03.713 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T09:08:03.719 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T09:08:03.794 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T09:08:03.799 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T09:08:03.947 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 28.3 kB in 0s (68.4 kB/s) 2024-09-21T09:08:04.021 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 28.3 kB in 1s (55.0 kB/s) 2024-09-21T09:08:04.989 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-21T09:08:05.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-21T09:08:05.071 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-21T09:08:05.082 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-21T09:08:05.099 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-21T09:08:05.164 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-21T09:08:05.286 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-21T09:08:05.286 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-21T09:08:05.378 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-09-21T09:08:05.379 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-09-21T09:08:05.499 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T09:08:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T09:08:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T09:08:05.499 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T09:08:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T09:08:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T09:08:05.500 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T09:08:05.500 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-09-21T09:08:05.500 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-21T09:08:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-21T09:08:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-21T09:08:05.501 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-21T09:08:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-21T09:08:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-21T09:08:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-21T09:08:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-21T09:08:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-21T09:08:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-21T09:08:05.502 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-21T09:08:05.503 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet zip 2024-09-21T09:08:05.504 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-09-21T09:08:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-21T09:08:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-21T09:08:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-21T09:08:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-21T09:08:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-21T09:08:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-21T09:08:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-21T09:08:05.504 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-09-21T09:08:05.504 INFO:teuthology.orchestra.run.smithi050.stdout: btrfs-tools 2024-09-21T09:08:05.601 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T09:08:05.601 INFO:teuthology.orchestra.run.smithi007.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T09:08:05.602 INFO:teuthology.orchestra.run.smithi007.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T09:08:05.602 INFO:teuthology.orchestra.run.smithi007.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T09:08:05.602 INFO:teuthology.orchestra.run.smithi007.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T09:08:05.602 INFO:teuthology.orchestra.run.smithi007.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T09:08:05.603 INFO:teuthology.orchestra.run.smithi007.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T09:08:05.603 INFO:teuthology.orchestra.run.smithi007.stdout:The following additional packages will be installed: 2024-09-21T09:08:05.603 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-21T09:08:05.604 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-21T09:08:05.604 INFO:teuthology.orchestra.run.smithi007.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-21T09:08:05.604 INFO:teuthology.orchestra.run.smithi007.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-21T09:08:05.605 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-21T09:08:05.605 INFO:teuthology.orchestra.run.smithi007.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-21T09:08:05.605 INFO:teuthology.orchestra.run.smithi007.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-21T09:08:05.605 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-21T09:08:05.605 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-21T09:08:05.605 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-21T09:08:05.605 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-21T09:08:05.605 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-21T09:08:05.605 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-21T09:08:05.606 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet zip 2024-09-21T09:08:05.607 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2024-09-21T09:08:05.607 INFO:teuthology.orchestra.run.smithi007.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-21T09:08:05.607 INFO:teuthology.orchestra.run.smithi007.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-21T09:08:05.607 INFO:teuthology.orchestra.run.smithi007.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-21T09:08:05.607 INFO:teuthology.orchestra.run.smithi007.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-21T09:08:05.607 INFO:teuthology.orchestra.run.smithi007.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-21T09:08:05.607 INFO:teuthology.orchestra.run.smithi007.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-21T09:08:05.607 INFO:teuthology.orchestra.run.smithi007.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-21T09:08:05.607 INFO:teuthology.orchestra.run.smithi007.stdout:Recommended packages: 2024-09-21T09:08:05.607 INFO:teuthology.orchestra.run.smithi007.stdout: btrfs-tools 2024-09-21T09:08:05.610 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-09-21T09:08:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-21T09:08:05.610 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-21T09:08:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-21T09:08:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-21T09:08:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-21T09:08:05.611 INFO:teuthology.orchestra.run.smithi050.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-21T09:08:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-21T09:08:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-21T09:08:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-21T09:08:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-21T09:08:05.612 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-21T09:08:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-21T09:08:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-21T09:08:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-21T09:08:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-21T09:08:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-21T09:08:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-21T09:08:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-21T09:08:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-21T09:08:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-21T09:08:05.613 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-21T09:08:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-21T09:08:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-21T09:08:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-21T09:08:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-21T09:08:05.614 INFO:teuthology.orchestra.run.smithi050.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-21T09:08:05.714 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2024-09-21T09:08:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-21T09:08:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-21T09:08:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-21T09:08:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-21T09:08:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-21T09:08:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-21T09:08:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-21T09:08:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-21T09:08:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-21T09:08:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-21T09:08:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-21T09:08:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-21T09:08:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-21T09:08:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-21T09:08:05.718 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-21T09:08:05.718 INFO:teuthology.orchestra.run.smithi007.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-21T09:08:05.759 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-21T09:08:05.759 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 181 MB of archives. 2024-09-21T09:08:05.759 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-21T09:08:05.759 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-21T09:08:05.803 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-21T09:08:05.860 INFO:teuthology.orchestra.run.smithi007.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-21T09:08:05.860 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 181 MB of archives. 2024-09-21T09:08:05.860 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-21T09:08:05.861 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-21T09:08:05.907 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-21T09:08:06.051 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-21T09:08:06.149 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-21T09:08:06.174 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-21T09:08:06.197 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-21T09:08:06.204 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-21T09:08:06.205 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-21T09:08:06.210 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-21T09:08:06.217 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-21T09:08:06.224 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-21T09:08:06.225 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-21T09:08:06.238 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-21T09:08:06.271 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-21T09:08:06.295 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-21T09:08:06.302 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-21T09:08:06.303 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-21T09:08:06.307 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-21T09:08:06.316 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-21T09:08:06.319 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-21T09:08:06.323 INFO:teuthology.orchestra.run.smithi007.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-21T09:08:06.329 INFO:teuthology.orchestra.run.smithi007.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-21T09:08:06.341 INFO:teuthology.orchestra.run.smithi007.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-21T09:08:06.422 INFO:teuthology.orchestra.run.smithi007.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-21T09:08:06.436 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-21T09:08:06.438 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-21T09:08:06.448 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-21T09:08:06.549 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-21T09:08:06.559 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-21T09:08:06.570 INFO:teuthology.orchestra.run.smithi007.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-21T09:08:06.572 INFO:teuthology.orchestra.run.smithi007.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-21T09:08:06.589 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-21T09:08:06.597 INFO:teuthology.orchestra.run.smithi007.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-21T09:08:06.598 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-21T09:08:06.599 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-21T09:08:06.601 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-21T09:08:06.618 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-21T09:08:06.622 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-21T09:08:06.627 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-21T09:08:06.631 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-21T09:08:06.650 INFO:teuthology.orchestra.run.smithi007.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-21T09:08:06.661 INFO:teuthology.orchestra.run.smithi007.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-21T09:08:06.691 INFO:teuthology.orchestra.run.smithi007.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-21T09:08:06.700 INFO:teuthology.orchestra.run.smithi007.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-21T09:08:06.701 INFO:teuthology.orchestra.run.smithi007.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-21T09:08:06.702 INFO:teuthology.orchestra.run.smithi007.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-21T09:08:06.712 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-21T09:08:06.716 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-21T09:08:06.720 INFO:teuthology.orchestra.run.smithi007.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-21T09:08:06.721 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-21T09:08:06.724 INFO:teuthology.orchestra.run.smithi007.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-21T09:08:06.725 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-21T09:08:06.726 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-21T09:08:06.727 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-21T09:08:06.729 INFO:teuthology.orchestra.run.smithi007.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-21T09:08:06.729 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-21T09:08:06.730 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-21T09:08:06.730 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-21T09:08:06.732 INFO:teuthology.orchestra.run.smithi007.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-21T09:08:06.794 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-21T09:08:06.813 INFO:teuthology.orchestra.run.smithi007.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-21T09:08:06.813 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-21T09:08:06.814 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-21T09:08:06.815 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-21T09:08:06.817 INFO:teuthology.orchestra.run.smithi007.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-21T09:08:06.820 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-21T09:08:06.821 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-21T09:08:06.822 INFO:teuthology.orchestra.run.smithi007.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-21T09:08:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-21T09:08:06.827 INFO:teuthology.orchestra.run.smithi007.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-21T09:08:06.828 INFO:teuthology.orchestra.run.smithi007.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-21T09:08:06.830 INFO:teuthology.orchestra.run.smithi007.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-21T09:08:06.830 INFO:teuthology.orchestra.run.smithi007.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-21T09:08:06.831 INFO:teuthology.orchestra.run.smithi007.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-21T09:08:06.876 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-21T09:08:06.876 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-21T09:08:06.879 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-21T09:08:06.881 INFO:teuthology.orchestra.run.smithi050.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-21T09:08:06.894 INFO:teuthology.orchestra.run.smithi007.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-21T09:08:06.914 INFO:teuthology.orchestra.run.smithi007.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-21T09:08:06.914 INFO:teuthology.orchestra.run.smithi007.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-21T09:08:06.915 INFO:teuthology.orchestra.run.smithi007.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-21T09:08:06.920 INFO:teuthology.orchestra.run.smithi007.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-21T09:08:06.921 INFO:teuthology.orchestra.run.smithi007.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-21T09:08:06.957 INFO:teuthology.orchestra.run.smithi050.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-21T09:08:06.960 INFO:teuthology.orchestra.run.smithi050.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-21T09:08:06.961 INFO:teuthology.orchestra.run.smithi050.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-21T09:08:06.962 INFO:teuthology.orchestra.run.smithi050.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-21T09:08:06.973 INFO:teuthology.orchestra.run.smithi050.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-21T09:08:06.976 INFO:teuthology.orchestra.run.smithi007.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-21T09:08:06.977 INFO:teuthology.orchestra.run.smithi007.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-21T09:08:06.979 INFO:teuthology.orchestra.run.smithi007.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-21T09:08:06.979 INFO:teuthology.orchestra.run.smithi007.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-21T09:08:07.038 INFO:teuthology.orchestra.run.smithi050.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-21T09:08:07.039 INFO:teuthology.orchestra.run.smithi050.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-21T09:08:07.041 INFO:teuthology.orchestra.run.smithi050.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-21T09:08:07.043 INFO:teuthology.orchestra.run.smithi050.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-21T09:08:07.047 INFO:teuthology.orchestra.run.smithi050.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-21T09:08:07.057 INFO:teuthology.orchestra.run.smithi007.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-21T09:08:07.059 INFO:teuthology.orchestra.run.smithi007.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-21T09:08:07.060 INFO:teuthology.orchestra.run.smithi007.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-21T09:08:07.061 INFO:teuthology.orchestra.run.smithi007.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-21T09:08:07.072 INFO:teuthology.orchestra.run.smithi007.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-21T09:08:07.120 INFO:teuthology.orchestra.run.smithi050.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-21T09:08:07.123 INFO:teuthology.orchestra.run.smithi050.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-21T09:08:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-21T09:08:07.129 INFO:teuthology.orchestra.run.smithi050.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-21T09:08:07.130 INFO:teuthology.orchestra.run.smithi050.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-21T09:08:07.138 INFO:teuthology.orchestra.run.smithi007.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-21T09:08:07.139 INFO:teuthology.orchestra.run.smithi007.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-21T09:08:07.140 INFO:teuthology.orchestra.run.smithi007.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-21T09:08:07.142 INFO:teuthology.orchestra.run.smithi007.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-21T09:08:07.146 INFO:teuthology.orchestra.run.smithi007.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-21T09:08:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-21T09:08:07.206 INFO:teuthology.orchestra.run.smithi050.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-21T09:08:07.219 INFO:teuthology.orchestra.run.smithi007.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-21T09:08:07.222 INFO:teuthology.orchestra.run.smithi007.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-21T09:08:07.223 INFO:teuthology.orchestra.run.smithi007.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-21T09:08:07.228 INFO:teuthology.orchestra.run.smithi007.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-21T09:08:07.229 INFO:teuthology.orchestra.run.smithi007.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-21T09:08:07.300 INFO:teuthology.orchestra.run.smithi007.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-21T09:08:07.305 INFO:teuthology.orchestra.run.smithi007.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-21T09:08:07.349 INFO:teuthology.orchestra.run.smithi050.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-21T09:08:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-21T09:08:07.369 INFO:teuthology.orchestra.run.smithi050.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-21T09:08:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-21T09:08:07.372 INFO:teuthology.orchestra.run.smithi050.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-21T09:08:07.375 INFO:teuthology.orchestra.run.smithi050.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-21T09:08:07.414 INFO:teuthology.orchestra.run.smithi050.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-21T09:08:07.417 INFO:teuthology.orchestra.run.smithi050.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-21T09:08:07.418 INFO:teuthology.orchestra.run.smithi050.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-21T09:08:07.446 INFO:teuthology.orchestra.run.smithi050.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-21T09:08:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-21T09:08:07.454 INFO:teuthology.orchestra.run.smithi050.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-21T09:08:07.472 INFO:teuthology.orchestra.run.smithi050.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-21T09:08:07.472 INFO:teuthology.orchestra.run.smithi050.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-21T09:08:07.516 INFO:teuthology.orchestra.run.smithi050.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-21T09:08:07.534 INFO:teuthology.orchestra.run.smithi050.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-21T09:08:07.535 INFO:teuthology.orchestra.run.smithi050.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-21T09:08:07.535 INFO:teuthology.orchestra.run.smithi050.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-21T09:08:07.537 INFO:teuthology.orchestra.run.smithi050.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-21T09:08:07.537 INFO:teuthology.orchestra.run.smithi050.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-21T09:08:07.538 INFO:teuthology.orchestra.run.smithi050.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-21T09:08:07.545 INFO:teuthology.orchestra.run.smithi050.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-21T09:08:07.554 INFO:teuthology.orchestra.run.smithi007.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-21T09:08:07.570 INFO:teuthology.orchestra.run.smithi007.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-21T09:08:07.571 INFO:teuthology.orchestra.run.smithi007.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-21T09:08:07.573 INFO:teuthology.orchestra.run.smithi007.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-21T09:08:07.574 INFO:teuthology.orchestra.run.smithi007.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-21T09:08:07.576 INFO:teuthology.orchestra.run.smithi007.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-21T09:08:07.615 INFO:teuthology.orchestra.run.smithi050.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-21T09:08:07.618 INFO:teuthology.orchestra.run.smithi050.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-21T09:08:07.620 INFO:teuthology.orchestra.run.smithi050.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-21T09:08:07.621 INFO:teuthology.orchestra.run.smithi007.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-21T09:08:07.625 INFO:teuthology.orchestra.run.smithi007.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-21T09:08:07.626 INFO:teuthology.orchestra.run.smithi007.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-21T09:08:07.658 INFO:teuthology.orchestra.run.smithi007.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-21T09:08:07.663 INFO:teuthology.orchestra.run.smithi007.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-21T09:08:07.664 INFO:teuthology.orchestra.run.smithi007.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-21T09:08:07.664 INFO:teuthology.orchestra.run.smithi007.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-21T09:08:07.665 INFO:teuthology.orchestra.run.smithi007.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-21T09:08:07.677 INFO:teuthology.orchestra.run.smithi050.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-21T09:08:07.697 INFO:teuthology.orchestra.run.smithi050.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-21T09:08:07.703 INFO:teuthology.orchestra.run.smithi050.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-21T09:08:07.706 INFO:teuthology.orchestra.run.smithi050.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-21T09:08:07.707 INFO:teuthology.orchestra.run.smithi050.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-21T09:08:07.719 INFO:teuthology.orchestra.run.smithi050.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-21T09:08:07.720 INFO:teuthology.orchestra.run.smithi050.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-21T09:08:07.728 INFO:teuthology.orchestra.run.smithi050.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-21T09:08:07.729 INFO:teuthology.orchestra.run.smithi007.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-21T09:08:07.734 INFO:teuthology.orchestra.run.smithi007.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-21T09:08:07.735 INFO:teuthology.orchestra.run.smithi007.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-21T09:08:07.736 INFO:teuthology.orchestra.run.smithi007.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-21T09:08:07.738 INFO:teuthology.orchestra.run.smithi007.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-21T09:08:07.738 INFO:teuthology.orchestra.run.smithi007.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-21T09:08:07.740 INFO:teuthology.orchestra.run.smithi007.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-21T09:08:07.747 INFO:teuthology.orchestra.run.smithi007.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-21T09:08:07.778 INFO:teuthology.orchestra.run.smithi050.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-21T09:08:07.779 INFO:teuthology.orchestra.run.smithi050.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-21T09:08:07.780 INFO:teuthology.orchestra.run.smithi050.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-21T09:08:07.815 INFO:teuthology.orchestra.run.smithi007.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-21T09:08:07.819 INFO:teuthology.orchestra.run.smithi007.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-21T09:08:07.820 INFO:teuthology.orchestra.run.smithi007.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-21T09:08:07.859 INFO:teuthology.orchestra.run.smithi050.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-21T09:08:07.861 INFO:teuthology.orchestra.run.smithi050.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-21T09:08:07.879 INFO:teuthology.orchestra.run.smithi050.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-21T09:08:07.879 INFO:teuthology.orchestra.run.smithi050.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-21T09:08:07.880 INFO:teuthology.orchestra.run.smithi050.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-21T09:08:07.886 INFO:teuthology.orchestra.run.smithi050.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-21T09:08:07.888 INFO:teuthology.orchestra.run.smithi050.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-21T09:08:07.897 INFO:teuthology.orchestra.run.smithi007.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-21T09:08:07.903 INFO:teuthology.orchestra.run.smithi007.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-21T09:08:07.905 INFO:teuthology.orchestra.run.smithi007.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-21T09:08:07.907 INFO:teuthology.orchestra.run.smithi007.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-21T09:08:07.918 INFO:teuthology.orchestra.run.smithi007.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-21T09:08:07.919 INFO:teuthology.orchestra.run.smithi007.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-21T09:08:07.927 INFO:teuthology.orchestra.run.smithi007.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-21T09:08:07.952 INFO:teuthology.orchestra.run.smithi007.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-21T09:08:07.978 INFO:teuthology.orchestra.run.smithi007.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-21T09:08:07.980 INFO:teuthology.orchestra.run.smithi007.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-21T09:08:07.980 INFO:teuthology.orchestra.run.smithi007.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-21T09:08:08.059 INFO:teuthology.orchestra.run.smithi007.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-21T09:08:08.061 INFO:teuthology.orchestra.run.smithi007.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-21T09:08:08.078 INFO:teuthology.orchestra.run.smithi007.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-21T09:08:08.079 INFO:teuthology.orchestra.run.smithi007.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-21T09:08:08.079 INFO:teuthology.orchestra.run.smithi007.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-21T09:08:08.084 INFO:teuthology.orchestra.run.smithi007.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-21T09:08:08.086 INFO:teuthology.orchestra.run.smithi007.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-21T09:08:08.437 INFO:teuthology.orchestra.run.smithi050.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-21T09:08:08.438 INFO:teuthology.orchestra.run.smithi050.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-21T09:08:08.455 INFO:teuthology.orchestra.run.smithi050.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-21T09:08:08.497 INFO:teuthology.orchestra.run.smithi050.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-21T09:08:08.507 INFO:teuthology.orchestra.run.smithi050.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-21T09:08:08.509 INFO:teuthology.orchestra.run.smithi050.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-21T09:08:08.583 INFO:teuthology.orchestra.run.smithi050.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-21T09:08:08.825 INFO:teuthology.orchestra.run.smithi050.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-21T09:08:08.826 INFO:teuthology.orchestra.run.smithi050.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-21T09:08:08.843 INFO:teuthology.orchestra.run.smithi007.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-21T09:08:08.844 INFO:teuthology.orchestra.run.smithi007.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-21T09:08:08.862 INFO:teuthology.orchestra.run.smithi007.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-21T09:08:08.904 INFO:teuthology.orchestra.run.smithi007.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-21T09:08:08.929 INFO:teuthology.orchestra.run.smithi007.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-21T09:08:08.933 INFO:teuthology.orchestra.run.smithi007.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-21T09:08:09.012 INFO:teuthology.orchestra.run.smithi007.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-21T09:08:09.322 INFO:teuthology.orchestra.run.smithi007.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-21T09:08:09.323 INFO:teuthology.orchestra.run.smithi007.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-21T09:08:10.616 INFO:teuthology.orchestra.run.smithi050.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-21T09:08:10.619 INFO:teuthology.orchestra.run.smithi050.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-21T09:08:10.620 INFO:teuthology.orchestra.run.smithi050.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-21T09:08:11.012 INFO:teuthology.orchestra.run.smithi050.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-21T09:08:11.234 INFO:teuthology.orchestra.run.smithi007.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-21T09:08:11.237 INFO:teuthology.orchestra.run.smithi007.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-21T09:08:11.238 INFO:teuthology.orchestra.run.smithi007.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-21T09:08:11.428 INFO:teuthology.orchestra.run.smithi007.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-21T09:08:11.615 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 181 MB in 5s (33.6 MB/s) 2024-09-21T09:08:11.779 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-21T09:08:11.882 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-21T09:08:11.888 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-21T09:08:11.986 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T09:08:12.023 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 181 MB in 6s (31.7 MB/s) 2024-09-21T09:08:12.303 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-21T09:08:12.322 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-21T09:08:12.349 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-21T09:08:12.389 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T09:08:12.408 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-21T09:08:12.414 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-21T09:08:12.510 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T09:08:12.725 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-21T09:08:12.752 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-21T09:08:12.792 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T09:08:12.856 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-21T09:08:12.882 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-21T09:08:12.922 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T09:08:13.212 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-21T09:08:13.233 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-21T09:08:13.239 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T09:08:13.260 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-21T09:08:13.287 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:08:13.300 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T09:08:13.715 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-21T09:08:13.742 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T09:08:13.779 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-21T09:08:13.782 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:08:13.806 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T09:08:13.854 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:08:14.101 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-21T09:08:14.128 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T09:08:14.168 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:08:14.215 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-21T09:08:14.242 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T09:08:14.274 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:08:14.610 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-21T09:08:14.613 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-21T09:08:14.637 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T09:08:14.640 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-21T09:08:14.677 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:08:14.679 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T09:08:14.999 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librados2. 2024-09-21T09:08:15.026 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:15.055 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-21T09:08:15.065 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:15.082 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-21T09:08:15.122 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T09:08:15.425 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librados2. 2024-09-21T09:08:15.451 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:15.483 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:15.518 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librbd1. 2024-09-21T09:08:15.545 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:15.593 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:15.903 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librbd1. 2024-09-21T09:08:15.929 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:15.969 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:15.988 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs2. 2024-09-21T09:08:16.003 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:16.037 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:16.315 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rados. 2024-09-21T09:08:16.342 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:16.381 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:16.406 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libcephfs2. 2024-09-21T09:08:16.432 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:16.464 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:16.701 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-21T09:08:16.718 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:16.741 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rados. 2024-09-21T09:08:16.757 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:16.759 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:16.800 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:17.012 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cephfs. 2024-09-21T09:08:17.028 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:17.087 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:17.127 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-21T09:08:17.154 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:17.194 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:17.447 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cephfs. 2024-09-21T09:08:17.465 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:17.505 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:17.556 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-21T09:08:17.583 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:17.614 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:17.808 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-21T09:08:17.835 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:17.874 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:17.909 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-21T09:08:17.936 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-21T09:08:17.976 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T09:08:18.211 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-21T09:08:18.238 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-21T09:08:18.279 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T09:08:18.537 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-prettytable. 2024-09-21T09:08:18.566 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-21T09:08:18.603 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-21T09:08:18.632 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-prettytable. 2024-09-21T09:08:18.659 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-21T09:08:18.699 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-21T09:08:18.848 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rbd. 2024-09-21T09:08:18.875 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:18.906 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:18.960 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rbd. 2024-09-21T09:08:18.976 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:19.018 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:19.234 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-21T09:08:19.261 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-21T09:08:19.300 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T09:08:19.371 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-21T09:08:19.398 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-21T09:08:19.437 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T09:08:19.578 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-21T09:08:19.595 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-21T09:08:19.628 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-21T09:08:19.682 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-21T09:08:19.698 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-21T09:08:19.740 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-21T09:08:19.906 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-21T09:08:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-21T09:08:19.973 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-21T09:08:20.043 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-21T09:08:20.063 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-21T09:08:20.101 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-21T09:08:20.293 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua5.1. 2024-09-21T09:08:20.319 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-21T09:08:20.359 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-21T09:08:20.446 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package lua5.1. 2024-09-21T09:08:20.473 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-21T09:08:20.512 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-21T09:08:20.696 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-any. 2024-09-21T09:08:20.711 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-21T09:08:20.746 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-21T09:08:20.807 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package lua-any. 2024-09-21T09:08:20.823 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-21T09:08:20.857 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-21T09:08:20.957 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package zip. 2024-09-21T09:08:20.983 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-21T09:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking zip (3.0-12build2) ... 2024-09-21T09:08:21.093 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package zip. 2024-09-21T09:08:21.109 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-21T09:08:21.151 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking zip (3.0-12build2) ... 2024-09-21T09:08:21.301 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package unzip. 2024-09-21T09:08:21.330 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-21T09:08:21.359 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-21T09:08:21.463 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package unzip. 2024-09-21T09:08:21.489 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-21T09:08:21.529 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-21T09:08:21.747 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package luarocks. 2024-09-21T09:08:21.773 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-21T09:08:21.813 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-21T09:08:21.933 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package luarocks. 2024-09-21T09:08:21.960 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-21T09:08:22.000 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-21T09:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librgw2. 2024-09-21T09:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:22.263 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:22.391 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librgw2. 2024-09-21T09:08:22.418 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:22.474 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:22.974 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rgw. 2024-09-21T09:08:22.998 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:23.040 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:23.051 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rgw. 2024-09-21T09:08:23.067 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:23.101 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:23.318 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-21T09:08:23.345 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-21T09:08:23.376 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T09:08:23.429 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-21T09:08:23.456 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-21T09:08:23.496 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T09:08:23.671 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libradosstriper1. 2024-09-21T09:08:23.698 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:23.737 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:23.815 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libradosstriper1. 2024-09-21T09:08:23.842 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:23.882 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:24.166 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-common. 2024-09-21T09:08:24.193 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:24.249 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:24.552 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-common. 2024-09-21T09:08:24.579 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:24.610 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:25.829 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-base. 2024-09-21T09:08:25.856 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:25.906 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:26.049 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-base. 2024-09-21T09:08:26.076 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:26.125 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:26.475 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-21T09:08:26.502 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-21T09:08:26.550 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-21T09:08:26.728 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-21T09:08:26.755 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-21T09:08:26.794 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-21T09:08:26.861 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cheroot. 2024-09-21T09:08:26.888 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-21T09:08:26.928 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T09:08:27.089 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cheroot. 2024-09-21T09:08:27.116 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-21T09:08:27.155 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T09:08:27.247 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-21T09:08:27.274 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-21T09:08:27.314 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-21T09:08:27.483 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-21T09:08:27.510 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-21T09:08:27.550 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-21T09:08:27.583 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-21T09:08:27.599 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-21T09:08:27.633 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-21T09:08:27.802 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-21T09:08:27.829 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-21T09:08:27.869 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-21T09:08:28.128 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-21T09:08:28.155 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-21T09:08:28.180 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-21T09:08:28.194 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-21T09:08:28.207 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-21T09:08:28.247 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-21T09:08:28.497 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempora. 2024-09-21T09:08:28.524 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-21T09:08:28.550 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-tempora. 2024-09-21T09:08:28.564 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-21T09:08:28.577 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-21T09:08:28.616 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-21T09:08:28.842 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-portend. 2024-09-21T09:08:28.858 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-21T09:08:28.885 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-portend. 2024-09-21T09:08:28.891 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-21T09:08:28.902 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-21T09:08:28.935 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-21T09:08:29.178 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-21T09:08:29.205 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-21T09:08:29.213 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-21T09:08:29.240 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-21T09:08:29.244 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-21T09:08:29.288 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-21T09:08:29.547 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-21T09:08:29.574 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-21T09:08:29.629 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-21T09:08:29.800 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-21T09:08:29.830 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-21T09:08:29.866 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-21T09:08:29.926 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-natsort. 2024-09-21T09:08:29.942 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-21T09:08:29.975 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-21T09:08:30.279 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-logutils. 2024-09-21T09:08:30.294 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-natsort. 2024-09-21T09:08:30.306 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-21T09:08:30.322 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-21T09:08:30.345 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-21T09:08:30.369 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-21T09:08:30.648 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-21T09:08:30.675 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-21T09:08:30.715 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-21T09:08:30.756 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-logutils. 2024-09-21T09:08:30.783 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-21T09:08:30.822 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-21T09:08:31.018 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-mako. 2024-09-21T09:08:31.045 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-21T09:08:31.109 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T09:08:31.125 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-21T09:08:31.153 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-21T09:08:31.191 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-21T09:08:31.454 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-21T09:08:31.481 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-21T09:08:31.503 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-mako. 2024-09-21T09:08:31.512 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-21T09:08:31.530 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-21T09:08:31.578 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T09:08:31.790 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-21T09:08:31.817 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-21T09:08:31.857 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-21T09:08:31.989 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-21T09:08:32.017 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-21T09:08:32.064 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-21T09:08:32.159 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webob. 2024-09-21T09:08:32.186 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-21T09:08:32.226 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T09:08:32.417 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-21T09:08:32.444 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-21T09:08:32.492 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-21T09:08:32.571 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-waitress. 2024-09-21T09:08:32.598 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-21T09:08:32.641 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T09:08:32.786 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webob. 2024-09-21T09:08:32.814 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-21T09:08:32.853 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T09:08:32.957 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempita. 2024-09-21T09:08:32.984 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-21T09:08:33.023 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T09:08:33.223 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-waitress. 2024-09-21T09:08:33.250 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-21T09:08:33.285 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-paste. 2024-09-21T09:08:33.292 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T09:08:33.312 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-21T09:08:33.343 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T09:08:33.609 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-tempita. 2024-09-21T09:08:33.636 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-21T09:08:33.683 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T09:08:33.695 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-21T09:08:33.723 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-21T09:08:33.771 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T09:08:34.041 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-21T09:08:34.053 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-paste. 2024-09-21T09:08:34.068 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-21T09:08:34.080 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-21T09:08:34.099 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-21T09:08:34.128 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T09:08:34.393 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webtest. 2024-09-21T09:08:34.421 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-21T09:08:34.448 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-21T09:08:34.460 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-21T09:08:34.464 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-21T09:08:34.548 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T09:08:34.780 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pecan. 2024-09-21T09:08:34.807 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-21T09:08:34.846 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T09:08:34.850 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-21T09:08:34.878 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-21T09:08:34.917 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-21T09:08:35.220 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webtest. 2024-09-21T09:08:35.247 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-21T09:08:35.251 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-certifi. 2024-09-21T09:08:35.278 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-21T09:08:35.286 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-21T09:08:35.317 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-21T09:08:35.573 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pecan. 2024-09-21T09:08:35.600 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-21T09:08:35.629 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-idna. 2024-09-21T09:08:35.631 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T09:08:35.656 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-21T09:08:35.695 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T09:08:35.948 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-urllib3. 2024-09-21T09:08:35.961 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-certifi. 2024-09-21T09:08:35.975 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-21T09:08:35.988 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-21T09:08:36.014 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T09:08:36.018 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-21T09:08:36.326 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests. 2024-09-21T09:08:36.353 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-21T09:08:36.363 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-idna. 2024-09-21T09:08:36.391 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-21T09:08:36.392 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T09:08:36.430 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T09:08:36.672 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-21T09:08:36.689 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-21T09:08:36.722 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T09:08:36.741 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-urllib3. 2024-09-21T09:08:36.769 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-21T09:08:36.824 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T09:08:37.042 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-21T09:08:37.059 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:37.100 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:37.136 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-requests. 2024-09-21T09:08:37.163 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-21T09:08:37.202 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T09:08:37.505 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-21T09:08:37.513 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-21T09:08:37.532 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:37.541 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-21T09:08:37.572 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:37.580 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T09:08:37.883 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-21T09:08:37.900 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-21T09:08:37.910 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-21T09:08:37.916 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:37.949 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-21T09:08:37.958 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:38.227 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-openssl. 2024-09-21T09:08:38.254 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-21T09:08:38.338 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-21T09:08:38.365 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:38.404 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:38.406 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-21T09:08:38.797 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr. 2024-09-21T09:08:38.824 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:39.230 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:39.608 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-21T09:08:39.635 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-21T09:08:39.674 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-21T09:08:39.975 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mon. 2024-09-21T09:08:40.002 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:40.042 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:40.102 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-openssl. 2024-09-21T09:08:40.129 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-21T09:08:40.168 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-21T09:08:40.446 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr. 2024-09-21T09:08:40.473 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:40.504 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:40.670 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-osd. 2024-09-21T09:08:40.697 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:40.736 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mon. 2024-09-21T09:08:40.935 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:40.974 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:41.647 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-osd. 2024-09-21T09:08:41.674 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:41.719 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:41.865 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph. 2024-09-21T09:08:41.881 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:41.923 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:42.267 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-fuse. 2024-09-21T09:08:42.295 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:42.334 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:42.679 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mds. 2024-09-21T09:08:42.706 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:42.745 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:42.780 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph. 2024-09-21T09:08:42.797 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:42.830 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:43.107 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephadm. 2024-09-21T09:08:43.134 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:43.150 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-fuse. 2024-09-21T09:08:43.165 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:43.176 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:43.216 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:43.476 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-21T09:08:43.492 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-21T09:08:43.534 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-21T09:08:43.603 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mds. 2024-09-21T09:08:43.630 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:43.669 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:43.862 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-21T09:08:43.878 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T09:08:43.920 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T09:08:44.039 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package cephadm. 2024-09-21T09:08:44.066 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:44.105 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:44.392 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-21T09:08:44.419 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-21T09:08:44.475 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-21T09:08:44.786 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-21T09:08:44.813 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T09:08:44.844 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T09:08:44.908 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-babel. 2024-09-21T09:08:44.937 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T09:08:44.966 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T09:08:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jinja2. 2024-09-21T09:08:45.280 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-21T09:08:45.311 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T09:08:45.622 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-21T09:08:45.650 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:45.689 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:45.891 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-babel. 2024-09-21T09:08:45.919 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T09:08:45.957 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T09:08:46.008 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-21T09:08:46.025 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-21T09:08:46.058 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-21T09:08:46.285 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jinja2. 2024-09-21T09:08:46.313 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-21T09:08:46.328 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-routes. 2024-09-21T09:08:46.351 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T09:08:46.356 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-21T09:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T09:08:46.681 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-21T09:08:46.697 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:46.721 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-21T09:08:46.731 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:46.788 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:47.133 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-21T09:08:47.161 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-21T09:08:47.199 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-21T09:08:47.477 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-routes. 2024-09-21T09:08:47.493 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-21T09:08:47.527 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T09:08:47.872 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-21T09:08:47.899 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:47.938 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:47.952 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-21T09:08:47.969 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-21T09:08:48.011 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T09:08:48.514 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-joblib. 2024-09-21T09:08:48.542 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-21T09:08:48.581 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T09:08:49.109 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-21T09:08:49.137 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-21T09:08:49.176 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-21T09:08:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-21T09:08:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-21T09:08:49.293 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T09:08:49.504 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn. 2024-09-21T09:08:49.531 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-21T09:08:49.570 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T09:08:49.771 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-joblib. 2024-09-21T09:08:49.799 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-21T09:08:49.829 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T09:08:50.228 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-21T09:08:50.245 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:50.355 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:50.375 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-21T09:08:50.402 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-21T09:08:50.441 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-21T09:08:50.752 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sklearn. 2024-09-21T09:08:50.779 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-21T09:08:50.818 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T09:08:51.267 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cachetools. 2024-09-21T09:08:51.295 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-21T09:08:51.334 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-21T09:08:51.493 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-21T09:08:51.510 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:51.628 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-21T09:08:51.645 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:51.656 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-21T09:08:51.695 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-21T09:08:51.990 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-21T09:08:52.018 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-21T09:08:52.048 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T09:08:52.326 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rsa. 2024-09-21T09:08:52.354 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-21T09:08:52.384 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-21T09:08:52.649 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cachetools. 2024-09-21T09:08:52.671 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-google-auth. 2024-09-21T09:08:52.677 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-21T09:08:52.699 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-21T09:08:52.715 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-21T09:08:52.729 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-21T09:08:53.018 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-21T09:08:53.046 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-21T09:08:53.058 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-21T09:08:53.084 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-21T09:08:53.085 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-21T09:08:53.124 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T09:08:53.436 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-websocket. 2024-09-21T09:08:53.446 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-21T09:08:53.463 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-21T09:08:53.474 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-21T09:08:53.502 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-21T09:08:53.513 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T09:08:53.814 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-21T09:08:53.824 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rsa. 2024-09-21T09:08:53.841 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-21T09:08:53.852 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-21T09:08:53.880 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T09:08:53.890 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-21T09:08:54.169 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-google-auth. 2024-09-21T09:08:54.186 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-21T09:08:54.219 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-21T09:08:54.514 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-21T09:08:54.542 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-21T09:08:54.581 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T09:08:54.727 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-21T09:08:54.744 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:54.777 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:54.892 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-websocket. 2024-09-21T09:08:54.919 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-21T09:08:54.958 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-21T09:08:55.097 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-21T09:08:55.125 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-21T09:08:55.163 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T09:08:55.279 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-21T09:08:55.306 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-21T09:08:55.345 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T09:08:55.509 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-21T09:08:55.536 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T09:08:55.575 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T09:08:55.811 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package jq. 2024-09-21T09:08:55.828 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T09:08:55.861 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-21T09:08:55.992 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-21T09:08:56.020 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:56.058 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:56.071 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package socat. 2024-09-21T09:08:56.099 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-21T09:08:56.138 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-21T09:08:56.386 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-21T09:08:56.414 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-21T09:08:56.441 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package xmlstarlet. 2024-09-21T09:08:56.452 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T09:08:56.458 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-21T09:08:56.516 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-21T09:08:56.797 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-21T09:08:56.825 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T09:08:56.845 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-test. 2024-09-21T09:08:56.862 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T09:08:56.895 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:57.125 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package jq. 2024-09-21T09:08:57.153 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T09:08:57.183 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-21T09:08:57.411 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package socat. 2024-09-21T09:08:57.428 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-21T09:08:57.469 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-21T09:08:57.797 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package xmlstarlet. 2024-09-21T09:08:57.813 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-21T09:08:57.855 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-21T09:08:58.211 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-test. 2024-09-21T09:08:58.228 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:58.262 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:59.125 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-volume. 2024-09-21T09:08:59.153 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:08:59.191 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:59.495 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-21T09:08:59.512 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:08:59.553 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:08:59.839 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-21T09:08:59.856 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-21T09:08:59.889 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-21T09:09:00.386 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-21T09:09:00.414 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-21T09:09:00.452 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-21T09:09:00.766 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-volume. 2024-09-21T09:09:00.794 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-21T09:09:00.823 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package nvme-cli. 2024-09-21T09:09:00.851 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-21T09:09:00.883 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:00.889 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T09:09:01.195 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-21T09:09:01.211 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:09:01.253 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:01.311 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pkg-config. 2024-09-21T09:09:01.339 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-21T09:09:01.377 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-21T09:09:01.531 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-21T09:09:01.559 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-21T09:09:01.597 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-21T09:09:01.639 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-21T09:09:01.656 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-21T09:09:01.697 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-21T09:09:01.894 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-21T09:09:01.922 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-21T09:09:01.952 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-21T09:09:02.142 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-21T09:09:02.170 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-21T09:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-21T09:09:02.323 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package nvme-cli. 2024-09-21T09:09:02.351 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-21T09:09:02.389 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T09:09:02.511 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastescript. 2024-09-21T09:09:02.539 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-21T09:09:02.569 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-21T09:09:02.828 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package pkg-config. 2024-09-21T09:09:02.856 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pluggy. 2024-09-21T09:09:02.856 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-21T09:09:02.884 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-21T09:09:02.894 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-21T09:09:02.922 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-21T09:09:03.156 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-21T09:09:03.184 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-21T09:09:03.222 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-21T09:09:03.234 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-psutil. 2024-09-21T09:09:03.262 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-21T09:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-21T09:09:03.651 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-21T09:09:03.661 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-py. 2024-09-21T09:09:03.679 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-21T09:09:03.689 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-21T09:09:03.717 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-21T09:09:03.736 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-21T09:09:04.004 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pastescript. 2024-09-21T09:09:04.031 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-21T09:09:04.070 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-21T09:09:04.073 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pygments. 2024-09-21T09:09:04.101 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-21T09:09:04.139 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T09:09:04.365 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pluggy. 2024-09-21T09:09:04.393 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-21T09:09:04.423 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-21T09:09:04.552 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-21T09:09:04.569 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-21T09:09:04.602 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-21T09:09:04.743 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-psutil. 2024-09-21T09:09:04.771 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-21T09:09:04.809 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-21T09:09:04.944 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-toml. 2024-09-21T09:09:04.971 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-21T09:09:05.129 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-py. 2024-09-21T09:09:05.158 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-21T09:09:05.204 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-21T09:09:05.212 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-21T09:09:05.507 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pytest. 2024-09-21T09:09:05.524 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pygments. 2024-09-21T09:09:05.535 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-21T09:09:05.553 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-21T09:09:05.582 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T09:09:05.590 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T09:09:05.894 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplejson. 2024-09-21T09:09:05.922 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-21T09:09:05.960 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-21T09:09:06.070 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-21T09:09:06.099 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-21T09:09:06.137 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-21T09:09:06.213 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-21T09:09:06.230 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-21T09:09:06.271 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-21T09:09:06.431 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-toml. 2024-09-21T09:09:06.460 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-21T09:09:06.498 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-21T09:09:06.784 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pytest. 2024-09-21T09:09:06.813 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-21T09:09:06.851 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T09:09:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package radosgw. 2024-09-21T09:09:07.045 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:09:07.083 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:07.230 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-simplejson. 2024-09-21T09:09:07.258 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-21T09:09:07.296 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-21T09:09:07.565 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-21T09:09:07.582 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-21T09:09:07.623 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-21T09:09:07.895 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package rbd-fuse. 2024-09-21T09:09:07.912 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:09:07.953 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:08.258 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-21T09:09:08.403 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package radosgw. 2024-09-21T09:09:08.431 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:09:08.469 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:08.575 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T09:09:08.675 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T09:09:08.921 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-21T09:09:09.259 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-21T09:09:09.323 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package rbd-fuse. 2024-09-21T09:09:09.351 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-21T09:09:09.389 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:09.703 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-21T09:09:09.706 INFO:teuthology.orchestra.run.smithi050.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-21T09:09:09.777 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:09.961 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T09:09:10.087 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T09:09:10.277 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user cephadm....done 2024-09-21T09:09:10.345 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-21T09:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T09:09:10.685 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-21T09:09:10.721 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-21T09:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-21T09:09:11.054 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-21T09:09:11.151 INFO:teuthology.orchestra.run.smithi007.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-21T09:09:11.313 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-21T09:09:11.331 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:11.581 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T09:09:11.707 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-21T09:09:11.848 INFO:teuthology.orchestra.run.smithi007.stdout:Adding system user cephadm....done 2024-09-21T09:09:11.979 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T09:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T09:09:12.238 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-21T09:09:12.385 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-21T09:09:12.473 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-21T09:09:12.599 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-21T09:09:12.636 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-21T09:09:12.867 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-21T09:09:12.895 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-21T09:09:13.131 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-21T09:09:13.135 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T09:09:13.261 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-21T09:09:13.390 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-21T09:09:13.571 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T09:09:13.691 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-21T09:09:13.923 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-21T09:09:13.934 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:14.183 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-21T09:09:14.260 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T09:09:14.369 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-21T09:09:14.459 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-21T09:09:14.529 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-21T09:09:14.655 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-21T09:09:14.694 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-21T09:09:14.914 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-21T09:09:14.953 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-21T09:09:15.196 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-21T09:09:15.311 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-21T09:09:15.345 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-21T09:09:15.401 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T09:09:15.519 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-21T09:09:15.571 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:15.831 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T09:09:15.870 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T09:09:15.958 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-21T09:09:15.996 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-21T09:09:16.092 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-21T09:09:16.252 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-21T09:09:16.281 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T09:09:16.511 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-21T09:09:16.556 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-21T09:09:16.858 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up zip (3.0-12build2) ... 2024-09-21T09:09:16.888 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-21T09:09:16.918 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-21T09:09:16.959 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T09:09:16.972 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T09:09:17.090 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-21T09:09:17.467 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T09:09:17.593 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-21T09:09:17.661 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T09:09:17.860 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T09:09:17.904 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T09:09:18.054 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-21T09:09:18.137 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-21T09:09:18.180 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T09:09:18.438 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up zip (3.0-12build2) ... 2024-09-21T09:09:18.490 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-21T09:09:18.547 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T09:09:18.891 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-21T09:09:19.125 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T09:09:19.233 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T09:09:19.494 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T09:09:19.500 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T09:09:19.626 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-21T09:09:19.752 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T09:09:19.787 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T09:09:20.087 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-21T09:09:20.155 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-21T09:09:20.414 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-21T09:09:20.455 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-21T09:09:20.549 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:20.689 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T09:09:20.842 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T09:09:21.066 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T09:09:21.159 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T09:09:21.368 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T09:09:21.719 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-21T09:09:21.979 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-21T09:09:22.088 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:22.372 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T09:09:22.374 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-21T09:09:22.619 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:09:22.707 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T09:09:22.728 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-21T09:09:22.988 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T09:09:23.114 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-21T09:09:23.240 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T09:09:23.558 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-21T09:09:23.818 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-21T09:09:23.940 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-21T09:09:24.069 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:09:24.170 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-21T09:09:24.183 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:09:24.317 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-21T09:09:24.463 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-21T09:09:24.585 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T09:09:24.703 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-21T09:09:24.723 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-21T09:09:24.812 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T09:09:24.990 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-21T09:09:25.105 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-21T09:09:25.250 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-21T09:09:25.365 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-21T09:09:25.518 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-21T09:09:25.616 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:09:25.767 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-21T09:09:25.802 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T09:09:25.903 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-21T09:09:26.069 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-21T09:09:26.171 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T09:09:26.297 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T09:09:26.328 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-21T09:09:26.607 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T09:09:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-21T09:09:26.908 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-21T09:09:26.938 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-21T09:09:27.151 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-21T09:09:27.189 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-21T09:09:27.252 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-21T09:09:27.378 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T09:09:27.457 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T09:09:27.468 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-21T09:09:27.584 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-21T09:09:27.705 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T09:09:27.831 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T09:09:27.868 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T09:09:27.994 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T09:09:28.241 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-21T09:09:28.279 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T09:09:28.484 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-21T09:09:28.585 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-21T09:09:28.613 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-21T09:09:28.836 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:09:28.856 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-21T09:09:28.937 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T09:09:28.982 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-21T09:09:29.117 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T09:09:29.206 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-21T09:09:29.280 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T09:09:29.451 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T09:09:29.578 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T09:09:29.598 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T09:09:29.899 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-21T09:09:29.954 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-21T09:09:30.000 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-21T09:09:30.197 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-21T09:09:30.268 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-21T09:09:30.323 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-21T09:09:30.528 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T09:09:30.599 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T09:09:30.733 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T09:09:30.856 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-21T09:09:31.068 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T09:09:31.275 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-21T09:09:31.369 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T09:09:31.560 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T09:09:31.637 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-21T09:09:31.738 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-21T09:09:31.929 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T09:09:32.006 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-21T09:09:32.055 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:32.282 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T09:09:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-21T09:09:32.602 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:32.636 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-21T09:09:32.711 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:32.837 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-21T09:09:33.046 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-21T09:09:33.114 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:33.240 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:33.314 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T09:09:33.366 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:33.585 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T09:09:33.585 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T09:09:33.667 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T09:09:33.793 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:33.919 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:34.036 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-21T09:09:34.092 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:34.193 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:34.303 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:34.331 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:34.429 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T09:09:34.457 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-21T09:09:34.877 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:34.995 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:35.096 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:35.306 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T09:09:35.307 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T09:09:35.781 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:35.907 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:35.947 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:36.033 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:36.134 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:36.159 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T09:09:36.252 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:36.353 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:36.454 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:36.971 INFO:teuthology.orchestra.run.smithi050.stdout:Adding group ceph....done 2024-09-21T09:09:37.291 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user ceph....done 2024-09-21T09:09:37.429 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:37.434 INFO:teuthology.orchestra.run.smithi050.stdout:Setting system user ceph properties....done 2024-09-21T09:09:37.454 INFO:teuthology.orchestra.run.smithi050.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-21T09:09:37.547 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:37.601 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-21T09:09:37.673 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:37.799 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:37.925 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:37.979 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-21T09:09:38.452 INFO:teuthology.orchestra.run.smithi007.stdout:Adding group ceph....done 2024-09-21T09:09:38.514 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:38.665 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:38.820 INFO:teuthology.orchestra.run.smithi007.stdout:Adding system user ceph....done 2024-09-21T09:09:38.980 INFO:teuthology.orchestra.run.smithi007.stdout:Setting system user ceph properties....done 2024-09-21T09:09:38.998 INFO:teuthology.orchestra.run.smithi007.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-21T09:09:39.140 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-21T09:09:39.309 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T09:09:39.309 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T09:09:39.458 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-21T09:09:39.893 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:39.927 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:40.044 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:40.226 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-21T09:09:40.485 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T09:09:40.485 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T09:09:40.712 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:40.938 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:40.947 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T09:09:40.947 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T09:09:41.281 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-21T09:09:41.464 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:41.679 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T09:09:41.679 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T09:09:41.740 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:41.993 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T09:09:41.993 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T09:09:42.182 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:42.480 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T09:09:42.480 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T09:09:42.483 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:42.710 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T09:09:42.710 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T09:09:42.984 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:43.119 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:43.177 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:43.457 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T09:09:43.458 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T09:09:43.460 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T09:09:43.460 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T09:09:43.987 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:43.992 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:44.088 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:44.239 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:44.362 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:44.458 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T09:09:44.458 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T09:09:44.663 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:44.924 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:44.948 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:45.108 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:45.234 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:45.355 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-21T09:09:45.385 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-21T09:09:45.455 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-21T09:09:45.591 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-21T09:09:45.746 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-21T09:09:45.847 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-21T09:09:45.991 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-21T09:09:46.409 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-21T09:09:47.104 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-21T09:09:47.109 DEBUG:teuthology.parallel:result is None 2024-09-21T09:09:47.145 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-21T09:09:47.809 INFO:teuthology.orchestra.run.smithi007.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-21T09:09:47.813 DEBUG:teuthology.parallel:result is None 2024-09-21T09:09:47.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T09:09:47.958 DEBUG:teuthology.orchestra.run.smithi007:> dpkg-query -W -f '${Version}' ceph 2024-09-21T09:09:47.977 INFO:teuthology.orchestra.run.smithi007.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-21T09:09:47.977 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-21T09:09:47.978 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-21T09:09:47.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-21T09:09:48.125 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-query -W -f '${Version}' ceph 2024-09-21T09:09:48.144 INFO:teuthology.orchestra.run.smithi050.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-21T09:09:48.145 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-21T09:09:48.145 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-21T09:09:48.146 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T09:09:48.147 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:09:48.147 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T09:09:48.162 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:09:48.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T09:09:48.200 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T09:09:48.200 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:09:48.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T09:09:48.218 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T09:09:48.277 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:09:48.277 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T09:09:48.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T09:09:48.347 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T09:09:48.347 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:09:48.347 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T09:09:48.360 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T09:09:48.417 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:09:48.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T09:09:48.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T09:09:48.487 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T09:09:48.487 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:09:48.488 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T09:09:48.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T09:09:48.557 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:09:48.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T09:09:48.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T09:09:48.626 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T09:09:48.694 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T09:09:48.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2024-09-21T09:09:48.697 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2024-09-21T09:09:48.710 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T09:09:48.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T09:09:48.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T09:09:48.768 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T09:09:48.768 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T09:09:48.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T09:09:48.837 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T09:09:48.837 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T09:09:48.838 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225', 'branch': 'squid', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7913225', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-squid'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9490, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'targets': {'smithi007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyQOu/sQRjcX9OY/oYMPuHxd/BdCx0jEw2Wdegr5pP8iy0lAGRPdKV/esDjngl13QUPQRpDth1UH9+VzWTZWXM=', 'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBRezow6Dxv/aoklxbG7gTRAQ2kvo1PXUVMstZNelt8cHUaUwEvVLYf7yQN41USSzJy1he3G4RpfJ+ROgBhGc5w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_user_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_21:40:05', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T09:09:48.838 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T09:09:48.871 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T09:09:48.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T09:09:48.919 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T09:09:48.932 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:09:48.932 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T09:09:48.982 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T09:09:48.982 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-09-21T09:09:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T09:09:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:09:49.030 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-21T09:09:49.030 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:09:49.030 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 09:04:19.151595962 +0000 2024-09-21T09:09:49.030 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 09:04:18.887598307 +0000 2024-09-21T09:09:49.031 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 09:04:18.887598307 +0000 2024-09-21T09:09:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2024-09-21T09:09:49.031 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T09:09:49.084 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T09:09:49.084 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T09:09:49.084 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000317778 s, 1.6 MB/s 2024-09-21T09:09:49.086 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T09:09:49.135 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-09-21T09:09:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T09:09:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:09:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-21T09:09:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:09:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 09:04:19.615591840 +0000 2024-09-21T09:09:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 09:04:19.363594079 +0000 2024-09-21T09:09:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 09:04:19.363594079 +0000 2024-09-21T09:09:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2024-09-21T09:09:49.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T09:09:49.236 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T09:09:49.236 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T09:09:49.236 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000299324 s, 1.7 MB/s 2024-09-21T09:09:49.237 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T09:09:49.291 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-09-21T09:09:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T09:09:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:09:49.342 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-21T09:09:49.342 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:09:49.342 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 09:04:20.111587434 +0000 2024-09-21T09:09:49.342 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 09:04:19.847589780 +0000 2024-09-21T09:09:49.342 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 09:04:19.847589780 +0000 2024-09-21T09:09:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2024-09-21T09:09:49.342 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T09:09:49.396 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T09:09:49.396 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T09:09:49.396 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000268992 s, 1.9 MB/s 2024-09-21T09:09:49.398 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T09:09:49.447 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-09-21T09:09:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T09:09:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:09:49.494 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-21T09:09:49.494 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:09:49.495 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 09:04:20.575583311 +0000 2024-09-21T09:09:49.495 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 09:04:20.355585266 +0000 2024-09-21T09:09:49.495 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 09:04:20.355585266 +0000 2024-09-21T09:09:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2024-09-21T09:09:49.495 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T09:09:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T09:09:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T09:09:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000214703 s, 2.4 MB/s 2024-09-21T09:09:49.551 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T09:09:49.600 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T09:09:49.600 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:09:49.600 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T09:09:49.606 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T09:09:49.606 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-09-21T09:09:49.652 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T09:09:49.652 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:09:49.652 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-21T09:09:49.652 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:09:49.652 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-21 09:04:19.133207650 +0000 2024-09-21T09:09:49.652 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-21 09:04:18.885209865 +0000 2024-09-21T09:09:49.652 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-21 09:04:18.885209865 +0000 2024-09-21T09:09:49.652 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-21T09:09:49.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T09:09:49.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-21T09:09:49.706 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-21T09:09:49.706 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000311434 s, 1.6 MB/s 2024-09-21T09:09:49.708 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T09:09:49.757 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-09-21T09:09:49.804 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T09:09:49.804 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:09:49.804 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-21T09:09:49.804 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:09:49.804 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-21 09:04:19.605203434 +0000 2024-09-21T09:09:49.804 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-21 09:04:19.369205542 +0000 2024-09-21T09:09:49.804 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-21 09:04:19.369205542 +0000 2024-09-21T09:09:49.804 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-21T09:09:49.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T09:09:49.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-21T09:09:49.858 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-21T09:09:49.858 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000307137 s, 1.7 MB/s 2024-09-21T09:09:49.860 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T09:09:49.908 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-09-21T09:09:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T09:09:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:09:49.956 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-21T09:09:49.956 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:09:49.956 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-21 09:04:20.065199324 +0000 2024-09-21T09:09:49.956 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-21 09:04:19.825201469 +0000 2024-09-21T09:09:49.956 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-21 09:04:19.825201469 +0000 2024-09-21T09:09:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-21T09:09:49.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T09:09:50.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-21T09:09:50.010 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-21T09:09:50.011 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000272604 s, 1.9 MB/s 2024-09-21T09:09:50.012 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T09:09:50.061 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-09-21T09:09:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T09:09:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T09:09:50.107 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-21T09:09:50.107 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T09:09:50.107 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-21 09:04:20.505195395 +0000 2024-09-21T09:09:50.108 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-21 09:04:20.261197573 +0000 2024-09-21T09:09:50.108 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-21 09:04:20.261197573 +0000 2024-09-21T09:09:50.108 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-21T09:09:50.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T09:09:50.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-21T09:09:50.161 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-21T09:09:50.161 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000302562 s, 1.7 MB/s 2024-09-21T09:09:50.163 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T09:09:50.212 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T09:09:50.213 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T09:09:50.213 INFO:tasks.ceph:Generating config... 2024-09-21T09:09:50.214 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-09-21T09:09:50.214 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T09:09:50.214 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T09:09:50.214 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T09:09:50.214 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T09:09:50.214 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T09:09:50.214 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-21T09:09:50.214 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-21T09:09:50.214 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-21T09:09:50.214 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T09:09:50.214 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T09:09:50.214 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T09:09:50.215 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-21T09:09:50.215 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T09:09:50.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T09:09:50.251 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T09:09:50.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T09:09:50.349 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T09:09:50.406 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.7'), ('mon.c', '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]'), ('mon.b', '172.21.15.50')] 2024-09-21T09:09:50.406 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.50'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-21T09:09:50.407 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:09:50.407 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T09:09:50.458 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.7 --addv c '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]' --add b 172.21.15.50 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:09:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:09:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid 40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3 2024-09-21T09:09:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = quincy 2024-09-21T09:09:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2024-09-21T09:09:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3 2024-09-21T09:09:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2024-09-21T09:09:50.545154+0000 2024-09-21T09:09:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-21T09:09:50.545154+0000 2024-09-21T09:09:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 17 (quincy) 2024-09-21T09:09:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2024-09-21T09:09:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T09:09:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:1: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-09-21T09:09:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-21T09:09:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T09:09:50.547 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T09:09:50.594 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3... 2024-09-21T09:09:50.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T09:09:50.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T09:09:50.667 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2024-09-21T09:09:50.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2024-09-21T09:09:50.669 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.670 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.50" 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.671 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug trim objects = true 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2024-09-21T09:09:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: bdev async discard = True 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: bdev enable discard = True 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore allocator = bitmap 2024-09-21T09:09:50.673 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 1/20 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 1/20 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 4/10 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: osd blocked scrub grace period = 3600 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: osd max markdown count = 1000 2024-09-21T09:09:50.674 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: osd shutdown pgref assert = True 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2024-09-21T09:09:50.675 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T09:09:50.676 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T09:09:50.677 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T09:09:50.678 INFO:teuthology.orchestra.run.smithi007.stdout: rgw relaxed s3 bucket names = True 2024-09-21T09:09:50.678 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2024-09-21T09:09:50.678 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2024-09-21T09:09:50.678 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2024-09-21T09:09:50.678 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-09-21T09:09:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-09-21T09:09:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-09-21T09:09:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.50" 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-09-21T09:09:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: bdev async discard = True 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: bdev enable discard = True 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore allocator = bitmap 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 1/20 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 1/20 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-09-21T09:09:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 4/10 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: osd blocked scrub grace period = 3600 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: osd max markdown count = 1000 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: osd shutdown pgref assert = True 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-21T09:09:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-21T09:09:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-21T09:09:50.687 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-09-21T09:09:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-09-21T09:09:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-09-21T09:09:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-09-21T09:09:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T09:09:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T09:09:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: rgw relaxed s3 bucket names = True 2024-09-21T09:09:50.688 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-09-21T09:09:50.688 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-09-21T09:09:50.688 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-09-21T09:09:50.689 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T09:09:50.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T09:09:50.787 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T09:09:50.787 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:09:50.787 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T09:09:50.792 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:09:50.792 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T09:09:50.839 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T09:09:50.839 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:09:50.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T09:09:50.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T09:09:50.903 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:09:50.903 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:09:50.950 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T09:09:50.950 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:09:50.950 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T09:09:50.950 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T09:09:50.975 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:09:50.975 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:09:51.024 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T09:09:51.024 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T09:09:51.024 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T09:09:51.069 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T09:09:51.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T09:09:51.120 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T09:09:51.133 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T09:09:51.133 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T09:09:51.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T09:09:51.168 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T09:09:51.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T09:09:51.215 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T09:09:51.227 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T09:09:51.227 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T09:09:51.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T09:09:51.239 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T09:09:51.239 INFO:tasks.ceph:role: osd.0 2024-09-21T09:09:51.239 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T09:09:51.239 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T09:09:51.294 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:09:51.294 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:09:51.294 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:09:51.294 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T09:09:51.294 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:09:51.294 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:09:51.295 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:09:51.295 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T09:09:51.295 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:09:51.295 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:09:51.318 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-21T09:09:51.320 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-21T09:09:51.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T09:09:51.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T09:09:51.426 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:09:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T09:09:51.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T09:09:51.479 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T09:09:51.479 INFO:tasks.ceph:role: osd.1 2024-09-21T09:09:51.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T09:09:51.479 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T09:09:51.537 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:09:51.537 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:09:51.537 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:09:51.537 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T09:09:51.537 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:09:51.537 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:09:51.537 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:09:51.537 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T09:09:51.537 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:09:51.537 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:09:51.560 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-21T09:09:51.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-21T09:09:51.562 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T09:09:51.623 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T09:09:51.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:09:51.675 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T09:09:51.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T09:09:51.728 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T09:09:51.728 INFO:tasks.ceph:role: osd.2 2024-09-21T09:09:51.728 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T09:09:51.728 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T09:09:51.782 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:09:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:09:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:09:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T09:09:51.782 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:09:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:09:51.782 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:09:51.782 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T09:09:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:09:51.782 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:09:51.806 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-21T09:09:51.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-21T09:09:51.808 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T09:09:51.866 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T09:09:51.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:09:51.919 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T09:09:51.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T09:09:51.972 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T09:09:51.972 INFO:tasks.ceph:role: osd.3 2024-09-21T09:09:51.972 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T09:09:51.973 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T09:09:52.026 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:09:52.026 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:09:52.027 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:09:52.027 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T09:09:52.027 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:09:52.027 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:09:52.027 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:09:52.027 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T09:09:52.027 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:09:52.027 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:09:52.051 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-21T09:09:52.054 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-21T09:09:52.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T09:09:52.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T09:09:52.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:09:52.162 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T09:09:52.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:09:52.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:52.266+0000 7f4d881287c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T09:09:52.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:52.270+0000 7f4d881287c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T09:09:52.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:52.270+0000 7f4d881287c0 -1 bdev(0x55d7b5ee1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T09:09:52.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:52.270+0000 7f4d881287c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T09:09:55.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T09:09:55.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:09:55.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:55.734+0000 7f0b2dfe57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T09:09:55.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:55.734+0000 7f0b2dfe57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T09:09:55.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:55.734+0000 7f0b2dfe57c0 -1 bdev(0x55e1f1315800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T09:09:55.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:55.738+0000 7f0b2dfe57c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T09:09:59.350 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T09:09:59.406 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:09:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:59.486+0000 7efe5f0307c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T09:09:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:59.486+0000 7efe5f0307c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T09:09:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:59.486+0000 7efe5f0307c0 -1 bdev(0x55d2db345800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T09:09:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:09:59.486+0000 7efe5f0307c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T09:10:02.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T09:10:02.974 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:10:03.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:10:03.054+0000 7f29eca947c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T09:10:03.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:10:03.054+0000 7f29eca947c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T09:10:03.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:10:03.054+0000 7f29eca947c0 -1 bdev(0x5637956ef800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T09:10:03.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T09:10:03.054+0000 7f29eca947c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T09:10:06.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T09:10:06.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T09:10:06.286 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T09:10:06.286 INFO:tasks.ceph:role: osd.4 2024-09-21T09:10:06.286 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T09:10:06.286 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T09:10:06.343 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:10:06.343 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:10:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:10:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T09:10:06.344 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:10:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:10:06.344 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:10:06.344 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T09:10:06.344 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:10:06.344 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:10:06.370 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-21T09:10:06.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-21T09:10:06.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T09:10:06.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T09:10:06.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:10:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T09:10:06.606 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T09:10:06.662 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T09:10:06.663 INFO:tasks.ceph:role: osd.5 2024-09-21T09:10:06.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T09:10:06.663 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T09:10:06.719 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:10:06.719 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:10:06.720 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:10:06.720 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T09:10:06.720 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:10:06.720 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:10:06.720 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:10:06.720 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T09:10:06.720 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:10:06.720 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:10:06.743 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-21T09:10:06.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-21T09:10:06.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T09:10:06.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T09:10:06.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:10:06.854 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T09:10:06.854 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T09:10:06.907 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T09:10:06.907 INFO:tasks.ceph:role: osd.6 2024-09-21T09:10:06.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T09:10:06.907 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T09:10:06.962 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:10:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:10:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:10:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T09:10:06.962 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:10:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:10:06.963 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:10:06.963 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T09:10:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:10:06.963 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:10:06.987 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-21T09:10:06.988 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-21T09:10:06.988 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T09:10:07.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T09:10:07.103 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T09:10:07.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:10:07.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T09:10:07.157 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T09:10:07.157 INFO:tasks.ceph:role: osd.7 2024-09-21T09:10:07.157 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T09:10:07.157 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T09:10:07.209 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T09:10:07.209 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T09:10:07.209 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T09:10:07.210 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T09:10:07.210 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T09:10:07.210 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-21T09:10:07.210 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T09:10:07.210 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T09:10:07.210 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T09:10:07.210 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T09:10:07.233 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-21T09:10:07.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-21T09:10:07.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T09:10:07.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T09:10:07.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:10:07.347 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T09:10:07.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:10:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:07.445+0000 7f3d424687c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T09:10:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:07.445+0000 7f3d424687c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T09:10:07.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:07.445+0000 7f3d424687c0 -1 bdev(0x55cef3231800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T09:10:07.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:07.445+0000 7f3d424687c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T09:10:10.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T09:10:10.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:10:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:10.721+0000 7faaee6517c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T09:10:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:10.721+0000 7faaee6517c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T09:10:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:10.721+0000 7faaee6517c0 -1 bdev(0x564db3fb7800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T09:10:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:10.721+0000 7faaee6517c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T09:10:14.107 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T09:10:14.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:10:14.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:14.245+0000 7f80a61ae7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T09:10:14.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:14.245+0000 7f80a61ae7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T09:10:14.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:14.245+0000 7f80a61ae7c0 -1 bdev(0x55da8cbb9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T09:10:14.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:14.245+0000 7f80a61ae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T09:10:17.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T09:10:17.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:10:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:17.537+0000 7fb4df6597c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T09:10:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:17.537+0000 7fb4df6597c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T09:10:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:17.537+0000 7fb4df6597c0 -1 bdev(0x55ac9b78b800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T09:10:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-21T09:10:17.537+0000 7fb4df6597c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T09:10:20.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T09:10:20.736 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T09:10:20.736 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:10:20.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T09:10:20.751 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:10:20.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T09:10:20.805 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:10:20.805 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T09:10:20.860 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:10:20.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T09:10:20.917 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:10:20.917 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T09:10:20.973 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:10:20.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T09:10:20.987 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:10:20.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T09:10:21.047 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:10:21.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T09:10:21.103 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:10:21.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T09:10:21.159 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:10:21.159 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T09:10:21.215 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:10:21.215 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T09:10:21.221 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:10:21.221 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T09:10:21.263 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T09:10:21.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T09:10:21.266 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.y] 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBfje5meuIoBBAA3fqGhTSjsJpdOA4yPwGcjA== 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBgje5mXWJKEBAAGb8hyq5ZQF+N8CyGvdVHmg== 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBjje5m3wMpLBAAN4RA1k8KZ7O5N/TqbDU+Zg== 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBnje5mZQ00HRAAzfNdBrMNSGvgM9XNvbBtkA== 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.3] 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBrje5mFeBzAxAAo1Vo/q1/nGSDHaRPzMeVjw== 2024-09-21T09:10:21.309 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBfje5mbIw9BxAApfqRsI8LGyA5sgNbtG7iXw== 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.4] 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBvje5mmPq8GhAAQTJCbEkNKeSfxGlNXDux8Q== 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.5] 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQByje5mHPEvKxAAz61wJlL3NHNzciELi+4+Xw== 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.6] 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB2je5mjYb3DhAAKVJODQWue8GjJMg5ACEPYQ== 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.7] 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB5je5mVeI4IBAAxud6IvWkNVpSFhAW7WZcBg== 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBfje5mrdMEChAAVgREJ63kWNOShPIsQTRJWw== 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout:[client.1] 2024-09-21T09:10:21.310 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBfje5mFtrnDBAAtnTRJPg1nVoOw87xNhR/pA== 2024-09-21T09:10:21.317 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2024-09-21T09:10:21.317 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBfje5meuIoBBAA3fqGhTSjsJpdOA4yPwGcjA== 2024-09-21T09:10:21.317 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2024-09-21T09:10:21.317 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBgje5mXWJKEBAAGb8hyq5ZQF+N8CyGvdVHmg== 2024-09-21T09:10:21.317 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2024-09-21T09:10:21.317 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBjje5m3wMpLBAAN4RA1k8KZ7O5N/TqbDU+Zg== 2024-09-21T09:10:21.317 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2024-09-21T09:10:21.317 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBnje5mZQ00HRAAzfNdBrMNSGvgM9XNvbBtkA== 2024-09-21T09:10:21.317 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBrje5mFeBzAxAAo1Vo/q1/nGSDHaRPzMeVjw== 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBfje5mbIw9BxAApfqRsI8LGyA5sgNbtG7iXw== 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBvje5mmPq8GhAAQTJCbEkNKeSfxGlNXDux8Q== 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQByje5mHPEvKxAAz61wJlL3NHNzciELi+4+Xw== 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQB2je5mjYb3DhAAKVJODQWue8GjJMg5ACEPYQ== 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQB5je5mVeI4IBAAxud6IvWkNVpSFhAW7WZcBg== 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBfje5mrdMEChAAVgREJ63kWNOShPIsQTRJWw== 2024-09-21T09:10:21.318 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2024-09-21T09:10:21.319 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBfje5mFtrnDBAAtnTRJPg1nVoOw87xNhR/pA== 2024-09-21T09:10:21.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T09:10:21.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T09:10:21.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.411 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.627 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.629 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T09:10:21.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T09:10:21.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.923 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:21.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:22.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:22.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T09:10:22.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T09:10:22.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T09:10:22.195 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T09:10:22.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T09:10:22.260 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T09:10:22.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T09:10:22.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T09:10:22.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T09:10:22.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T09:10:22.432 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T09:10:22.524 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T09:10:22.535 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T09:10:22.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T09:10:22.648 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T09:10:22.658 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:10:22.660 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T09:10:22.706 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T09:10:22.706 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T09:10:22.706 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T09:10:22.708 INFO:tasks.ceph.mon.a:Started 2024-09-21T09:10:22.708 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T09:10:22.709 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T09:10:22.711 INFO:tasks.ceph.mon.c:Started 2024-09-21T09:10:22.711 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T09:10:22.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T09:10:22.751 INFO:tasks.ceph.mon.b:Started 2024-09-21T09:10:22.752 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T09:10:22.752 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T09:10:22.752 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T09:10:22.754 INFO:tasks.ceph.mgr.y:Started 2024-09-21T09:10:22.754 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T09:10:22.754 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T09:10:22.756 INFO:tasks.ceph.mgr.x:Started 2024-09-21T09:10:22.756 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T09:10:22.757 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T09:10:28.381 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:28.377+0000 7ff3b22ca180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T09:10:28.388 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:28.381+0000 7fc3aa89b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T09:10:28.927 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:28.925+0000 7ff3b22ca180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T09:10:28.961 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:28.957+0000 7fc3aa89b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T09:10:29.029 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-09-21T09:10:29.046 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T09:10:29.046 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T09:10:29.047 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:10:29.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T09:10:29.056 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:10:29.056 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T09:10:29.113 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:10:29.113 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T09:10:29.140 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:29.137+0000 7ff3b22ca180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T09:10:29.166 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:10:29.166 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T09:10:29.182 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:29.177+0000 7fc3aa89b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T09:10:29.193 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:10:29.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T09:10:29.207 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:10:29.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T09:10:29.262 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:10:29.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T09:10:29.317 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-21T09:10:29.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T09:10:29.370 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 1d44c360-02ac-4142-a4a1-3ef3bae71ebf 0 2024-09-21T09:10:29.633 INFO:teuthology.orchestra.run.smithi050.stdout:0 2024-09-21T09:10:29.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 02fc3a59-f3a3-412b-ba73-5f43dc7c4714 1 2024-09-21T09:10:29.758 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:29.757+0000 7ff3b22ca180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T09:10:29.763 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:29.757+0000 7fc3aa89b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T09:10:29.816 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:29.813+0000 7ff3b22ca180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T09:10:29.820 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:29.813+0000 7fc3aa89b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T09:10:29.859 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-21T09:10:29.872 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:29.869+0000 7ff3b22ca180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T09:10:29.876 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 2ad4a646-5d8d-431d-89c1-5f13ae2c6048 2 2024-09-21T09:10:29.876 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:29.869+0000 7fc3aa89b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T09:10:29.955 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:29.953+0000 7ff3b22ca180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T09:10:29.956 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:29.949+0000 7fc3aa89b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T09:10:30.011 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:30.005+0000 7fc3aa89b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T09:10:30.013 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:30.009+0000 7ff3b22ca180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T09:10:30.075 INFO:teuthology.orchestra.run.smithi050.stdout:2 2024-09-21T09:10:30.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 99b23411-8e42-453f-917e-8342abf03624 3 2024-09-21T09:10:30.093 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:30.085+0000 7fc3aa89b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T09:10:30.095 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:30.093+0000 7ff3b22ca180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T09:10:30.149 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:30.145+0000 7fc3aa89b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T09:10:30.152 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:30.149+0000 7ff3b22ca180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T09:10:30.287 INFO:teuthology.orchestra.run.smithi050.stdout:3 2024-09-21T09:10:30.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 7d1e4d92-c6ab-4218-bc8e-2809085574b4 4 2024-09-21T09:10:30.308 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:30.301+0000 7fc3aa89b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T09:10:30.314 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:30.309+0000 7ff3b22ca180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T09:10:30.373 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:30.365+0000 7fc3aa89b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T09:10:30.379 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:30.377+0000 7ff3b22ca180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T09:10:30.517 INFO:teuthology.orchestra.run.smithi050.stdout:4 2024-09-21T09:10:30.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 2065653a-bbf5-4d55-b57c-a947d18b5fa7 5 2024-09-21T09:10:30.785 INFO:teuthology.orchestra.run.smithi050.stdout:5 2024-09-21T09:10:30.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 59146344-8e80-4b04-8947-1c119e33be55 6 2024-09-21T09:10:30.997 INFO:tasks.ceph.mgr.x.smithi050.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-21T09:10:30.997 INFO:tasks.ceph.mgr.x.smithi050.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-21T09:10:30.997 INFO:tasks.ceph.mgr.x.smithi050.stderr: from numpy import show_config as show_numpy_config 2024-09-21T09:10:31.013 INFO:teuthology.orchestra.run.smithi050.stdout:6 2024-09-21T09:10:31.031 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 2bd65ed0-7bb8-43d1-a5c6-0713c265495a 7 2024-09-21T09:10:31.036 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:31.033+0000 7ff3b22ca180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T09:10:31.137 INFO:tasks.ceph.mgr.y.smithi007.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-21T09:10:31.137 INFO:tasks.ceph.mgr.y.smithi007.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-21T09:10:31.137 INFO:tasks.ceph.mgr.y.smithi007.stderr: from numpy import show_config as show_numpy_config 2024-09-21T09:10:31.187 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:31.185+0000 7ff3b22ca180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T09:10:31.201 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:31.197+0000 7fc3aa89b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T09:10:31.235 INFO:teuthology.orchestra.run.smithi050.stdout:7 2024-09-21T09:10:31.251 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T09:10:31.251 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T09:10:31.254 INFO:tasks.ceph.osd.0:Started 2024-09-21T09:10:31.254 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T09:10:31.254 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T09:10:31.256 INFO:tasks.ceph.osd.1:Started 2024-09-21T09:10:31.256 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T09:10:31.256 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T09:10:31.258 INFO:tasks.ceph.osd.2:Started 2024-09-21T09:10:31.258 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T09:10:31.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T09:10:31.260 INFO:tasks.ceph.osd.3:Started 2024-09-21T09:10:31.260 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T09:10:31.261 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T09:10:31.296 INFO:tasks.ceph.osd.4:Started 2024-09-21T09:10:31.296 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T09:10:31.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T09:10:31.298 INFO:tasks.ceph.osd.5:Started 2024-09-21T09:10:31.298 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T09:10:31.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T09:10:31.301 INFO:tasks.ceph.osd.6:Started 2024-09-21T09:10:31.301 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T09:10:31.301 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T09:10:31.303 INFO:tasks.ceph.osd.7:Started 2024-09-21T09:10:31.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T09:10:31.355 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:31.353+0000 7ff3b22ca180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T09:10:31.424 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:31.421+0000 7ff3b22ca180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T09:10:31.424 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:31.417+0000 7fc3aa89b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T09:10:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:10:31.495 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"fsid":"40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3","created":"2024-09-21T09:10:28.086623+0000","modified":"2024-09-21T09:10:31.231639+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T09:10:31.231639+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1d44c360-02ac-4142-a4a1-3ef3bae71ebf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"02fc3a59-f3a3-412b-ba73-5f43dc7c4714","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ad4a646-5d8d-431d-89c1-5f13ae2c6048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"99b23411-8e42-453f-917e-8342abf03624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7d1e4d92-c6ab-4218-bc8e-2809085574b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2065653a-bbf5-4d55-b57c-a947d18b5fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"59146344-8e80-4b04-8947-1c119e33be55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2bd65ed0-7bb8-43d1-a5c6-0713c265495a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:10:31.512 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T09:10:31.512 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T09:10:31.565 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:31.561+0000 7ff3b22ca180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T09:10:31.599 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:31.593+0000 7fc3aa89b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T09:10:31.670 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:31.665+0000 7fc3aa89b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T09:10:31.819 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:31.813+0000 7fc3aa89b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T09:10:32.196 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:32.193+0000 7ff3b22ca180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T09:10:32.275 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:32.273+0000 7ff3b22ca180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T09:10:32.318 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T09:10:32.445 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:32.441+0000 7fc3aa89b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T09:10:32.466 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:32.461+0000 7ff3b22ca180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T09:10:32.494 INFO:teuthology.misc.health.smithi007.stdout: 2024-09-21T09:10:32.495 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":10,"fsid":"40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3","created":"2024-09-21T09:10:28.086623+0000","modified":"2024-09-21T09:10:31.231639+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T09:10:31.231639+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1d44c360-02ac-4142-a4a1-3ef3bae71ebf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"02fc3a59-f3a3-412b-ba73-5f43dc7c4714","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ad4a646-5d8d-431d-89c1-5f13ae2c6048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"99b23411-8e42-453f-917e-8342abf03624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7d1e4d92-c6ab-4218-bc8e-2809085574b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2065653a-bbf5-4d55-b57c-a947d18b5fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"59146344-8e80-4b04-8947-1c119e33be55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2bd65ed0-7bb8-43d1-a5c6-0713c265495a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:10:32.509 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T09:10:32.525 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:32.521+0000 7fc3aa89b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T09:10:32.542 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:32.541+0000 7ff3b22ca180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T09:10:32.716 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:32.709+0000 7fc3aa89b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T09:10:32.793 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:32.789+0000 7fc3aa89b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T09:10:32.848 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:32.845+0000 7ff3b22ca180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T09:10:32.890 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:10:32.885+0000 7f50ab1bf7c0 -1 Falling back to public interface 2024-09-21T09:10:32.902 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:10:32.897+0000 7f68169157c0 -1 Falling back to public interface 2024-09-21T09:10:32.912 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:32.909+0000 7ff3b22ca180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T09:10:32.967 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:10:32.965+0000 7fce751307c0 -1 Falling back to public interface 2024-09-21T09:10:33.103 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:33.097+0000 7fc3aa89b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T09:10:33.142 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:10:33.137+0000 7f4d9cfa47c0 -1 Falling back to public interface 2024-09-21T09:10:33.169 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-21T09:10:33.165+0000 7fc3aa89b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T09:10:33.171 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:10:33.169+0000 7fb8332957c0 -1 Falling back to public interface 2024-09-21T09:10:33.207 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:10:33.205+0000 7f7b1a93c7c0 -1 Falling back to public interface 2024-09-21T09:10:33.207 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:10:33.205+0000 7f563a4e97c0 -1 Falling back to public interface 2024-09-21T09:10:33.406 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:10:33.401+0000 7f67aa29d7c0 -1 Falling back to public interface 2024-09-21T09:10:33.959 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:33.957+0000 7ff358e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T09:10:33.960 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-09-21T09:10:33.957+0000 7ff358e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T09:10:37.276 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:10:37.273+0000 7fce751307c0 -1 osd.4 0 log_to_monitors true 2024-09-21T09:10:37.474 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:10:37.469+0000 7f68169157c0 -1 osd.2 0 log_to_monitors true 2024-09-21T09:10:37.542 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:10:37.541+0000 7f563a4e97c0 -1 osd.6 0 log_to_monitors true 2024-09-21T09:10:37.576 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:10:37.569+0000 7f67aa29d7c0 -1 osd.1 0 log_to_monitors true 2024-09-21T09:10:37.738 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:10:37.737+0000 7f7b1a93c7c0 -1 osd.5 0 log_to_monitors true 2024-09-21T09:10:37.749 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:10:37.745+0000 7f50ab1bf7c0 -1 osd.3 0 log_to_monitors true 2024-09-21T09:10:37.882 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:10:37.881+0000 7fb8332957c0 -1 osd.7 0 log_to_monitors true 2024-09-21T09:10:37.990 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:10:37.985+0000 7f4d9cfa47c0 -1 osd.0 0 log_to_monitors true 2024-09-21T09:10:39.263 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:10:39.261+0000 7fce708b6640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T09:10:39.291 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:10:39.289+0000 7fce68efd640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:10:39.316 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T09:10:39.725 INFO:teuthology.misc.health.smithi007.stdout: 2024-09-21T09:10:39.726 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":13,"fsid":"40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3","created":"2024-09-21T09:10:28.086623+0000","modified":"2024-09-21T09:10:39.336048+0000","last_up_change":"2024-09-21T09:10:39.336048+0000","last_in_change":"2024-09-21T09:10:31.231639+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1d44c360-02ac-4142-a4a1-3ef3bae71ebf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"02fc3a59-f3a3-412b-ba73-5f43dc7c4714","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ad4a646-5d8d-431d-89c1-5f13ae2c6048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"99b23411-8e42-453f-917e-8342abf03624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7d1e4d92-c6ab-4218-bc8e-2809085574b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6803","nonce":50317293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6805","nonce":50317293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6809","nonce":50317293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6807","nonce":50317293}]},"public_addr":"172.21.15.50:6803/50317293","cluster_addr":"172.21.15.50:6805/50317293","heartbeat_back_addr":"172.21.15.50:6809/50317293","heartbeat_front_addr":"172.21.15.50:6807/50317293","state":["exists","up"]},{"osd":5,"uuid":"2065653a-bbf5-4d55-b57c-a947d18b5fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"59146344-8e80-4b04-8947-1c119e33be55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2bd65ed0-7bb8-43d1-a5c6-0713c265495a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:10:39.754 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-21T09:10:40.653 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:10:40.649+0000 7f7b170f7640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T09:10:40.659 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:10:40.657+0000 7fb82fa50640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T09:10:40.683 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:10:40.681+0000 7f7b0e709640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:10:40.690 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:10:40.689+0000 7fb827062640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:10:40.694 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:10:40.693+0000 7f5635c6f640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T09:10:40.722 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:10:40.721+0000 7f562e2b6640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:10:40.880 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:10:40.873+0000 7f4d9872a640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T09:10:40.894 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:10:40.889+0000 7f681209b640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T09:10:40.905 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:10:40.901+0000 7f4d90d71640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:10:40.925 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:10:40.921+0000 7f680a6e2640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:10:40.943 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:10:40.937+0000 7f50a797a640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T09:10:40.968 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:10:40.961+0000 7f67a6a58640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T09:10:40.981 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:10:40.977+0000 7f509ef8c640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:10:40.998 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:10:40.993+0000 7f679e06a640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T09:10:46.560 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T09:10:46.867 INFO:teuthology.misc.health.smithi007.stdout: 2024-09-21T09:10:46.867 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":19,"fsid":"40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3","created":"2024-09-21T09:10:28.086623+0000","modified":"2024-09-21T09:10:45.721094+0000","last_up_change":"2024-09-21T09:10:41.697031+0000","last_in_change":"2024-09-21T09:10:31.231639+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T09:10:43.023047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d44c360-02ac-4142-a4a1-3ef3bae71ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6817","nonce":1603589667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6819","nonce":1603589667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6823","nonce":1603589667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6821","nonce":1603589667}]},"public_addr":"172.21.15.7:6817/1603589667","cluster_addr":"172.21.15.7:6819/1603589667","heartbeat_back_addr":"172.21.15.7:6823/1603589667","heartbeat_front_addr":"172.21.15.7:6821/1603589667","state":["exists","up"]},{"osd":1,"uuid":"02fc3a59-f3a3-412b-ba73-5f43dc7c4714","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6825","nonce":4002665254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6827","nonce":4002665254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6831","nonce":4002665254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6829","nonce":4002665254}]},"public_addr":"172.21.15.7:6825/4002665254","cluster_addr":"172.21.15.7:6827/4002665254","heartbeat_back_addr":"172.21.15.7:6831/4002665254","heartbeat_front_addr":"172.21.15.7:6829/4002665254","state":["exists","up"]},{"osd":2,"uuid":"2ad4a646-5d8d-431d-89c1-5f13ae2c6048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6809","nonce":992756194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6811","nonce":992756194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6815","nonce":992756194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6813","nonce":992756194}]},"public_addr":"172.21.15.7:6809/992756194","cluster_addr":"172.21.15.7:6811/992756194","heartbeat_back_addr":"172.21.15.7:6815/992756194","heartbeat_front_addr":"172.21.15.7:6813/992756194","state":["exists","up"]},{"osd":3,"uuid":"99b23411-8e42-453f-917e-8342abf03624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6801","nonce":1625592448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6803","nonce":1625592448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6807","nonce":1625592448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6805","nonce":1625592448}]},"public_addr":"172.21.15.7:6801/1625592448","cluster_addr":"172.21.15.7:6803/1625592448","heartbeat_back_addr":"172.21.15.7:6807/1625592448","heartbeat_front_addr":"172.21.15.7:6805/1625592448","state":["exists","up"]},{"osd":4,"uuid":"7d1e4d92-c6ab-4218-bc8e-2809085574b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6803","nonce":50317293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6805","nonce":50317293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6809","nonce":50317293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6807","nonce":50317293}]},"public_addr":"172.21.15.50:6803/50317293","cluster_addr":"172.21.15.50:6805/50317293","heartbeat_back_addr":"172.21.15.50:6809/50317293","heartbeat_front_addr":"172.21.15.50:6807/50317293","state":["exists","up"]},{"osd":5,"uuid":"2065653a-bbf5-4d55-b57c-a947d18b5fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6820","nonce":3773654391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6824","nonce":3773654391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6832","nonce":3773654391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6828","nonce":3773654391}]},"public_addr":"172.21.15.50:6820/3773654391","cluster_addr":"172.21.15.50:6824/3773654391","heartbeat_back_addr":"172.21.15.50:6832/3773654391","heartbeat_front_addr":"172.21.15.50:6828/3773654391","state":["exists","up"]},{"osd":6,"uuid":"59146344-8e80-4b04-8947-1c119e33be55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6821","nonce":2220031654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6825","nonce":2220031654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6831","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6833","nonce":2220031654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6829","nonce":2220031654}]},"public_addr":"172.21.15.50:6821/2220031654","cluster_addr":"172.21.15.50:6825/2220031654","heartbeat_back_addr":"172.21.15.50:6833/2220031654","heartbeat_front_addr":"172.21.15.50:6829/2220031654","state":["exists","up"]},{"osd":7,"uuid":"2bd65ed0-7bb8-43d1-a5c6-0713c265495a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6811","nonce":647878711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6813","nonce":647878711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6817","nonce":647878711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6815","nonce":647878711}]},"public_addr":"172.21.15.50:6811/647878711","cluster_addr":"172.21.15.50:6813/647878711","heartbeat_back_addr":"172.21.15.50:6817/647878711","heartbeat_front_addr":"172.21.15.50:6815/647878711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.970712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.599658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.516125+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.728100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.283957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.740034+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.565564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.895681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:10:46.887 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T09:10:46.887 INFO:tasks.ceph:Creating RBD pool 2024-09-21T09:10:46.887 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-21T09:10:47.747 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'rbd' created 2024-09-21T09:10:47.776 DEBUG:teuthology.orchestra.run.smithi007:> rbd --cluster ceph pool init rbd 2024-09-21T09:10:50.802 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T09:10:50.803 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T09:10:50.803 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T09:10:50.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T09:10:50.804 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T09:10:51.168 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:10:51.186 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3143598896},{"type":"v1","addr":"172.21.15.50:6801","nonce":3143598896}]},"active_addr":"172.21.15.50:6801/3143598896","active_change":"2024-09-21T09:10:32.932591+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1920255924}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2411346251}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":896302906}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4157172386}]}]} 2024-09-21T09:10:51.189 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T09:10:51.190 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T09:10:51.190 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T09:10:51.487 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:10:51.487 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":23,"fsid":"40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3","created":"2024-09-21T09:10:28.086623+0000","modified":"2024-09-21T09:10:50.766102+0000","last_up_change":"2024-09-21T09:10:41.697031+0000","last_in_change":"2024-09-21T09:10:31.231639+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T09:10:43.023047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T09:10:47.239561+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d44c360-02ac-4142-a4a1-3ef3bae71ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6817","nonce":1603589667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6819","nonce":1603589667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6823","nonce":1603589667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6821","nonce":1603589667}]},"public_addr":"172.21.15.7:6817/1603589667","cluster_addr":"172.21.15.7:6819/1603589667","heartbeat_back_addr":"172.21.15.7:6823/1603589667","heartbeat_front_addr":"172.21.15.7:6821/1603589667","state":["exists","up"]},{"osd":1,"uuid":"02fc3a59-f3a3-412b-ba73-5f43dc7c4714","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6825","nonce":4002665254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6827","nonce":4002665254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6831","nonce":4002665254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6829","nonce":4002665254}]},"public_addr":"172.21.15.7:6825/4002665254","cluster_addr":"172.21.15.7:6827/4002665254","heartbeat_back_addr":"172.21.15.7:6831/4002665254","heartbeat_front_addr":"172.21.15.7:6829/4002665254","state":["exists","up"]},{"osd":2,"uuid":"2ad4a646-5d8d-431d-89c1-5f13ae2c6048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6809","nonce":992756194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6811","nonce":992756194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6815","nonce":992756194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6813","nonce":992756194}]},"public_addr":"172.21.15.7:6809/992756194","cluster_addr":"172.21.15.7:6811/992756194","heartbeat_back_addr":"172.21.15.7:6815/992756194","heartbeat_front_addr":"172.21.15.7:6813/992756194","state":["exists","up"]},{"osd":3,"uuid":"99b23411-8e42-453f-917e-8342abf03624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6801","nonce":1625592448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6803","nonce":1625592448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6807","nonce":1625592448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6805","nonce":1625592448}]},"public_addr":"172.21.15.7:6801/1625592448","cluster_addr":"172.21.15.7:6803/1625592448","heartbeat_back_addr":"172.21.15.7:6807/1625592448","heartbeat_front_addr":"172.21.15.7:6805/1625592448","state":["exists","up"]},{"osd":4,"uuid":"7d1e4d92-c6ab-4218-bc8e-2809085574b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6803","nonce":50317293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6805","nonce":50317293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6809","nonce":50317293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6807","nonce":50317293}]},"public_addr":"172.21.15.50:6803/50317293","cluster_addr":"172.21.15.50:6805/50317293","heartbeat_back_addr":"172.21.15.50:6809/50317293","heartbeat_front_addr":"172.21.15.50:6807/50317293","state":["exists","up"]},{"osd":5,"uuid":"2065653a-bbf5-4d55-b57c-a947d18b5fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6820","nonce":3773654391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6824","nonce":3773654391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6832","nonce":3773654391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6828","nonce":3773654391}]},"public_addr":"172.21.15.50:6820/3773654391","cluster_addr":"172.21.15.50:6824/3773654391","heartbeat_back_addr":"172.21.15.50:6832/3773654391","heartbeat_front_addr":"172.21.15.50:6828/3773654391","state":["exists","up"]},{"osd":6,"uuid":"59146344-8e80-4b04-8947-1c119e33be55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6821","nonce":2220031654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6825","nonce":2220031654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6831","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6833","nonce":2220031654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6829","nonce":2220031654}]},"public_addr":"172.21.15.50:6821/2220031654","cluster_addr":"172.21.15.50:6825/2220031654","heartbeat_back_addr":"172.21.15.50:6833/2220031654","heartbeat_front_addr":"172.21.15.50:6829/2220031654","state":["exists","up"]},{"osd":7,"uuid":"2bd65ed0-7bb8-43d1-a5c6-0713c265495a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6811","nonce":647878711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6813","nonce":647878711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6817","nonce":647878711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6815","nonce":647878711}]},"public_addr":"172.21.15.50:6811/647878711","cluster_addr":"172.21.15.50:6813/647878711","heartbeat_back_addr":"172.21.15.50:6817/647878711","heartbeat_front_addr":"172.21.15.50:6815/647878711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.970712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.599658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.516125+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.728100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.283957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.740034+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.565564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.895681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:10:51.505 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T09:10:51.505 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T09:10:51.801 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:10:51.801 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":23,"fsid":"40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3","created":"2024-09-21T09:10:28.086623+0000","modified":"2024-09-21T09:10:50.766102+0000","last_up_change":"2024-09-21T09:10:41.697031+0000","last_in_change":"2024-09-21T09:10:31.231639+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T09:10:43.023047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T09:10:47.239561+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d44c360-02ac-4142-a4a1-3ef3bae71ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6817","nonce":1603589667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6819","nonce":1603589667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6823","nonce":1603589667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6821","nonce":1603589667}]},"public_addr":"172.21.15.7:6817/1603589667","cluster_addr":"172.21.15.7:6819/1603589667","heartbeat_back_addr":"172.21.15.7:6823/1603589667","heartbeat_front_addr":"172.21.15.7:6821/1603589667","state":["exists","up"]},{"osd":1,"uuid":"02fc3a59-f3a3-412b-ba73-5f43dc7c4714","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6825","nonce":4002665254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6827","nonce":4002665254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6831","nonce":4002665254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6829","nonce":4002665254}]},"public_addr":"172.21.15.7:6825/4002665254","cluster_addr":"172.21.15.7:6827/4002665254","heartbeat_back_addr":"172.21.15.7:6831/4002665254","heartbeat_front_addr":"172.21.15.7:6829/4002665254","state":["exists","up"]},{"osd":2,"uuid":"2ad4a646-5d8d-431d-89c1-5f13ae2c6048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6809","nonce":992756194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6811","nonce":992756194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6815","nonce":992756194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6813","nonce":992756194}]},"public_addr":"172.21.15.7:6809/992756194","cluster_addr":"172.21.15.7:6811/992756194","heartbeat_back_addr":"172.21.15.7:6815/992756194","heartbeat_front_addr":"172.21.15.7:6813/992756194","state":["exists","up"]},{"osd":3,"uuid":"99b23411-8e42-453f-917e-8342abf03624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6801","nonce":1625592448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6803","nonce":1625592448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6807","nonce":1625592448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6805","nonce":1625592448}]},"public_addr":"172.21.15.7:6801/1625592448","cluster_addr":"172.21.15.7:6803/1625592448","heartbeat_back_addr":"172.21.15.7:6807/1625592448","heartbeat_front_addr":"172.21.15.7:6805/1625592448","state":["exists","up"]},{"osd":4,"uuid":"7d1e4d92-c6ab-4218-bc8e-2809085574b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6803","nonce":50317293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6805","nonce":50317293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6809","nonce":50317293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6807","nonce":50317293}]},"public_addr":"172.21.15.50:6803/50317293","cluster_addr":"172.21.15.50:6805/50317293","heartbeat_back_addr":"172.21.15.50:6809/50317293","heartbeat_front_addr":"172.21.15.50:6807/50317293","state":["exists","up"]},{"osd":5,"uuid":"2065653a-bbf5-4d55-b57c-a947d18b5fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6820","nonce":3773654391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6824","nonce":3773654391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6832","nonce":3773654391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6828","nonce":3773654391}]},"public_addr":"172.21.15.50:6820/3773654391","cluster_addr":"172.21.15.50:6824/3773654391","heartbeat_back_addr":"172.21.15.50:6832/3773654391","heartbeat_front_addr":"172.21.15.50:6828/3773654391","state":["exists","up"]},{"osd":6,"uuid":"59146344-8e80-4b04-8947-1c119e33be55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6821","nonce":2220031654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6825","nonce":2220031654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6831","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6833","nonce":2220031654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6829","nonce":2220031654}]},"public_addr":"172.21.15.50:6821/2220031654","cluster_addr":"172.21.15.50:6825/2220031654","heartbeat_back_addr":"172.21.15.50:6833/2220031654","heartbeat_front_addr":"172.21.15.50:6829/2220031654","state":["exists","up"]},{"osd":7,"uuid":"2bd65ed0-7bb8-43d1-a5c6-0713c265495a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6811","nonce":647878711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6813","nonce":647878711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6817","nonce":647878711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6815","nonce":647878711}]},"public_addr":"172.21.15.50:6811/647878711","cluster_addr":"172.21.15.50:6813/647878711","heartbeat_back_addr":"172.21.15.50:6817/647878711","heartbeat_front_addr":"172.21.15.50:6815/647878711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.970712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.599658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.516125+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.728100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.283957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.740034+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.565564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.895681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:10:51.819 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T09:10:51.819 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T09:10:51.819 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T09:10:51.820 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T09:10:51.820 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T09:10:51.820 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T09:10:51.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T09:10:51.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T09:10:52.086 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-21T09:10:52.086 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T09:10:52.087 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-21T09:10:52.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T09:10:52.092 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2024-09-21T09:10:52.093 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T09:10:52.095 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-21T09:10:52.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T09:10:52.097 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-21T09:10:52.097 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T09:10:52.097 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-21T09:10:52.098 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T09:10:52.099 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-21T09:10:52.100 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T09:10:52.102 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-21T09:10:52.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T09:10:52.599 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-21T09:10:52.608 INFO:teuthology.orchestra.run.smithi007.stdout:55834574851 2024-09-21T09:10:52.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2024-09-21T09:10:52.627 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-21T09:10:52.636 INFO:teuthology.orchestra.run.smithi007.stdout:64424509443 2024-09-21T09:10:52.636 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-21T09:10:52.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-09-21T09:10:52.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.3 2024-09-21T09:10:52.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2024-09-21T09:10:52.661 INFO:teuthology.orchestra.run.smithi007.stdout:64424509443 2024-09-21T09:10:52.665 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-21T09:10:52.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.2 2024-09-21T09:10:52.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.0 2024-09-21T09:10:52.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.5 2024-09-21T09:10:52.685 INFO:teuthology.orchestra.run.smithi007.stdout:64424509443 2024-09-21T09:10:52.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.7 2024-09-21T09:10:53.625 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T09:10:53.648 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T09:10:53.661 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T09:10:53.661 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T09:10:53.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T09:10:53.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T09:10:53.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T09:10:53.703 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T09:10:54.184 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-21T09:10:54.187 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-21T09:10:54.195 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-21T09:10:54.205 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2024-09-21T09:10:54.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.1 2024-09-21T09:10:54.213 DEBUG:teuthology.parallel:result is None 2024-09-21T09:10:54.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.3 2024-09-21T09:10:54.216 DEBUG:teuthology.parallel:result is None 2024-09-21T09:10:54.218 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-21T09:10:54.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.6 2024-09-21T09:10:54.227 DEBUG:teuthology.parallel:result is None 2024-09-21T09:10:54.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-09-21T09:10:54.237 DEBUG:teuthology.parallel:result is None 2024-09-21T09:10:54.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.2 2024-09-21T09:10:54.245 DEBUG:teuthology.parallel:result is None 2024-09-21T09:10:54.249 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-21T09:10:54.250 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-21T09:10:54.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.0 2024-09-21T09:10:54.269 DEBUG:teuthology.parallel:result is None 2024-09-21T09:10:54.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.5 2024-09-21T09:10:54.270 DEBUG:teuthology.parallel:result is None 2024-09-21T09:10:54.270 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-21T09:10:54.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.7 2024-09-21T09:10:54.287 DEBUG:teuthology.parallel:result is None 2024-09-21T09:10:54.287 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T09:10:54.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:10:54.618 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:10:54.619 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:10:54.635 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-21T09:10:52.943982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252540,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722180,"statfs":{"total":773094113280,"available":772835512320,"internally_reserved":0,"allocated":3063808,"data_stored":1814286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.192855"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.783824+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:10:50.783824+0000","last_peered":"2024-09-21T09:10:50.783824+0000","last_clean":"2024-09-21T09:10:50.783824+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:10:50.783824+0000","last_undegraded":"2024-09-21T09:10:50.783824+0000","last_fullsized":"2024-09-21T09:10:50.783824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:33.465317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.775375+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:10:50.775375+0000","last_peered":"2024-09-21T09:10:50.775375+0000","last_clean":"2024-09-21T09:10:50.775375+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:10:50.775375+0000","last_undegraded":"2024-09-21T09:10:50.775375+0000","last_fullsized":"2024-09-21T09:10:50.775375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:03.383843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.784391+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:10:50.784391+0000","last_peered":"2024-09-21T09:10:50.784391+0000","last_clean":"2024-09-21T09:10:50.784391+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:10:50.784391+0000","last_undegraded":"2024-09-21T09:10:50.784391+0000","last_fullsized":"2024-09-21T09:10:50.784391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:24.356684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:51.586976+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:10:51.586976+0000","last_peered":"2024-09-21T09:10:51.586976+0000","last_clean":"2024-09-21T09:10:51.586976+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:10:51.586976+0000","last_undegraded":"2024-09-21T09:10:51.586976+0000","last_fullsized":"2024-09-21T09:10:51.586976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.786603+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:10:50.786603+0000","last_peered":"2024-09-21T09:10:50.786603+0000","last_clean":"2024-09-21T09:10:50.786603+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:10:50.786603+0000","last_undegraded":"2024-09-21T09:10:50.786603+0000","last_fullsized":"2024-09-21T09:10:50.786603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:07.894252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:51.587265+0000","last_change":"2024-09-21T09:10:51.587265+0000","last_active":"2024-09-21T09:10:51.587265+0000","last_peered":"2024-09-21T09:10:51.587265+0000","last_clean":"2024-09-21T09:10:51.587265+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:10:51.587265+0000","last_undegraded":"2024-09-21T09:10:51.587265+0000","last_fullsized":"2024-09-21T09:10:51.587265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.783592+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:10:50.783592+0000","last_peered":"2024-09-21T09:10:50.783592+0000","last_clean":"2024-09-21T09:10:50.783592+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:10:50.783592+0000","last_undegraded":"2024-09-21T09:10:50.783592+0000","last_fullsized":"2024-09-21T09:10:50.783592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:09.405380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.784701+0000","last_change":"2024-09-21T09:10:50.784701+0000","last_active":"2024-09-21T09:10:50.784701+0000","last_peered":"2024-09-21T09:10:50.784701+0000","last_clean":"2024-09-21T09:10:50.784701+0000","last_became_active":"2024-09-21T09:10:48.763536+0000","last_became_peered":"2024-09-21T09:10:48.763536+0000","last_unstale":"2024-09-21T09:10:50.784701+0000","last_undegraded":"2024-09-21T09:10:50.784701+0000","last_fullsized":"2024-09-21T09:10:50.784701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:24.622195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.772421+0000","last_change":"2024-09-21T09:10:44.726458+0000","last_active":"2024-09-21T09:10:50.772421+0000","last_peered":"2024-09-21T09:10:50.772421+0000","last_clean":"2024-09-21T09:10:50.772421+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:10:50.772421+0000","last_undegraded":"2024-09-21T09:10:50.772421+0000","last_fullsized":"2024-09-21T09:10:50.772421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_clean_scrub_stamp":"2024-09-21T09:10:43.702491+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:07.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":237568,"data_stored":79208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":669557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":237568,"data_stored":79208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":669557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:10:54.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:10:54.928 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:10:54.928 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:10:54.944 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-21T09:10:52.943982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252540,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722180,"statfs":{"total":773094113280,"available":772835512320,"internally_reserved":0,"allocated":3063808,"data_stored":1814286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.192855"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.783824+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:10:50.783824+0000","last_peered":"2024-09-21T09:10:50.783824+0000","last_clean":"2024-09-21T09:10:50.783824+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:10:50.783824+0000","last_undegraded":"2024-09-21T09:10:50.783824+0000","last_fullsized":"2024-09-21T09:10:50.783824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:33.465317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.775375+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:10:50.775375+0000","last_peered":"2024-09-21T09:10:50.775375+0000","last_clean":"2024-09-21T09:10:50.775375+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:10:50.775375+0000","last_undegraded":"2024-09-21T09:10:50.775375+0000","last_fullsized":"2024-09-21T09:10:50.775375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:03.383843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.784391+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:10:50.784391+0000","last_peered":"2024-09-21T09:10:50.784391+0000","last_clean":"2024-09-21T09:10:50.784391+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:10:50.784391+0000","last_undegraded":"2024-09-21T09:10:50.784391+0000","last_fullsized":"2024-09-21T09:10:50.784391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:24.356684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:51.586976+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:10:51.586976+0000","last_peered":"2024-09-21T09:10:51.586976+0000","last_clean":"2024-09-21T09:10:51.586976+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:10:51.586976+0000","last_undegraded":"2024-09-21T09:10:51.586976+0000","last_fullsized":"2024-09-21T09:10:51.586976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.786603+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:10:50.786603+0000","last_peered":"2024-09-21T09:10:50.786603+0000","last_clean":"2024-09-21T09:10:50.786603+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:10:50.786603+0000","last_undegraded":"2024-09-21T09:10:50.786603+0000","last_fullsized":"2024-09-21T09:10:50.786603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:07.894252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:51.587265+0000","last_change":"2024-09-21T09:10:51.587265+0000","last_active":"2024-09-21T09:10:51.587265+0000","last_peered":"2024-09-21T09:10:51.587265+0000","last_clean":"2024-09-21T09:10:51.587265+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:10:51.587265+0000","last_undegraded":"2024-09-21T09:10:51.587265+0000","last_fullsized":"2024-09-21T09:10:51.587265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.783592+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:10:50.783592+0000","last_peered":"2024-09-21T09:10:50.783592+0000","last_clean":"2024-09-21T09:10:50.783592+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:10:50.783592+0000","last_undegraded":"2024-09-21T09:10:50.783592+0000","last_fullsized":"2024-09-21T09:10:50.783592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:09.405380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.784701+0000","last_change":"2024-09-21T09:10:50.784701+0000","last_active":"2024-09-21T09:10:50.784701+0000","last_peered":"2024-09-21T09:10:50.784701+0000","last_clean":"2024-09-21T09:10:50.784701+0000","last_became_active":"2024-09-21T09:10:48.763536+0000","last_became_peered":"2024-09-21T09:10:48.763536+0000","last_unstale":"2024-09-21T09:10:50.784701+0000","last_undegraded":"2024-09-21T09:10:50.784701+0000","last_fullsized":"2024-09-21T09:10:50.784701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:24.622195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T09:10:50.772421+0000","last_change":"2024-09-21T09:10:44.726458+0000","last_active":"2024-09-21T09:10:50.772421+0000","last_peered":"2024-09-21T09:10:50.772421+0000","last_clean":"2024-09-21T09:10:50.772421+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:10:50.772421+0000","last_undegraded":"2024-09-21T09:10:50.772421+0000","last_fullsized":"2024-09-21T09:10:50.772421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_clean_scrub_stamp":"2024-09-21T09:10:43.702491+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:07.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":237568,"data_stored":79208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":669557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":237568,"data_stored":79208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":669557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:10:54.945 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T09:10:54.945 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T09:10:54.945 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T09:10:54.946 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T09:10:55.273 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:10:55.273 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T09:10:55.291 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T09:10:55.291 INFO:teuthology.run_tasks:Running task rgw... 2024-09-21T09:10:55.308 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-21T09:10:55.308 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-21T09:10:55.309 INFO:tasks.rgw:Creating data pools 2024-09-21T09:10:55.309 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-21T09:10:55.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-21T09:10:55.813 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'default.rgw.buckets.data' created 2024-09-21T09:10:55.843 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-21T09:10:56.818 INFO:teuthology.orchestra.run.smithi007.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-21T09:10:56.866 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-21T09:10:57.811 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'default.rgw.buckets.index' created 2024-09-21T09:10:57.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-21T09:10:58.824 INFO:teuthology.orchestra.run.smithi007.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-21T09:10:58.865 DEBUG:tasks.rgw:Pools created 2024-09-21T09:10:58.865 INFO:tasks.rgw:Starting rgw... 2024-09-21T09:10:58.865 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-21T09:10:58.865 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-21T09:10:58.865 DEBUG:teuthology.orchestra.run.smithi007:> sudo echo -n http://smithi007.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-21T09:10:58.879 INFO:teuthology.orchestra.run.smithi007.stdout:http://smithi007.front.sepia.ceph.com:80 2024-09-21T09:10:58.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-21T09:10:58.932 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-21T09:10:58.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-21T09:10:58.974 INFO:tasks.rgw.client.0:Started 2024-09-21T09:10:58.974 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi007.front.sepia.ceph.com:80/ 2024-09-21T09:10:58.974 DEBUG:teuthology.orchestra.run.smithi007:> curl http://smithi007.front.sepia.ceph.com:80/ 2024-09-21T09:10:59.002 INFO:teuthology.orchestra.run.smithi007.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T09:10:59.002 INFO:teuthology.orchestra.run.smithi007.stderr: Dload Upload Total Spent Left Speed 2024-09-21T09:10:59.002 INFO:teuthology.orchestra.run.smithi007.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T09:10:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:curl: (7) Failed to connect to smithi007.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-21T09:10:59.003 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T09:11:00.004 DEBUG:teuthology.orchestra.run.smithi007:> curl http://smithi007.front.sepia.ceph.com:80/ 2024-09-21T09:11:00.016 INFO:teuthology.orchestra.run.smithi007.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T09:11:00.016 INFO:teuthology.orchestra.run.smithi007.stderr: Dload Upload Total Spent Left Speed 2024-09-21T09:11:00.017 INFO:teuthology.orchestra.run.smithi007.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T09:11:00.017 INFO:teuthology.orchestra.run.smithi007.stderr:curl: (7) Failed to connect to smithi007.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-21T09:11:00.017 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T09:11:02.018 DEBUG:teuthology.orchestra.run.smithi007:> curl http://smithi007.front.sepia.ceph.com:80/ 2024-09-21T09:11:02.030 INFO:teuthology.orchestra.run.smithi007.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T09:11:02.030 INFO:teuthology.orchestra.run.smithi007.stderr: Dload Upload Total Spent Left Speed 2024-09-21T09:11:02.030 INFO:teuthology.orchestra.run.smithi007.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T09:11:02.030 INFO:teuthology.orchestra.run.smithi007.stderr:curl: (7) Failed to connect to smithi007.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-21T09:11:02.031 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T09:11:06.032 DEBUG:teuthology.orchestra.run.smithi007:> curl http://smithi007.front.sepia.ceph.com:80/ 2024-09-21T09:11:06.044 INFO:teuthology.orchestra.run.smithi007.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T09:11:06.044 INFO:teuthology.orchestra.run.smithi007.stderr: Dload Upload Total Spent Left Speed 2024-09-21T09:11:06.045 INFO:teuthology.orchestra.run.smithi007.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-21T09:11:06.045 INFO:teuthology.orchestra.run.smithi007.stderr:curl: (7) Failed to connect to smithi007.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-21T09:11:06.045 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-21T09:11:08.037 INFO:tasks.rgw.client.0.smithi007.stdout:2024-09-21T09:11:08.033+0000 7f17569c9a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-21T09:11:14.047 DEBUG:teuthology.orchestra.run.smithi007:> curl http://smithi007.front.sepia.ceph.com:80/ 2024-09-21T09:11:14.059 INFO:teuthology.orchestra.run.smithi007.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-21T09:11:14.059 INFO:teuthology.orchestra.run.smithi007.stderr: Dload Upload Total Spent Left Speed 2024-09-21T09:11:14.062 INFO:teuthology.orchestra.run.smithi007.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 49068 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-21T09:11:14.063 INFO:teuthology.orchestra.run.smithi007.stdout:anonymous 2024-09-21T09:11:14.063 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-21T09:11:14.073 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-21T09:11:14.073 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-squid'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-21T09:11:14.073 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-21T09:11:14.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-21T09:11:14.444 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-21T09:11:14.444 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T09:11:14.444 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:11:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:11:14.796 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:11:14.811 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-09-21T09:11:12.950897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529,"ondisk_log_size":529,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270716,"kb_used_data":4560,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754704004,"statfs":{"total":773094113280,"available":772816900096,"internally_reserved":0,"allocated":4669440,"data_stored":2583524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.099850"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.864680+0000","last_change":"2024-09-21T09:10:56.846463+0000","last_active":"2024-09-21T09:11:07.864680+0000","last_peered":"2024-09-21T09:11:07.864680+0000","last_clean":"2024-09-21T09:11:07.864680+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:11:07.864680+0000","last_undegraded":"2024-09-21T09:11:07.864680+0000","last_fullsized":"2024-09-21T09:11:07.864680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886157+0000","last_change":"2024-09-21T09:10:58.836923+0000","last_active":"2024-09-21T09:11:07.886157+0000","last_peered":"2024-09-21T09:11:07.886157+0000","last_clean":"2024-09-21T09:11:07.886157+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:11:07.886157+0000","last_undegraded":"2024-09-21T09:11:07.886157+0000","last_fullsized":"2024-09-21T09:11:07.886157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:30.880333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875342+0000","last_change":"2024-09-21T09:10:56.865056+0000","last_active":"2024-09-21T09:11:07.875342+0000","last_peered":"2024-09-21T09:11:07.875342+0000","last_clean":"2024-09-21T09:11:07.875342+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:11:07.875342+0000","last_undegraded":"2024-09-21T09:11:07.875342+0000","last_fullsized":"2024-09-21T09:11:07.875342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917692+0000","last_change":"2024-09-21T09:10:58.835355+0000","last_active":"2024-09-21T09:11:07.917692+0000","last_peered":"2024-09-21T09:11:07.917692+0000","last_clean":"2024-09-21T09:11:07.917692+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:11:07.917692+0000","last_undegraded":"2024-09-21T09:11:07.917692+0000","last_fullsized":"2024-09-21T09:11:07.917692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:24.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874591+0000","last_change":"2024-09-21T09:10:56.861504+0000","last_active":"2024-09-21T09:11:07.874591+0000","last_peered":"2024-09-21T09:11:07.874591+0000","last_clean":"2024-09-21T09:11:07.874591+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:11:07.874591+0000","last_undegraded":"2024-09-21T09:11:07.874591+0000","last_fullsized":"2024-09-21T09:11:07.874591+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:00.409267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917558+0000","last_change":"2024-09-21T09:10:58.842892+0000","last_active":"2024-09-21T09:11:07.917558+0000","last_peered":"2024-09-21T09:11:07.917558+0000","last_clean":"2024-09-21T09:11:07.917558+0000","last_became_active":"2024-09-21T09:10:58.842456+0000","last_became_peered":"2024-09-21T09:10:58.842456+0000","last_unstale":"2024-09-21T09:11:07.917558+0000","last_undegraded":"2024-09-21T09:11:07.917558+0000","last_fullsized":"2024-09-21T09:11:07.917558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:02.970645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860752+0000","last_change":"2024-09-21T09:10:56.825059+0000","last_active":"2024-09-21T09:11:07.860752+0000","last_peered":"2024-09-21T09:11:07.860752+0000","last_clean":"2024-09-21T09:11:07.860752+0000","last_became_active":"2024-09-21T09:10:56.824415+0000","last_became_peered":"2024-09-21T09:10:56.824415+0000","last_unstale":"2024-09-21T09:11:07.860752+0000","last_undegraded":"2024-09-21T09:11:07.860752+0000","last_fullsized":"2024-09-21T09:11:07.860752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879454+0000","last_change":"2024-09-21T09:10:58.864483+0000","last_active":"2024-09-21T09:11:07.879454+0000","last_peered":"2024-09-21T09:11:07.879454+0000","last_clean":"2024-09-21T09:11:07.879454+0000","last_became_active":"2024-09-21T09:10:58.857109+0000","last_became_peered":"2024-09-21T09:10:58.857109+0000","last_unstale":"2024-09-21T09:11:07.879454+0000","last_undegraded":"2024-09-21T09:11:07.879454+0000","last_fullsized":"2024-09-21T09:11:07.879454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:38.780066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862652+0000","last_change":"2024-09-21T09:10:56.863607+0000","last_active":"2024-09-21T09:11:07.862652+0000","last_peered":"2024-09-21T09:11:07.862652+0000","last_clean":"2024-09-21T09:11:07.862652+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:11:07.862652+0000","last_undegraded":"2024-09-21T09:11:07.862652+0000","last_fullsized":"2024-09-21T09:11:07.862652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862242+0000","last_change":"2024-09-21T09:10:58.851357+0000","last_active":"2024-09-21T09:11:07.862242+0000","last_peered":"2024-09-21T09:11:07.862242+0000","last_clean":"2024-09-21T09:11:07.862242+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:11:07.862242+0000","last_undegraded":"2024-09-21T09:11:07.862242+0000","last_fullsized":"2024-09-21T09:11:07.862242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.858664+0000","last_change":"2024-09-21T09:10:56.823432+0000","last_active":"2024-09-21T09:11:07.858664+0000","last_peered":"2024-09-21T09:11:07.858664+0000","last_clean":"2024-09-21T09:11:07.858664+0000","last_became_active":"2024-09-21T09:10:56.822819+0000","last_became_peered":"2024-09-21T09:10:56.822819+0000","last_unstale":"2024-09-21T09:11:07.858664+0000","last_undegraded":"2024-09-21T09:11:07.858664+0000","last_fullsized":"2024-09-21T09:11:07.858664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863632+0000","last_change":"2024-09-21T09:10:58.825880+0000","last_active":"2024-09-21T09:11:07.863632+0000","last_peered":"2024-09-21T09:11:07.863632+0000","last_clean":"2024-09-21T09:11:07.863632+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:11:07.863632+0000","last_undegraded":"2024-09-21T09:11:07.863632+0000","last_fullsized":"2024-09-21T09:11:07.863632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:46.662637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861708+0000","last_change":"2024-09-21T09:10:56.851331+0000","last_active":"2024-09-21T09:11:07.861708+0000","last_peered":"2024-09-21T09:11:07.861708+0000","last_clean":"2024-09-21T09:11:07.861708+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:11:07.861708+0000","last_undegraded":"2024-09-21T09:11:07.861708+0000","last_fullsized":"2024-09-21T09:11:07.861708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861607+0000","last_change":"2024-09-21T09:10:58.868708+0000","last_active":"2024-09-21T09:11:07.861607+0000","last_peered":"2024-09-21T09:11:07.861607+0000","last_clean":"2024-09-21T09:11:07.861607+0000","last_became_active":"2024-09-21T09:10:58.868277+0000","last_became_peered":"2024-09-21T09:10:58.868277+0000","last_unstale":"2024-09-21T09:11:07.861607+0000","last_undegraded":"2024-09-21T09:11:07.861607+0000","last_fullsized":"2024-09-21T09:11:07.861607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872599+0000","last_change":"2024-09-21T09:10:56.864409+0000","last_active":"2024-09-21T09:11:07.872599+0000","last_peered":"2024-09-21T09:11:07.872599+0000","last_clean":"2024-09-21T09:11:07.872599+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:11:07.872599+0000","last_undegraded":"2024-09-21T09:11:07.872599+0000","last_fullsized":"2024-09-21T09:11:07.872599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875747+0000","last_change":"2024-09-21T09:10:58.837006+0000","last_active":"2024-09-21T09:11:07.875747+0000","last_peered":"2024-09-21T09:11:07.875747+0000","last_clean":"2024-09-21T09:11:07.875747+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:11:07.875747+0000","last_undegraded":"2024-09-21T09:11:07.875747+0000","last_fullsized":"2024-09-21T09:11:07.875747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:52.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917168+0000","last_change":"2024-09-21T09:10:58.853249+0000","last_active":"2024-09-21T09:11:07.917168+0000","last_peered":"2024-09-21T09:11:07.917168+0000","last_clean":"2024-09-21T09:11:07.917168+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:11:07.917168+0000","last_undegraded":"2024-09-21T09:11:07.917168+0000","last_fullsized":"2024-09-21T09:11:07.917168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:03.692219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887881+0000","last_change":"2024-09-21T09:10:56.838955+0000","last_active":"2024-09-21T09:11:07.887881+0000","last_peered":"2024-09-21T09:11:07.887881+0000","last_clean":"2024-09-21T09:11:07.887881+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:11:07.887881+0000","last_undegraded":"2024-09-21T09:11:07.887881+0000","last_fullsized":"2024-09-21T09:11:07.887881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861489+0000","last_change":"2024-09-21T09:10:58.869303+0000","last_active":"2024-09-21T09:11:07.861489+0000","last_peered":"2024-09-21T09:11:07.861489+0000","last_clean":"2024-09-21T09:11:07.861489+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:11:07.861489+0000","last_undegraded":"2024-09-21T09:11:07.861489+0000","last_fullsized":"2024-09-21T09:11:07.861489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.864346+0000","last_change":"2024-09-21T09:10:56.866497+0000","last_active":"2024-09-21T09:11:07.864346+0000","last_peered":"2024-09-21T09:11:07.864346+0000","last_clean":"2024-09-21T09:11:07.864346+0000","last_became_active":"2024-09-21T09:10:56.866213+0000","last_became_peered":"2024-09-21T09:10:56.866213+0000","last_unstale":"2024-09-21T09:11:07.864346+0000","last_undegraded":"2024-09-21T09:11:07.864346+0000","last_fullsized":"2024-09-21T09:11:07.864346+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:33.551996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885862+0000","last_change":"2024-09-21T09:10:58.840976+0000","last_active":"2024-09-21T09:11:07.885862+0000","last_peered":"2024-09-21T09:11:07.885862+0000","last_clean":"2024-09-21T09:11:07.885862+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:11:07.885862+0000","last_undegraded":"2024-09-21T09:11:07.885862+0000","last_fullsized":"2024-09-21T09:11:07.885862+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863890+0000","last_change":"2024-09-21T09:10:56.853888+0000","last_active":"2024-09-21T09:11:07.863890+0000","last_peered":"2024-09-21T09:11:07.863890+0000","last_clean":"2024-09-21T09:11:07.863890+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:11:07.863890+0000","last_undegraded":"2024-09-21T09:11:07.863890+0000","last_fullsized":"2024-09-21T09:11:07.863890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860687+0000","last_change":"2024-09-21T09:10:58.838132+0000","last_active":"2024-09-21T09:11:07.860687+0000","last_peered":"2024-09-21T09:11:07.860687+0000","last_clean":"2024-09-21T09:11:07.860687+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:11:07.860687+0000","last_undegraded":"2024-09-21T09:11:07.860687+0000","last_fullsized":"2024-09-21T09:11:07.860687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862733+0000","last_change":"2024-09-21T09:10:56.845923+0000","last_active":"2024-09-21T09:11:07.862733+0000","last_peered":"2024-09-21T09:11:07.862733+0000","last_clean":"2024-09-21T09:11:07.862733+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:11:07.862733+0000","last_undegraded":"2024-09-21T09:11:07.862733+0000","last_fullsized":"2024-09-21T09:11:07.862733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873591+0000","last_change":"2024-09-21T09:10:58.848326+0000","last_active":"2024-09-21T09:11:07.873591+0000","last_peered":"2024-09-21T09:11:07.873591+0000","last_clean":"2024-09-21T09:11:07.873591+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:11:07.873591+0000","last_undegraded":"2024-09-21T09:11:07.873591+0000","last_fullsized":"2024-09-21T09:11:07.873591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:44.318321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861552+0000","last_change":"2024-09-21T09:10:56.859019+0000","last_active":"2024-09-21T09:11:07.861552+0000","last_peered":"2024-09-21T09:11:07.861552+0000","last_clean":"2024-09-21T09:11:07.861552+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:11:07.861552+0000","last_undegraded":"2024-09-21T09:11:07.861552+0000","last_fullsized":"2024-09-21T09:11:07.861552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886865+0000","last_change":"2024-09-21T09:10:58.830335+0000","last_active":"2024-09-21T09:11:07.886865+0000","last_peered":"2024-09-21T09:11:07.886865+0000","last_clean":"2024-09-21T09:11:07.886865+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:11:07.886865+0000","last_undegraded":"2024-09-21T09:11:07.886865+0000","last_fullsized":"2024-09-21T09:11:07.886865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860588+0000","last_change":"2024-09-21T09:10:56.862662+0000","last_active":"2024-09-21T09:11:07.860588+0000","last_peered":"2024-09-21T09:11:07.860588+0000","last_clean":"2024-09-21T09:11:07.860588+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:11:07.860588+0000","last_undegraded":"2024-09-21T09:11:07.860588+0000","last_fullsized":"2024-09-21T09:11:07.860588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860144+0000","last_change":"2024-09-21T09:11:06.898983+0000","last_active":"2024-09-21T09:11:07.860144+0000","last_peered":"2024-09-21T09:11:07.860144+0000","last_clean":"2024-09-21T09:11:07.860144+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:11:07.860144+0000","last_undegraded":"2024-09-21T09:11:07.860144+0000","last_fullsized":"2024-09-21T09:11:07.860144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861279+0000","last_change":"2024-09-21T09:10:58.876069+0000","last_active":"2024-09-21T09:11:07.861279+0000","last_peered":"2024-09-21T09:11:07.861279+0000","last_clean":"2024-09-21T09:11:07.861279+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:11:07.861279+0000","last_undegraded":"2024-09-21T09:11:07.861279+0000","last_fullsized":"2024-09-21T09:11:07.861279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917597+0000","last_change":"2024-09-21T09:10:56.848523+0000","last_active":"2024-09-21T09:11:07.917597+0000","last_peered":"2024-09-21T09:11:07.917597+0000","last_clean":"2024-09-21T09:11:07.917597+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:11:07.917597+0000","last_undegraded":"2024-09-21T09:11:07.917597+0000","last_fullsized":"2024-09-21T09:11:07.917597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:19.819608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919936+0000","last_change":"2024-09-21T09:11:00.842168+0000","last_active":"2024-09-21T09:11:07.919936+0000","last_peered":"2024-09-21T09:11:07.919936+0000","last_clean":"2024-09-21T09:11:07.919936+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:11:07.919936+0000","last_undegraded":"2024-09-21T09:11:07.919936+0000","last_fullsized":"2024-09-21T09:11:07.919936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:33.920548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.253499+0000","last_change":"2024-09-21T09:11:02.866403+0000","last_active":"2024-09-21T09:11:08.253499+0000","last_peered":"2024-09-21T09:11:08.253499+0000","last_clean":"2024-09-21T09:11:08.253499+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:11:08.253499+0000","last_undegraded":"2024-09-21T09:11:08.253499+0000","last_fullsized":"2024-09-21T09:11:08.253499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:12.124539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887073+0000","last_change":"2024-09-21T09:11:04.894715+0000","last_active":"2024-09-21T09:11:07.887073+0000","last_peered":"2024-09-21T09:11:07.887073+0000","last_clean":"2024-09-21T09:11:07.887073+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:11:07.887073+0000","last_undegraded":"2024-09-21T09:11:07.887073+0000","last_fullsized":"2024-09-21T09:11:07.887073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:59.579572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885315+0000","last_change":"2024-09-21T09:11:06.885484+0000","last_active":"2024-09-21T09:11:07.885315+0000","last_peered":"2024-09-21T09:11:07.885315+0000","last_clean":"2024-09-21T09:11:07.885315+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:11:07.885315+0000","last_undegraded":"2024-09-21T09:11:07.885315+0000","last_fullsized":"2024-09-21T09:11:07.885315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:13.165470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919329+0000","last_change":"2024-09-21T09:10:58.842832+0000","last_active":"2024-09-21T09:11:07.919329+0000","last_peered":"2024-09-21T09:11:07.919329+0000","last_clean":"2024-09-21T09:11:07.919329+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:11:07.919329+0000","last_undegraded":"2024-09-21T09:11:07.919329+0000","last_fullsized":"2024-09-21T09:11:07.919329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:12.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861312+0000","last_change":"2024-09-21T09:10:56.849428+0000","last_active":"2024-09-21T09:11:07.861312+0000","last_peered":"2024-09-21T09:11:07.861312+0000","last_clean":"2024-09-21T09:11:07.861312+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:11:07.861312+0000","last_undegraded":"2024-09-21T09:11:07.861312+0000","last_fullsized":"2024-09-21T09:11:07.861312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879247+0000","last_change":"2024-09-21T09:11:00.833428+0000","last_active":"2024-09-21T09:11:07.879247+0000","last_peered":"2024-09-21T09:11:07.879247+0000","last_clean":"2024-09-21T09:11:07.879247+0000","last_became_active":"2024-09-21T09:11:00.832336+0000","last_became_peered":"2024-09-21T09:11:00.832336+0000","last_unstale":"2024-09-21T09:11:07.879247+0000","last_undegraded":"2024-09-21T09:11:07.879247+0000","last_fullsized":"2024-09-21T09:11:07.879247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:51.221746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.652738+0000","last_change":"2024-09-21T09:11:02.866594+0000","last_active":"2024-09-21T09:11:08.652738+0000","last_peered":"2024-09-21T09:11:08.652738+0000","last_clean":"2024-09-21T09:11:08.652738+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:11:08.652738+0000","last_undegraded":"2024-09-21T09:11:08.652738+0000","last_fullsized":"2024-09-21T09:11:08.652738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886658+0000","last_change":"2024-09-21T09:11:04.887299+0000","last_active":"2024-09-21T09:11:07.886658+0000","last_peered":"2024-09-21T09:11:07.886658+0000","last_clean":"2024-09-21T09:11:07.886658+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:11:07.886658+0000","last_undegraded":"2024-09-21T09:11:07.886658+0000","last_fullsized":"2024-09-21T09:11:07.886658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:08.490686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860069+0000","last_change":"2024-09-21T09:11:06.891369+0000","last_active":"2024-09-21T09:11:07.860069+0000","last_peered":"2024-09-21T09:11:07.860069+0000","last_clean":"2024-09-21T09:11:07.860069+0000","last_became_active":"2024-09-21T09:11:06.890505+0000","last_became_peered":"2024-09-21T09:11:06.890505+0000","last_unstale":"2024-09-21T09:11:07.860069+0000","last_undegraded":"2024-09-21T09:11:07.860069+0000","last_fullsized":"2024-09-21T09:11:07.860069+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:10.502126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875104+0000","last_change":"2024-09-21T09:10:58.851370+0000","last_active":"2024-09-21T09:11:07.875104+0000","last_peered":"2024-09-21T09:11:07.875104+0000","last_clean":"2024-09-21T09:11:07.875104+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:11:07.875104+0000","last_undegraded":"2024-09-21T09:11:07.875104+0000","last_fullsized":"2024-09-21T09:11:07.875104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:05.984687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917939+0000","last_change":"2024-09-21T09:10:56.836939+0000","last_active":"2024-09-21T09:11:07.917939+0000","last_peered":"2024-09-21T09:11:07.917939+0000","last_clean":"2024-09-21T09:11:07.917939+0000","last_became_active":"2024-09-21T09:10:56.836378+0000","last_became_peered":"2024-09-21T09:10:56.836378+0000","last_unstale":"2024-09-21T09:11:07.917939+0000","last_undegraded":"2024-09-21T09:11:07.917939+0000","last_fullsized":"2024-09-21T09:11:07.917939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:09.594344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879871+0000","last_change":"2024-09-21T09:11:00.845836+0000","last_active":"2024-09-21T09:11:07.879871+0000","last_peered":"2024-09-21T09:11:07.879871+0000","last_clean":"2024-09-21T09:11:07.879871+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:11:07.879871+0000","last_undegraded":"2024-09-21T09:11:07.879871+0000","last_fullsized":"2024-09-21T09:11:07.879871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:06.353993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.714205+0000","last_change":"2024-09-21T09:11:02.852500+0000","last_active":"2024-09-21T09:11:08.714205+0000","last_peered":"2024-09-21T09:11:08.714205+0000","last_clean":"2024-09-21T09:11:08.714205+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:11:08.714205+0000","last_undegraded":"2024-09-21T09:11:08.714205+0000","last_fullsized":"2024-09-21T09:11:08.714205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:19.073540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.920233+0000","last_change":"2024-09-21T09:11:04.895087+0000","last_active":"2024-09-21T09:11:07.920233+0000","last_peered":"2024-09-21T09:11:07.920233+0000","last_clean":"2024-09-21T09:11:07.920233+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:11:07.920233+0000","last_undegraded":"2024-09-21T09:11:07.920233+0000","last_fullsized":"2024-09-21T09:11:07.920233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:11.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.858265+0000","last_change":"2024-09-21T09:11:06.895556+0000","last_active":"2024-09-21T09:11:07.858265+0000","last_peered":"2024-09-21T09:11:07.858265+0000","last_clean":"2024-09-21T09:11:07.858265+0000","last_became_active":"2024-09-21T09:11:06.894677+0000","last_became_peered":"2024-09-21T09:11:06.894677+0000","last_unstale":"2024-09-21T09:11:07.858265+0000","last_undegraded":"2024-09-21T09:11:07.858265+0000","last_fullsized":"2024-09-21T09:11:07.858265+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:20.449346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875410+0000","last_change":"2024-09-21T09:10:58.837602+0000","last_active":"2024-09-21T09:11:07.875410+0000","last_peered":"2024-09-21T09:11:07.875410+0000","last_clean":"2024-09-21T09:11:07.875410+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:11:07.875410+0000","last_undegraded":"2024-09-21T09:11:07.875410+0000","last_fullsized":"2024-09-21T09:11:07.875410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:36.269116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886673+0000","last_change":"2024-09-21T09:10:56.844292+0000","last_active":"2024-09-21T09:11:07.886673+0000","last_peered":"2024-09-21T09:11:07.886673+0000","last_clean":"2024-09-21T09:11:07.886673+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:11:07.886673+0000","last_undegraded":"2024-09-21T09:11:07.886673+0000","last_fullsized":"2024-09-21T09:11:07.886673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918367+0000","last_change":"2024-09-21T09:11:00.852984+0000","last_active":"2024-09-21T09:11:07.918367+0000","last_peered":"2024-09-21T09:11:07.918367+0000","last_clean":"2024-09-21T09:11:07.918367+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:11:07.918367+0000","last_undegraded":"2024-09-21T09:11:07.918367+0000","last_fullsized":"2024-09-21T09:11:07.918367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:33.175145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.719267+0000","last_change":"2024-09-21T09:11:02.878317+0000","last_active":"2024-09-21T09:11:08.719267+0000","last_peered":"2024-09-21T09:11:08.719267+0000","last_clean":"2024-09-21T09:11:08.719267+0000","last_became_active":"2024-09-21T09:11:02.877537+0000","last_became_peered":"2024-09-21T09:11:02.877537+0000","last_unstale":"2024-09-21T09:11:08.719267+0000","last_undegraded":"2024-09-21T09:11:08.719267+0000","last_fullsized":"2024-09-21T09:11:08.719267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:23.147293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874181+0000","last_change":"2024-09-21T09:11:04.894947+0000","last_active":"2024-09-21T09:11:07.874181+0000","last_peered":"2024-09-21T09:11:07.874181+0000","last_clean":"2024-09-21T09:11:07.874181+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:11:07.874181+0000","last_undegraded":"2024-09-21T09:11:07.874181+0000","last_fullsized":"2024-09-21T09:11:07.874181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:21.481386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917278+0000","last_change":"2024-09-21T09:10:58.841384+0000","last_active":"2024-09-21T09:11:07.917278+0000","last_peered":"2024-09-21T09:11:07.917278+0000","last_clean":"2024-09-21T09:11:07.917278+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:11:07.917278+0000","last_undegraded":"2024-09-21T09:11:07.917278+0000","last_fullsized":"2024-09-21T09:11:07.917278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:08.308265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.864852+0000","last_change":"2024-09-21T09:10:56.846710+0000","last_active":"2024-09-21T09:11:07.864852+0000","last_peered":"2024-09-21T09:11:07.864852+0000","last_clean":"2024-09-21T09:11:07.864852+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:11:07.864852+0000","last_undegraded":"2024-09-21T09:11:07.864852+0000","last_fullsized":"2024-09-21T09:11:07.864852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885709+0000","last_change":"2024-09-21T09:11:00.839560+0000","last_active":"2024-09-21T09:11:07.885709+0000","last_peered":"2024-09-21T09:11:07.885709+0000","last_clean":"2024-09-21T09:11:07.885709+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:11:07.885709+0000","last_undegraded":"2024-09-21T09:11:07.885709+0000","last_fullsized":"2024-09-21T09:11:07.885709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:41.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'19","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.819908+0000","last_change":"2024-09-21T09:11:02.872323+0000","last_active":"2024-09-21T09:11:08.819908+0000","last_peered":"2024-09-21T09:11:08.819908+0000","last_clean":"2024-09-21T09:11:08.819908+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:11:08.819908+0000","last_undegraded":"2024-09-21T09:11:08.819908+0000","last_fullsized":"2024-09-21T09:11:08.819908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860330+0000","last_change":"2024-09-21T09:11:04.886593+0000","last_active":"2024-09-21T09:11:07.860330+0000","last_peered":"2024-09-21T09:11:07.860330+0000","last_clean":"2024-09-21T09:11:07.860330+0000","last_became_active":"2024-09-21T09:11:04.886030+0000","last_became_peered":"2024-09-21T09:11:04.886030+0000","last_unstale":"2024-09-21T09:11:07.860330+0000","last_undegraded":"2024-09-21T09:11:07.860330+0000","last_fullsized":"2024-09-21T09:11:07.860330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:09.002676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859374+0000","last_change":"2024-09-21T09:11:06.892001+0000","last_active":"2024-09-21T09:11:07.859374+0000","last_peered":"2024-09-21T09:11:07.859374+0000","last_clean":"2024-09-21T09:11:07.859374+0000","last_became_active":"2024-09-21T09:11:06.891156+0000","last_became_peered":"2024-09-21T09:11:06.891156+0000","last_unstale":"2024-09-21T09:11:07.859374+0000","last_undegraded":"2024-09-21T09:11:07.859374+0000","last_fullsized":"2024-09-21T09:11:07.859374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886013+0000","last_change":"2024-09-21T09:10:58.839960+0000","last_active":"2024-09-21T09:11:07.886013+0000","last_peered":"2024-09-21T09:11:07.886013+0000","last_clean":"2024-09-21T09:11:07.886013+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:11:07.886013+0000","last_undegraded":"2024-09-21T09:11:07.886013+0000","last_fullsized":"2024-09-21T09:11:07.886013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862328+0000","last_change":"2024-09-21T09:10:56.865060+0000","last_active":"2024-09-21T09:11:07.862328+0000","last_peered":"2024-09-21T09:11:07.862328+0000","last_clean":"2024-09-21T09:11:07.862328+0000","last_became_active":"2024-09-21T09:10:56.851666+0000","last_became_peered":"2024-09-21T09:10:56.851666+0000","last_unstale":"2024-09-21T09:11:07.862328+0000","last_undegraded":"2024-09-21T09:11:07.862328+0000","last_fullsized":"2024-09-21T09:11:07.862328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859495+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:11:07.859495+0000","last_peered":"2024-09-21T09:11:07.859495+0000","last_clean":"2024-09-21T09:11:07.859495+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:11:07.859495+0000","last_undegraded":"2024-09-21T09:11:07.859495+0000","last_fullsized":"2024-09-21T09:11:07.859495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:48.669684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.691078+0000","last_change":"2024-09-21T09:11:02.866165+0000","last_active":"2024-09-21T09:11:08.691078+0000","last_peered":"2024-09-21T09:11:08.691078+0000","last_clean":"2024-09-21T09:11:08.691078+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:11:08.691078+0000","last_undegraded":"2024-09-21T09:11:08.691078+0000","last_fullsized":"2024-09-21T09:11:08.691078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:54:48.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877248+0000","last_change":"2024-09-21T09:11:04.871999+0000","last_active":"2024-09-21T09:11:07.877248+0000","last_peered":"2024-09-21T09:11:07.877248+0000","last_clean":"2024-09-21T09:11:07.877248+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:11:07.877248+0000","last_undegraded":"2024-09-21T09:11:07.877248+0000","last_fullsized":"2024-09-21T09:11:07.877248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:03.218684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885937+0000","last_change":"2024-09-21T09:11:06.888476+0000","last_active":"2024-09-21T09:11:07.885937+0000","last_peered":"2024-09-21T09:11:07.885937+0000","last_clean":"2024-09-21T09:11:07.885937+0000","last_became_active":"2024-09-21T09:11:06.887587+0000","last_became_peered":"2024-09-21T09:11:06.887587+0000","last_unstale":"2024-09-21T09:11:07.885937+0000","last_undegraded":"2024-09-21T09:11:07.885937+0000","last_fullsized":"2024-09-21T09:11:07.885937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:44.751998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.858161+0000","last_change":"2024-09-21T09:10:58.844864+0000","last_active":"2024-09-21T09:11:07.858161+0000","last_peered":"2024-09-21T09:11:07.858161+0000","last_clean":"2024-09-21T09:11:07.858161+0000","last_became_active":"2024-09-21T09:10:58.844473+0000","last_became_peered":"2024-09-21T09:10:58.844473+0000","last_unstale":"2024-09-21T09:11:07.858161+0000","last_undegraded":"2024-09-21T09:11:07.858161+0000","last_fullsized":"2024-09-21T09:11:07.858161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918775+0000","last_change":"2024-09-21T09:10:56.842697+0000","last_active":"2024-09-21T09:11:07.918775+0000","last_peered":"2024-09-21T09:11:07.918775+0000","last_clean":"2024-09-21T09:11:07.918775+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:11:07.918775+0000","last_undegraded":"2024-09-21T09:11:07.918775+0000","last_fullsized":"2024-09-21T09:11:07.918775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:42.311166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873152+0000","last_change":"2024-09-21T09:11:00.852970+0000","last_active":"2024-09-21T09:11:07.873152+0000","last_peered":"2024-09-21T09:11:07.873152+0000","last_clean":"2024-09-21T09:11:07.873152+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:11:07.873152+0000","last_undegraded":"2024-09-21T09:11:07.873152+0000","last_fullsized":"2024-09-21T09:11:07.873152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:35.201984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"36'15","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.601523+0000","last_change":"2024-09-21T09:11:02.859081+0000","last_active":"2024-09-21T09:11:08.601523+0000","last_peered":"2024-09-21T09:11:08.601523+0000","last_clean":"2024-09-21T09:11:08.601523+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:11:08.601523+0000","last_undegraded":"2024-09-21T09:11:08.601523+0000","last_fullsized":"2024-09-21T09:11:08.601523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:19.576627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872379+0000","last_change":"2024-09-21T09:11:04.895980+0000","last_active":"2024-09-21T09:11:07.872379+0000","last_peered":"2024-09-21T09:11:07.872379+0000","last_clean":"2024-09-21T09:11:07.872379+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:11:07.872379+0000","last_undegraded":"2024-09-21T09:11:07.872379+0000","last_fullsized":"2024-09-21T09:11:07.872379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:57.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861986+0000","last_change":"2024-09-21T09:11:06.890295+0000","last_active":"2024-09-21T09:11:07.861986+0000","last_peered":"2024-09-21T09:11:07.861986+0000","last_clean":"2024-09-21T09:11:07.861986+0000","last_became_active":"2024-09-21T09:11:06.889522+0000","last_became_peered":"2024-09-21T09:11:06.889522+0000","last_unstale":"2024-09-21T09:11:07.861986+0000","last_undegraded":"2024-09-21T09:11:07.861986+0000","last_fullsized":"2024-09-21T09:11:07.861986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:02.337068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874028+0000","last_change":"2024-09-21T09:10:58.871951+0000","last_active":"2024-09-21T09:11:07.874028+0000","last_peered":"2024-09-21T09:11:07.874028+0000","last_clean":"2024-09-21T09:11:07.874028+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:11:07.874028+0000","last_undegraded":"2024-09-21T09:11:07.874028+0000","last_fullsized":"2024-09-21T09:11:07.874028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:16.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863329+0000","last_change":"2024-09-21T09:10:56.855073+0000","last_active":"2024-09-21T09:11:07.863329+0000","last_peered":"2024-09-21T09:11:07.863329+0000","last_clean":"2024-09-21T09:11:07.863329+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:11:07.863329+0000","last_undegraded":"2024-09-21T09:11:07.863329+0000","last_fullsized":"2024-09-21T09:11:07.863329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:43.818365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860105+0000","last_change":"2024-09-21T09:11:00.845552+0000","last_active":"2024-09-21T09:11:07.860105+0000","last_peered":"2024-09-21T09:11:07.860105+0000","last_clean":"2024-09-21T09:11:07.860105+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:11:07.860105+0000","last_undegraded":"2024-09-21T09:11:07.860105+0000","last_fullsized":"2024-09-21T09:11:07.860105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:44.841947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"36'12","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.222737+0000","last_change":"2024-09-21T09:11:02.868260+0000","last_active":"2024-09-21T09:11:08.222737+0000","last_peered":"2024-09-21T09:11:08.222737+0000","last_clean":"2024-09-21T09:11:08.222737+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:11:08.222737+0000","last_undegraded":"2024-09-21T09:11:08.222737+0000","last_fullsized":"2024-09-21T09:11:08.222737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:38.299285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873176+0000","last_change":"2024-09-21T09:11:04.890815+0000","last_active":"2024-09-21T09:11:07.873176+0000","last_peered":"2024-09-21T09:11:07.873176+0000","last_clean":"2024-09-21T09:11:07.873176+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:11:07.873176+0000","last_undegraded":"2024-09-21T09:11:07.873176+0000","last_fullsized":"2024-09-21T09:11:07.873176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:26.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892269+0000","last_change":"2024-09-21T09:11:06.888148+0000","last_active":"2024-09-21T09:11:07.892269+0000","last_peered":"2024-09-21T09:11:07.892269+0000","last_clean":"2024-09-21T09:11:07.892269+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:11:07.892269+0000","last_undegraded":"2024-09-21T09:11:07.892269+0000","last_fullsized":"2024-09-21T09:11:07.892269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862967+0000","last_change":"2024-09-21T09:10:58.871840+0000","last_active":"2024-09-21T09:11:07.862967+0000","last_peered":"2024-09-21T09:11:07.862967+0000","last_clean":"2024-09-21T09:11:07.862967+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:11:07.862967+0000","last_undegraded":"2024-09-21T09:11:07.862967+0000","last_fullsized":"2024-09-21T09:11:07.862967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891863+0000","last_change":"2024-09-21T09:10:56.855886+0000","last_active":"2024-09-21T09:11:07.891863+0000","last_peered":"2024-09-21T09:11:07.891863+0000","last_clean":"2024-09-21T09:11:07.891863+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:11:07.891863+0000","last_undegraded":"2024-09-21T09:11:07.891863+0000","last_fullsized":"2024-09-21T09:11:07.891863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891220+0000","last_change":"2024-09-21T09:11:00.850308+0000","last_active":"2024-09-21T09:11:07.891220+0000","last_peered":"2024-09-21T09:11:07.891220+0000","last_clean":"2024-09-21T09:11:07.891220+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:11:07.891220+0000","last_undegraded":"2024-09-21T09:11:07.891220+0000","last_fullsized":"2024-09-21T09:11:07.891220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:13.608546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"36'11","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.754747+0000","last_change":"2024-09-21T09:11:02.866122+0000","last_active":"2024-09-21T09:11:08.754747+0000","last_peered":"2024-09-21T09:11:08.754747+0000","last_clean":"2024-09-21T09:11:08.754747+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:11:08.754747+0000","last_undegraded":"2024-09-21T09:11:08.754747+0000","last_fullsized":"2024-09-21T09:11:08.754747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892034+0000","last_change":"2024-09-21T09:11:04.880608+0000","last_active":"2024-09-21T09:11:07.892034+0000","last_peered":"2024-09-21T09:11:07.892034+0000","last_clean":"2024-09-21T09:11:07.892034+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:11:07.892034+0000","last_undegraded":"2024-09-21T09:11:07.892034+0000","last_fullsized":"2024-09-21T09:11:07.892034+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:39.226968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872131+0000","last_change":"2024-09-21T09:11:06.892201+0000","last_active":"2024-09-21T09:11:07.872131+0000","last_peered":"2024-09-21T09:11:07.872131+0000","last_clean":"2024-09-21T09:11:07.872131+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:11:07.872131+0000","last_undegraded":"2024-09-21T09:11:07.872131+0000","last_fullsized":"2024-09-21T09:11:07.872131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:32.463353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919867+0000","last_change":"2024-09-21T09:10:58.838223+0000","last_active":"2024-09-21T09:11:07.919867+0000","last_peered":"2024-09-21T09:11:07.919867+0000","last_clean":"2024-09-21T09:11:07.919867+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:11:07.919867+0000","last_undegraded":"2024-09-21T09:11:07.919867+0000","last_fullsized":"2024-09-21T09:11:07.919867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:01.253234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918668+0000","last_change":"2024-09-21T09:10:56.841106+0000","last_active":"2024-09-21T09:11:07.918668+0000","last_peered":"2024-09-21T09:11:07.918668+0000","last_clean":"2024-09-21T09:11:07.918668+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:11:07.918668+0000","last_undegraded":"2024-09-21T09:11:07.918668+0000","last_fullsized":"2024-09-21T09:11:07.918668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:40.827746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873468+0000","last_change":"2024-09-21T09:11:00.841164+0000","last_active":"2024-09-21T09:11:07.873468+0000","last_peered":"2024-09-21T09:11:07.873468+0000","last_clean":"2024-09-21T09:11:07.873468+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:11:07.873468+0000","last_undegraded":"2024-09-21T09:11:07.873468+0000","last_fullsized":"2024-09-21T09:11:07.873468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:05.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"36'15","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.829827+0000","last_change":"2024-09-21T09:11:02.852292+0000","last_active":"2024-09-21T09:11:08.829827+0000","last_peered":"2024-09-21T09:11:08.829827+0000","last_clean":"2024-09-21T09:11:08.829827+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:11:08.829827+0000","last_undegraded":"2024-09-21T09:11:08.829827+0000","last_fullsized":"2024-09-21T09:11:08.829827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:12.322229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891842+0000","last_change":"2024-09-21T09:11:04.892391+0000","last_active":"2024-09-21T09:11:07.891842+0000","last_peered":"2024-09-21T09:11:07.891842+0000","last_clean":"2024-09-21T09:11:07.891842+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:11:07.891842+0000","last_undegraded":"2024-09-21T09:11:07.891842+0000","last_fullsized":"2024-09-21T09:11:07.891842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:52.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859871+0000","last_change":"2024-09-21T09:11:06.883898+0000","last_active":"2024-09-21T09:11:07.859871+0000","last_peered":"2024-09-21T09:11:07.859871+0000","last_clean":"2024-09-21T09:11:07.859871+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:11:07.859871+0000","last_undegraded":"2024-09-21T09:11:07.859871+0000","last_fullsized":"2024-09-21T09:11:07.859871+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861295+0000","last_change":"2024-09-21T09:10:58.837935+0000","last_active":"2024-09-21T09:11:07.861295+0000","last_peered":"2024-09-21T09:11:07.861295+0000","last_clean":"2024-09-21T09:11:07.861295+0000","last_became_active":"2024-09-21T09:10:58.837642+0000","last_became_peered":"2024-09-21T09:10:58.837642+0000","last_unstale":"2024-09-21T09:11:07.861295+0000","last_undegraded":"2024-09-21T09:11:07.861295+0000","last_fullsized":"2024-09-21T09:11:07.861295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:30.880333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917989+0000","last_change":"2024-09-21T09:10:56.844590+0000","last_active":"2024-09-21T09:11:07.917989+0000","last_peered":"2024-09-21T09:11:07.917989+0000","last_clean":"2024-09-21T09:11:07.917989+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:11:07.917989+0000","last_undegraded":"2024-09-21T09:11:07.917989+0000","last_fullsized":"2024-09-21T09:11:07.917989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:20.839825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887676+0000","last_change":"2024-09-21T09:11:00.839056+0000","last_active":"2024-09-21T09:11:07.887676+0000","last_peered":"2024-09-21T09:11:07.887676+0000","last_clean":"2024-09-21T09:11:07.887676+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:11:07.887676+0000","last_undegraded":"2024-09-21T09:11:07.887676+0000","last_fullsized":"2024-09-21T09:11:07.887676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:07.991734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.610824+0000","last_change":"2024-09-21T09:11:02.876439+0000","last_active":"2024-09-21T09:11:08.610824+0000","last_peered":"2024-09-21T09:11:08.610824+0000","last_clean":"2024-09-21T09:11:08.610824+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:11:08.610824+0000","last_undegraded":"2024-09-21T09:11:08.610824+0000","last_fullsized":"2024-09-21T09:11:08.610824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886756+0000","last_change":"2024-09-21T09:11:04.884790+0000","last_active":"2024-09-21T09:11:07.886756+0000","last_peered":"2024-09-21T09:11:07.886756+0000","last_clean":"2024-09-21T09:11:07.886756+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:11:07.886756+0000","last_undegraded":"2024-09-21T09:11:07.886756+0000","last_fullsized":"2024-09-21T09:11:07.886756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:00.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857883+0000","last_change":"2024-09-21T09:11:06.887820+0000","last_active":"2024-09-21T09:11:07.857883+0000","last_peered":"2024-09-21T09:11:07.857883+0000","last_clean":"2024-09-21T09:11:07.857883+0000","last_became_active":"2024-09-21T09:11:06.886984+0000","last_became_peered":"2024-09-21T09:11:06.886984+0000","last_unstale":"2024-09-21T09:11:07.857883+0000","last_undegraded":"2024-09-21T09:11:07.857883+0000","last_fullsized":"2024-09-21T09:11:07.857883+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:09.296705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892688+0000","last_change":"2024-09-21T09:10:58.873730+0000","last_active":"2024-09-21T09:11:07.892688+0000","last_peered":"2024-09-21T09:11:07.892688+0000","last_clean":"2024-09-21T09:11:07.892688+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:11:07.892688+0000","last_undegraded":"2024-09-21T09:11:07.892688+0000","last_fullsized":"2024-09-21T09:11:07.892688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877889+0000","last_change":"2024-09-21T09:10:56.849104+0000","last_active":"2024-09-21T09:11:07.877889+0000","last_peered":"2024-09-21T09:11:07.877889+0000","last_clean":"2024-09-21T09:11:07.877889+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:11:07.877889+0000","last_undegraded":"2024-09-21T09:11:07.877889+0000","last_fullsized":"2024-09-21T09:11:07.877889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:34.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918861+0000","last_change":"2024-09-21T09:11:00.841893+0000","last_active":"2024-09-21T09:11:07.918861+0000","last_peered":"2024-09-21T09:11:07.918861+0000","last_clean":"2024-09-21T09:11:07.918861+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:11:07.918861+0000","last_undegraded":"2024-09-21T09:11:07.918861+0000","last_fullsized":"2024-09-21T09:11:07.918861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:55.253483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'17","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.747430+0000","last_change":"2024-09-21T09:11:02.867833+0000","last_active":"2024-09-21T09:11:08.747430+0000","last_peered":"2024-09-21T09:11:08.747430+0000","last_clean":"2024-09-21T09:11:08.747430+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:11:08.747430+0000","last_undegraded":"2024-09-21T09:11:08.747430+0000","last_fullsized":"2024-09-21T09:11:08.747430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860111+0000","last_change":"2024-09-21T09:11:04.890721+0000","last_active":"2024-09-21T09:11:07.860111+0000","last_peered":"2024-09-21T09:11:07.860111+0000","last_clean":"2024-09-21T09:11:07.860111+0000","last_became_active":"2024-09-21T09:11:04.889444+0000","last_became_peered":"2024-09-21T09:11:04.889444+0000","last_unstale":"2024-09-21T09:11:07.860111+0000","last_undegraded":"2024-09-21T09:11:07.860111+0000","last_fullsized":"2024-09-21T09:11:07.860111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:39.226968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890722+0000","last_change":"2024-09-21T09:11:06.883751+0000","last_active":"2024-09-21T09:11:07.890722+0000","last_peered":"2024-09-21T09:11:07.890722+0000","last_clean":"2024-09-21T09:11:07.890722+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:11:07.890722+0000","last_undegraded":"2024-09-21T09:11:07.890722+0000","last_fullsized":"2024-09-21T09:11:07.890722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:09.296705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918972+0000","last_change":"2024-09-21T09:10:58.838888+0000","last_active":"2024-09-21T09:11:07.918972+0000","last_peered":"2024-09-21T09:11:07.918972+0000","last_clean":"2024-09-21T09:11:07.918972+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:11:07.918972+0000","last_undegraded":"2024-09-21T09:11:07.918972+0000","last_fullsized":"2024-09-21T09:11:07.918972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:53.547541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":196,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886954+0000","last_change":"2024-09-21T09:10:44.726458+0000","last_active":"2024-09-21T09:11:07.886954+0000","last_peered":"2024-09-21T09:11:07.886954+0000","last_clean":"2024-09-21T09:11:07.886954+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:11:07.886954+0000","last_undegraded":"2024-09-21T09:11:07.886954+0000","last_fullsized":"2024-09-21T09:11:07.886954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_clean_scrub_stamp":"2024-09-21T09:10:43.702491+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:07.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917895+0000","last_change":"2024-09-21T09:10:50.784701+0000","last_active":"2024-09-21T09:11:07.917895+0000","last_peered":"2024-09-21T09:11:07.917895+0000","last_clean":"2024-09-21T09:11:07.917895+0000","last_became_active":"2024-09-21T09:10:48.763536+0000","last_became_peered":"2024-09-21T09:10:48.763536+0000","last_unstale":"2024-09-21T09:11:07.917895+0000","last_undegraded":"2024-09-21T09:11:07.917895+0000","last_fullsized":"2024-09-21T09:11:07.917895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:24.622195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878733+0000","last_change":"2024-09-21T09:10:56.830300+0000","last_active":"2024-09-21T09:11:07.878733+0000","last_peered":"2024-09-21T09:11:07.878733+0000","last_clean":"2024-09-21T09:11:07.878733+0000","last_became_active":"2024-09-21T09:10:56.829179+0000","last_became_peered":"2024-09-21T09:10:56.829179+0000","last_unstale":"2024-09-21T09:11:07.878733+0000","last_undegraded":"2024-09-21T09:11:07.878733+0000","last_fullsized":"2024-09-21T09:11:07.878733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:38.639861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861984+0000","last_change":"2024-09-21T09:11:00.845448+0000","last_active":"2024-09-21T09:11:07.861984+0000","last_peered":"2024-09-21T09:11:07.861984+0000","last_clean":"2024-09-21T09:11:07.861984+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:11:07.861984+0000","last_undegraded":"2024-09-21T09:11:07.861984+0000","last_fullsized":"2024-09-21T09:11:07.861984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"36'13","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.538084+0000","last_change":"2024-09-21T09:11:02.863275+0000","last_active":"2024-09-21T09:11:08.538084+0000","last_peered":"2024-09-21T09:11:08.538084+0000","last_clean":"2024-09-21T09:11:08.538084+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:11:08.538084+0000","last_undegraded":"2024-09-21T09:11:08.538084+0000","last_fullsized":"2024-09-21T09:11:08.538084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:39.968749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874817+0000","last_change":"2024-09-21T09:11:04.894538+0000","last_active":"2024-09-21T09:11:07.874817+0000","last_peered":"2024-09-21T09:11:07.874817+0000","last_clean":"2024-09-21T09:11:07.874817+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:11:07.874817+0000","last_undegraded":"2024-09-21T09:11:07.874817+0000","last_fullsized":"2024-09-21T09:11:07.874817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.154030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861304+0000","last_change":"2024-09-21T09:11:06.891095+0000","last_active":"2024-09-21T09:11:07.861304+0000","last_peered":"2024-09-21T09:11:07.861304+0000","last_clean":"2024-09-21T09:11:07.861304+0000","last_became_active":"2024-09-21T09:11:06.890235+0000","last_became_peered":"2024-09-21T09:11:06.890235+0000","last_unstale":"2024-09-21T09:11:07.861304+0000","last_undegraded":"2024-09-21T09:11:07.861304+0000","last_fullsized":"2024-09-21T09:11:07.861304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875154+0000","last_change":"2024-09-21T09:10:58.855489+0000","last_active":"2024-09-21T09:11:07.875154+0000","last_peered":"2024-09-21T09:11:07.875154+0000","last_clean":"2024-09-21T09:11:07.875154+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:11:07.875154+0000","last_undegraded":"2024-09-21T09:11:07.875154+0000","last_fullsized":"2024-09-21T09:11:07.875154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:04.859633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917709+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:11:07.917709+0000","last_peered":"2024-09-21T09:11:07.917709+0000","last_clean":"2024-09-21T09:11:07.917709+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:11:07.917709+0000","last_undegraded":"2024-09-21T09:11:07.917709+0000","last_fullsized":"2024-09-21T09:11:07.917709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:09.405380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860547+0000","last_change":"2024-09-21T09:10:56.862992+0000","last_active":"2024-09-21T09:11:07.860547+0000","last_peered":"2024-09-21T09:11:07.860547+0000","last_clean":"2024-09-21T09:11:07.860547+0000","last_became_active":"2024-09-21T09:10:56.862302+0000","last_became_peered":"2024-09-21T09:10:56.862302+0000","last_unstale":"2024-09-21T09:11:07.860547+0000","last_undegraded":"2024-09-21T09:11:07.860547+0000","last_fullsized":"2024-09-21T09:11:07.860547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918024+0000","last_change":"2024-09-21T09:11:00.845917+0000","last_active":"2024-09-21T09:11:07.918024+0000","last_peered":"2024-09-21T09:11:07.918024+0000","last_clean":"2024-09-21T09:11:07.918024+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:11:07.918024+0000","last_undegraded":"2024-09-21T09:11:07.918024+0000","last_fullsized":"2024-09-21T09:11:07.918024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:59.152254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'23","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.738848+0000","last_change":"2024-09-21T09:11:02.871422+0000","last_active":"2024-09-21T09:11:08.738848+0000","last_peered":"2024-09-21T09:11:08.738848+0000","last_clean":"2024-09-21T09:11:08.738848+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:11:08.738848+0000","last_undegraded":"2024-09-21T09:11:08.738848+0000","last_fullsized":"2024-09-21T09:11:08.738848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:57.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919701+0000","last_change":"2024-09-21T09:11:04.893734+0000","last_active":"2024-09-21T09:11:07.919701+0000","last_peered":"2024-09-21T09:11:07.919701+0000","last_clean":"2024-09-21T09:11:07.919701+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:11:07.919701+0000","last_undegraded":"2024-09-21T09:11:07.919701+0000","last_fullsized":"2024-09-21T09:11:07.919701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.709917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873529+0000","last_change":"2024-09-21T09:11:06.895362+0000","last_active":"2024-09-21T09:11:07.873529+0000","last_peered":"2024-09-21T09:11:07.873529+0000","last_clean":"2024-09-21T09:11:07.873529+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:11:07.873529+0000","last_undegraded":"2024-09-21T09:11:07.873529+0000","last_fullsized":"2024-09-21T09:11:07.873529+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:23.606134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862492+0000","last_change":"2024-09-21T09:10:58.831552+0000","last_active":"2024-09-21T09:11:07.862492+0000","last_peered":"2024-09-21T09:11:07.862492+0000","last_clean":"2024-09-21T09:11:07.862492+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:11:07.862492+0000","last_undegraded":"2024-09-21T09:11:07.862492+0000","last_fullsized":"2024-09-21T09:11:07.862492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890456+0000","last_change":"2024-09-21T09:10:51.587265+0000","last_active":"2024-09-21T09:11:07.890456+0000","last_peered":"2024-09-21T09:11:07.890456+0000","last_clean":"2024-09-21T09:11:07.890456+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:11:07.890456+0000","last_undegraded":"2024-09-21T09:11:07.890456+0000","last_fullsized":"2024-09-21T09:11:07.890456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872905+0000","last_change":"2024-09-21T09:10:56.866005+0000","last_active":"2024-09-21T09:11:07.872905+0000","last_peered":"2024-09-21T09:11:07.872905+0000","last_clean":"2024-09-21T09:11:07.872905+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:11:07.872905+0000","last_undegraded":"2024-09-21T09:11:07.872905+0000","last_fullsized":"2024-09-21T09:11:07.872905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891995+0000","last_change":"2024-09-21T09:11:00.850206+0000","last_active":"2024-09-21T09:11:07.891995+0000","last_peered":"2024-09-21T09:11:07.891995+0000","last_clean":"2024-09-21T09:11:07.891995+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:11:07.891995+0000","last_undegraded":"2024-09-21T09:11:07.891995+0000","last_fullsized":"2024-09-21T09:11:07.891995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:26.137691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.743648+0000","last_change":"2024-09-21T09:11:02.873117+0000","last_active":"2024-09-21T09:11:08.743648+0000","last_peered":"2024-09-21T09:11:08.743648+0000","last_clean":"2024-09-21T09:11:08.743648+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:11:08.743648+0000","last_undegraded":"2024-09-21T09:11:08.743648+0000","last_fullsized":"2024-09-21T09:11:08.743648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879516+0000","last_change":"2024-09-21T09:11:04.873369+0000","last_active":"2024-09-21T09:11:07.879516+0000","last_peered":"2024-09-21T09:11:07.879516+0000","last_clean":"2024-09-21T09:11:07.879516+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:11:07.879516+0000","last_undegraded":"2024-09-21T09:11:07.879516+0000","last_fullsized":"2024-09-21T09:11:07.879516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.868816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877621+0000","last_change":"2024-09-21T09:11:06.896298+0000","last_active":"2024-09-21T09:11:07.877621+0000","last_peered":"2024-09-21T09:11:07.877621+0000","last_clean":"2024-09-21T09:11:07.877621+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:11:07.877621+0000","last_undegraded":"2024-09-21T09:11:07.877621+0000","last_fullsized":"2024-09-21T09:11:07.877621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:42.784843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861573+0000","last_change":"2024-09-21T09:10:58.838558+0000","last_active":"2024-09-21T09:11:07.861573+0000","last_peered":"2024-09-21T09:11:07.861573+0000","last_clean":"2024-09-21T09:11:07.861573+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:11:07.861573+0000","last_undegraded":"2024-09-21T09:11:07.861573+0000","last_fullsized":"2024-09-21T09:11:07.861573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919560+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:11:07.919560+0000","last_peered":"2024-09-21T09:11:07.919560+0000","last_clean":"2024-09-21T09:11:07.919560+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:11:07.919560+0000","last_undegraded":"2024-09-21T09:11:07.919560+0000","last_fullsized":"2024-09-21T09:11:07.919560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:07.894252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862899+0000","last_change":"2024-09-21T09:10:56.860578+0000","last_active":"2024-09-21T09:11:07.862899+0000","last_peered":"2024-09-21T09:11:07.862899+0000","last_clean":"2024-09-21T09:11:07.862899+0000","last_became_active":"2024-09-21T09:10:56.859985+0000","last_became_peered":"2024-09-21T09:10:56.859985+0000","last_unstale":"2024-09-21T09:11:07.862899+0000","last_undegraded":"2024-09-21T09:11:07.862899+0000","last_fullsized":"2024-09-21T09:11:07.862899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891301+0000","last_change":"2024-09-21T09:11:00.852944+0000","last_active":"2024-09-21T09:11:07.891301+0000","last_peered":"2024-09-21T09:11:07.891301+0000","last_clean":"2024-09-21T09:11:07.891301+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:11:07.891301+0000","last_undegraded":"2024-09-21T09:11:07.891301+0000","last_fullsized":"2024-09-21T09:11:07.891301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:24.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.575963+0000","last_change":"2024-09-21T09:11:02.856485+0000","last_active":"2024-09-21T09:11:08.575963+0000","last_peered":"2024-09-21T09:11:08.575963+0000","last_clean":"2024-09-21T09:11:08.575963+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:11:08.575963+0000","last_undegraded":"2024-09-21T09:11:08.575963+0000","last_fullsized":"2024-09-21T09:11:08.575963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:05.267197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918854+0000","last_change":"2024-09-21T09:11:04.880602+0000","last_active":"2024-09-21T09:11:07.918854+0000","last_peered":"2024-09-21T09:11:07.918854+0000","last_clean":"2024-09-21T09:11:07.918854+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:11:07.918854+0000","last_undegraded":"2024-09-21T09:11:07.918854+0000","last_fullsized":"2024-09-21T09:11:07.918854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:56.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885116+0000","last_change":"2024-09-21T09:11:06.869065+0000","last_active":"2024-09-21T09:11:07.885116+0000","last_peered":"2024-09-21T09:11:07.885116+0000","last_clean":"2024-09-21T09:11:07.885116+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:11:07.885116+0000","last_undegraded":"2024-09-21T09:11:07.885116+0000","last_fullsized":"2024-09-21T09:11:07.885116+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:28.667296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860321+0000","last_change":"2024-09-21T09:10:58.846835+0000","last_active":"2024-09-21T09:11:07.860321+0000","last_peered":"2024-09-21T09:11:07.860321+0000","last_clean":"2024-09-21T09:11:07.860321+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:11:07.860321+0000","last_undegraded":"2024-09-21T09:11:07.860321+0000","last_fullsized":"2024-09-21T09:11:07.860321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861214+0000","last_change":"2024-09-21T09:10:56.858275+0000","last_active":"2024-09-21T09:11:07.861214+0000","last_peered":"2024-09-21T09:11:07.861214+0000","last_clean":"2024-09-21T09:11:07.861214+0000","last_became_active":"2024-09-21T09:10:56.851223+0000","last_became_peered":"2024-09-21T09:10:56.851223+0000","last_unstale":"2024-09-21T09:11:07.861214+0000","last_undegraded":"2024-09-21T09:11:07.861214+0000","last_fullsized":"2024-09-21T09:11:07.861214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874368+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:11:07.874368+0000","last_peered":"2024-09-21T09:11:07.874368+0000","last_clean":"2024-09-21T09:11:07.874368+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:11:07.874368+0000","last_undegraded":"2024-09-21T09:11:07.874368+0000","last_fullsized":"2024-09-21T09:11:07.874368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878504+0000","last_change":"2024-09-21T09:11:00.855241+0000","last_active":"2024-09-21T09:11:07.878504+0000","last_peered":"2024-09-21T09:11:07.878504+0000","last_clean":"2024-09-21T09:11:07.878504+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:11:07.878504+0000","last_undegraded":"2024-09-21T09:11:07.878504+0000","last_fullsized":"2024-09-21T09:11:07.878504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:56:14.401301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"36'18","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.669526+0000","last_change":"2024-09-21T09:11:02.864623+0000","last_active":"2024-09-21T09:11:08.669526+0000","last_peered":"2024-09-21T09:11:08.669526+0000","last_clean":"2024-09-21T09:11:08.669526+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:11:08.669526+0000","last_undegraded":"2024-09-21T09:11:08.669526+0000","last_fullsized":"2024-09-21T09:11:08.669526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:12.141735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857779+0000","last_change":"2024-09-21T09:11:04.890355+0000","last_active":"2024-09-21T09:11:07.857779+0000","last_peered":"2024-09-21T09:11:07.857779+0000","last_clean":"2024-09-21T09:11:07.857779+0000","last_became_active":"2024-09-21T09:11:04.889578+0000","last_became_peered":"2024-09-21T09:11:04.889578+0000","last_unstale":"2024-09-21T09:11:07.857779+0000","last_undegraded":"2024-09-21T09:11:07.857779+0000","last_fullsized":"2024-09-21T09:11:07.857779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:54.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874804+0000","last_change":"2024-09-21T09:11:06.896833+0000","last_active":"2024-09-21T09:11:07.874804+0000","last_peered":"2024-09-21T09:11:07.874804+0000","last_clean":"2024-09-21T09:11:07.874804+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:11:07.874804+0000","last_undegraded":"2024-09-21T09:11:07.874804+0000","last_fullsized":"2024-09-21T09:11:07.874804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:38.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860990+0000","last_change":"2024-09-21T09:10:58.825808+0000","last_active":"2024-09-21T09:11:07.860990+0000","last_peered":"2024-09-21T09:11:07.860990+0000","last_clean":"2024-09-21T09:11:07.860990+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:11:07.860990+0000","last_undegraded":"2024-09-21T09:11:07.860990+0000","last_fullsized":"2024-09-21T09:11:07.860990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861807+0000","last_change":"2024-09-21T09:10:56.851643+0000","last_active":"2024-09-21T09:11:07.861807+0000","last_peered":"2024-09-21T09:11:07.861807+0000","last_clean":"2024-09-21T09:11:07.861807+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:11:07.861807+0000","last_undegraded":"2024-09-21T09:11:07.861807+0000","last_fullsized":"2024-09-21T09:11:07.861807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918406+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:11:07.918406+0000","last_peered":"2024-09-21T09:11:07.918406+0000","last_clean":"2024-09-21T09:11:07.918406+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:11:07.918406+0000","last_undegraded":"2024-09-21T09:11:07.918406+0000","last_fullsized":"2024-09-21T09:11:07.918406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:24.356684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860285+0000","last_change":"2024-09-21T09:11:00.847115+0000","last_active":"2024-09-21T09:11:07.860285+0000","last_peered":"2024-09-21T09:11:07.860285+0000","last_clean":"2024-09-21T09:11:07.860285+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:11:07.860285+0000","last_undegraded":"2024-09-21T09:11:07.860285+0000","last_fullsized":"2024-09-21T09:11:07.860285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:55.012417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.771506+0000","last_change":"2024-09-21T09:11:02.862921+0000","last_active":"2024-09-21T09:11:08.771506+0000","last_peered":"2024-09-21T09:11:08.771506+0000","last_clean":"2024-09-21T09:11:08.771506+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:11:08.771506+0000","last_undegraded":"2024-09-21T09:11:08.771506+0000","last_fullsized":"2024-09-21T09:11:08.771506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885282+0000","last_change":"2024-09-21T09:11:04.894220+0000","last_active":"2024-09-21T09:11:07.885282+0000","last_peered":"2024-09-21T09:11:07.885282+0000","last_clean":"2024-09-21T09:11:07.885282+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:11:07.885282+0000","last_undegraded":"2024-09-21T09:11:07.885282+0000","last_fullsized":"2024-09-21T09:11:07.885282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:07.285264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892057+0000","last_change":"2024-09-21T09:11:06.881113+0000","last_active":"2024-09-21T09:11:07.892057+0000","last_peered":"2024-09-21T09:11:07.892057+0000","last_clean":"2024-09-21T09:11:07.892057+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:11:07.892057+0000","last_undegraded":"2024-09-21T09:11:07.892057+0000","last_fullsized":"2024-09-21T09:11:07.892057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877629+0000","last_change":"2024-09-21T09:10:58.868894+0000","last_active":"2024-09-21T09:11:07.877629+0000","last_peered":"2024-09-21T09:11:07.877629+0000","last_clean":"2024-09-21T09:11:07.877629+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:11:07.877629+0000","last_undegraded":"2024-09-21T09:11:07.877629+0000","last_fullsized":"2024-09-21T09:11:07.877629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:41.448227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880607+0000","last_change":"2024-09-21T09:10:56.853201+0000","last_active":"2024-09-21T09:11:07.880607+0000","last_peered":"2024-09-21T09:11:07.880607+0000","last_clean":"2024-09-21T09:11:07.880607+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:11:07.880607+0000","last_undegraded":"2024-09-21T09:11:07.880607+0000","last_fullsized":"2024-09-21T09:11:07.880607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:58.587669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880094+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:11:07.880094+0000","last_peered":"2024-09-21T09:11:07.880094+0000","last_clean":"2024-09-21T09:11:07.880094+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:11:07.880094+0000","last_undegraded":"2024-09-21T09:11:07.880094+0000","last_fullsized":"2024-09-21T09:11:07.880094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:03.383843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917409+0000","last_change":"2024-09-21T09:11:00.850095+0000","last_active":"2024-09-21T09:11:07.917409+0000","last_peered":"2024-09-21T09:11:07.917409+0000","last_clean":"2024-09-21T09:11:07.917409+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:11:07.917409+0000","last_undegraded":"2024-09-21T09:11:07.917409+0000","last_fullsized":"2024-09-21T09:11:07.917409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:17.456402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.726686+0000","last_change":"2024-09-21T09:11:02.853229+0000","last_active":"2024-09-21T09:11:08.726686+0000","last_peered":"2024-09-21T09:11:08.726686+0000","last_clean":"2024-09-21T09:11:08.726686+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:11:08.726686+0000","last_undegraded":"2024-09-21T09:11:08.726686+0000","last_fullsized":"2024-09-21T09:11:08.726686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:25.468451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874251+0000","last_change":"2024-09-21T09:11:04.891312+0000","last_active":"2024-09-21T09:11:07.874251+0000","last_peered":"2024-09-21T09:11:07.874251+0000","last_clean":"2024-09-21T09:11:07.874251+0000","last_became_active":"2024-09-21T09:11:04.890437+0000","last_became_peered":"2024-09-21T09:11:04.890437+0000","last_unstale":"2024-09-21T09:11:07.874251+0000","last_undegraded":"2024-09-21T09:11:07.874251+0000","last_fullsized":"2024-09-21T09:11:07.874251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:50.682223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873290+0000","last_change":"2024-09-21T09:11:06.887900+0000","last_active":"2024-09-21T09:11:07.873290+0000","last_peered":"2024-09-21T09:11:07.873290+0000","last_clean":"2024-09-21T09:11:07.873290+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:11:07.873290+0000","last_undegraded":"2024-09-21T09:11:07.873290+0000","last_fullsized":"2024-09-21T09:11:07.873290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:03.433485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859715+0000","last_change":"2024-09-21T09:10:58.837150+0000","last_active":"2024-09-21T09:11:07.859715+0000","last_peered":"2024-09-21T09:11:07.859715+0000","last_clean":"2024-09-21T09:11:07.859715+0000","last_became_active":"2024-09-21T09:10:58.836859+0000","last_became_peered":"2024-09-21T09:10:58.836859+0000","last_unstale":"2024-09-21T09:11:07.859715+0000","last_undegraded":"2024-09-21T09:11:07.859715+0000","last_fullsized":"2024-09-21T09:11:07.859715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879824+0000","last_change":"2024-09-21T09:10:56.849803+0000","last_active":"2024-09-21T09:11:07.879824+0000","last_peered":"2024-09-21T09:11:07.879824+0000","last_clean":"2024-09-21T09:11:07.879824+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:11:07.879824+0000","last_undegraded":"2024-09-21T09:11:07.879824+0000","last_fullsized":"2024-09-21T09:11:07.879824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:47.709157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919337+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:11:07.919337+0000","last_peered":"2024-09-21T09:11:07.919337+0000","last_clean":"2024-09-21T09:11:07.919337+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:11:07.919337+0000","last_undegraded":"2024-09-21T09:11:07.919337+0000","last_fullsized":"2024-09-21T09:11:07.919337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:33.465317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.876823+0000","last_change":"2024-09-21T09:11:00.831510+0000","last_active":"2024-09-21T09:11:07.876823+0000","last_peered":"2024-09-21T09:11:07.876823+0000","last_clean":"2024-09-21T09:11:07.876823+0000","last_became_active":"2024-09-21T09:11:00.830738+0000","last_became_peered":"2024-09-21T09:11:00.830738+0000","last_unstale":"2024-09-21T09:11:07.876823+0000","last_undegraded":"2024-09-21T09:11:07.876823+0000","last_fullsized":"2024-09-21T09:11:07.876823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:13.485361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"36'19","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.704439+0000","last_change":"2024-09-21T09:11:02.856720+0000","last_active":"2024-09-21T09:11:08.704439+0000","last_peered":"2024-09-21T09:11:08.704439+0000","last_clean":"2024-09-21T09:11:08.704439+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:11:08.704439+0000","last_undegraded":"2024-09-21T09:11:08.704439+0000","last_fullsized":"2024-09-21T09:11:08.704439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878168+0000","last_change":"2024-09-21T09:11:04.872979+0000","last_active":"2024-09-21T09:11:07.878168+0000","last_peered":"2024-09-21T09:11:07.878168+0000","last_clean":"2024-09-21T09:11:07.878168+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:11:07.878168+0000","last_undegraded":"2024-09-21T09:11:07.878168+0000","last_fullsized":"2024-09-21T09:11:07.878168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:17.499450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861042+0000","last_change":"2024-09-21T09:11:06.889672+0000","last_active":"2024-09-21T09:11:07.861042+0000","last_peered":"2024-09-21T09:11:07.861042+0000","last_clean":"2024-09-21T09:11:07.861042+0000","last_became_active":"2024-09-21T09:11:06.888516+0000","last_became_peered":"2024-09-21T09:11:06.888516+0000","last_unstale":"2024-09-21T09:11:07.861042+0000","last_undegraded":"2024-09-21T09:11:07.861042+0000","last_fullsized":"2024-09-21T09:11:07.861042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880284+0000","last_change":"2024-09-21T09:11:06.900571+0000","last_active":"2024-09-21T09:11:07.880284+0000","last_peered":"2024-09-21T09:11:07.880284+0000","last_clean":"2024-09-21T09:11:07.880284+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:11:07.880284+0000","last_undegraded":"2024-09-21T09:11:07.880284+0000","last_fullsized":"2024-09-21T09:11:07.880284+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:40.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859795+0000","last_change":"2024-09-21T09:10:58.841597+0000","last_active":"2024-09-21T09:11:07.859795+0000","last_peered":"2024-09-21T09:11:07.859795+0000","last_clean":"2024-09-21T09:11:07.859795+0000","last_became_active":"2024-09-21T09:10:58.839814+0000","last_became_peered":"2024-09-21T09:10:58.839814+0000","last_unstale":"2024-09-21T09:11:07.859795+0000","last_undegraded":"2024-09-21T09:11:07.859795+0000","last_fullsized":"2024-09-21T09:11:07.859795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919902+0000","last_change":"2024-09-21T09:10:56.867413+0000","last_active":"2024-09-21T09:11:07.919902+0000","last_peered":"2024-09-21T09:11:07.919902+0000","last_clean":"2024-09-21T09:11:07.919902+0000","last_became_active":"2024-09-21T09:10:56.867019+0000","last_became_peered":"2024-09-21T09:10:56.867019+0000","last_unstale":"2024-09-21T09:11:07.919902+0000","last_undegraded":"2024-09-21T09:11:07.919902+0000","last_fullsized":"2024-09-21T09:11:07.919902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:06.120617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860398+0000","last_change":"2024-09-21T09:11:00.839217+0000","last_active":"2024-09-21T09:11:07.860398+0000","last_peered":"2024-09-21T09:11:07.860398+0000","last_clean":"2024-09-21T09:11:07.860398+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:11:07.860398+0000","last_undegraded":"2024-09-21T09:11:07.860398+0000","last_fullsized":"2024-09-21T09:11:07.860398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:23.833810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"36'11","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.778784+0000","last_change":"2024-09-21T09:11:02.872614+0000","last_active":"2024-09-21T09:11:08.778784+0000","last_peered":"2024-09-21T09:11:08.778784+0000","last_clean":"2024-09-21T09:11:08.778784+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:11:08.778784+0000","last_undegraded":"2024-09-21T09:11:08.778784+0000","last_fullsized":"2024-09-21T09:11:08.778784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.889951+0000","last_change":"2024-09-21T09:11:04.882308+0000","last_active":"2024-09-21T09:11:07.889951+0000","last_peered":"2024-09-21T09:11:07.889951+0000","last_clean":"2024-09-21T09:11:07.889951+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:11:07.889951+0000","last_undegraded":"2024-09-21T09:11:07.889951+0000","last_fullsized":"2024-09-21T09:11:07.889951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:42.301147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891604+0000","last_change":"2024-09-21T09:11:06.892382+0000","last_active":"2024-09-21T09:11:07.891604+0000","last_peered":"2024-09-21T09:11:07.891604+0000","last_clean":"2024-09-21T09:11:07.891604+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:11:07.891604+0000","last_undegraded":"2024-09-21T09:11:07.891604+0000","last_fullsized":"2024-09-21T09:11:07.891604+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:20.449346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877889+0000","last_change":"2024-09-21T09:10:58.869150+0000","last_active":"2024-09-21T09:11:07.877889+0000","last_peered":"2024-09-21T09:11:07.877889+0000","last_clean":"2024-09-21T09:11:07.877889+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:11:07.877889+0000","last_undegraded":"2024-09-21T09:11:07.877889+0000","last_fullsized":"2024-09-21T09:11:07.877889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:58.386210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863932+0000","last_change":"2024-09-21T09:10:56.854764+0000","last_active":"2024-09-21T09:11:07.863932+0000","last_peered":"2024-09-21T09:11:07.863932+0000","last_clean":"2024-09-21T09:11:07.863932+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:11:07.863932+0000","last_undegraded":"2024-09-21T09:11:07.863932+0000","last_fullsized":"2024-09-21T09:11:07.863932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878033+0000","last_change":"2024-09-21T09:11:00.839265+0000","last_active":"2024-09-21T09:11:07.878033+0000","last_peered":"2024-09-21T09:11:07.878033+0000","last_clean":"2024-09-21T09:11:07.878033+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:11:07.878033+0000","last_undegraded":"2024-09-21T09:11:07.878033+0000","last_fullsized":"2024-09-21T09:11:07.878033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:14.524942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"36'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.228135+0000","last_change":"2024-09-21T09:11:02.859426+0000","last_active":"2024-09-21T09:11:08.228135+0000","last_peered":"2024-09-21T09:11:08.228135+0000","last_clean":"2024-09-21T09:11:08.228135+0000","last_became_active":"2024-09-21T09:11:02.858690+0000","last_became_peered":"2024-09-21T09:11:02.858690+0000","last_unstale":"2024-09-21T09:11:08.228135+0000","last_undegraded":"2024-09-21T09:11:08.228135+0000","last_fullsized":"2024-09-21T09:11:08.228135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:07.586879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857744+0000","last_change":"2024-09-21T09:11:04.860220+0000","last_active":"2024-09-21T09:11:07.857744+0000","last_peered":"2024-09-21T09:11:07.857744+0000","last_clean":"2024-09-21T09:11:07.857744+0000","last_became_active":"2024-09-21T09:11:04.859440+0000","last_became_peered":"2024-09-21T09:11:04.859440+0000","last_unstale":"2024-09-21T09:11:07.857744+0000","last_undegraded":"2024-09-21T09:11:07.857744+0000","last_fullsized":"2024-09-21T09:11:07.857744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:58.916787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861022+0000","last_change":"2024-09-21T09:11:06.879042+0000","last_active":"2024-09-21T09:11:07.861022+0000","last_peered":"2024-09-21T09:11:07.861022+0000","last_clean":"2024-09-21T09:11:07.861022+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:11:07.861022+0000","last_undegraded":"2024-09-21T09:11:07.861022+0000","last_fullsized":"2024-09-21T09:11:07.861022+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:34.670949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877376+0000","last_change":"2024-09-21T09:10:58.864481+0000","last_active":"2024-09-21T09:11:07.877376+0000","last_peered":"2024-09-21T09:11:07.877376+0000","last_clean":"2024-09-21T09:11:07.877376+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:11:07.877376+0000","last_undegraded":"2024-09-21T09:11:07.877376+0000","last_fullsized":"2024-09-21T09:11:07.877376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:33.405020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862086+0000","last_change":"2024-09-21T09:10:56.858748+0000","last_active":"2024-09-21T09:11:07.862086+0000","last_peered":"2024-09-21T09:11:07.862086+0000","last_clean":"2024-09-21T09:11:07.862086+0000","last_became_active":"2024-09-21T09:10:56.858102+0000","last_became_peered":"2024-09-21T09:10:56.858102+0000","last_unstale":"2024-09-21T09:11:07.862086+0000","last_undegraded":"2024-09-21T09:11:07.862086+0000","last_fullsized":"2024-09-21T09:11:07.862086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857279+0000","last_change":"2024-09-21T09:11:00.839191+0000","last_active":"2024-09-21T09:11:07.857279+0000","last_peered":"2024-09-21T09:11:07.857279+0000","last_clean":"2024-09-21T09:11:07.857279+0000","last_became_active":"2024-09-21T09:11:00.838002+0000","last_became_peered":"2024-09-21T09:11:00.838002+0000","last_unstale":"2024-09-21T09:11:07.857279+0000","last_undegraded":"2024-09-21T09:11:07.857279+0000","last_fullsized":"2024-09-21T09:11:07.857279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:23.833810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'11","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.684011+0000","last_change":"2024-09-21T09:11:02.869796+0000","last_active":"2024-09-21T09:11:08.684011+0000","last_peered":"2024-09-21T09:11:08.684011+0000","last_clean":"2024-09-21T09:11:08.684011+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:11:08.684011+0000","last_undegraded":"2024-09-21T09:11:08.684011+0000","last_fullsized":"2024-09-21T09:11:08.684011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:48.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885370+0000","last_change":"2024-09-21T09:11:04.893727+0000","last_active":"2024-09-21T09:11:07.885370+0000","last_peered":"2024-09-21T09:11:07.885370+0000","last_clean":"2024-09-21T09:11:07.885370+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:11:07.885370+0000","last_undegraded":"2024-09-21T09:11:07.885370+0000","last_fullsized":"2024-09-21T09:11:07.885370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:18.437905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919617+0000","last_change":"2024-09-21T09:11:06.893750+0000","last_active":"2024-09-21T09:11:07.919617+0000","last_peered":"2024-09-21T09:11:07.919617+0000","last_clean":"2024-09-21T09:11:07.919617+0000","last_became_active":"2024-09-21T09:11:06.892766+0000","last_became_peered":"2024-09-21T09:11:06.892766+0000","last_unstale":"2024-09-21T09:11:07.919617+0000","last_undegraded":"2024-09-21T09:11:07.919617+0000","last_fullsized":"2024-09-21T09:11:07.919617+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:03.695046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890242+0000","last_change":"2024-09-21T09:10:58.859005+0000","last_active":"2024-09-21T09:11:07.890242+0000","last_peered":"2024-09-21T09:11:07.890242+0000","last_clean":"2024-09-21T09:11:07.890242+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:11:07.890242+0000","last_undegraded":"2024-09-21T09:11:07.890242+0000","last_fullsized":"2024-09-21T09:11:07.890242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:38.110596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875879+0000","last_change":"2024-09-21T09:10:56.860416+0000","last_active":"2024-09-21T09:11:07.875879+0000","last_peered":"2024-09-21T09:11:07.875879+0000","last_clean":"2024-09-21T09:11:07.875879+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:11:07.875879+0000","last_undegraded":"2024-09-21T09:11:07.875879+0000","last_fullsized":"2024-09-21T09:11:07.875879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:48.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917007+0000","last_change":"2024-09-21T09:11:00.842215+0000","last_active":"2024-09-21T09:11:07.917007+0000","last_peered":"2024-09-21T09:11:07.917007+0000","last_clean":"2024-09-21T09:11:07.917007+0000","last_became_active":"2024-09-21T09:11:00.841367+0000","last_became_peered":"2024-09-21T09:11:00.841367+0000","last_unstale":"2024-09-21T09:11:07.917007+0000","last_undegraded":"2024-09-21T09:11:07.917007+0000","last_fullsized":"2024-09-21T09:11:07.917007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:46.657240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.452217+0000","last_change":"2024-09-21T09:11:02.872950+0000","last_active":"2024-09-21T09:11:08.452217+0000","last_peered":"2024-09-21T09:11:08.452217+0000","last_clean":"2024-09-21T09:11:08.452217+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:11:08.452217+0000","last_undegraded":"2024-09-21T09:11:08.452217+0000","last_fullsized":"2024-09-21T09:11:08.452217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891000+0000","last_change":"2024-09-21T09:11:04.885912+0000","last_active":"2024-09-21T09:11:07.891000+0000","last_peered":"2024-09-21T09:11:07.891000+0000","last_clean":"2024-09-21T09:11:07.891000+0000","last_became_active":"2024-09-21T09:11:04.884734+0000","last_became_peered":"2024-09-21T09:11:04.884734+0000","last_unstale":"2024-09-21T09:11:07.891000+0000","last_undegraded":"2024-09-21T09:11:07.891000+0000","last_fullsized":"2024-09-21T09:11:07.891000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:58.916787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918477+0000","last_change":"2024-09-21T09:10:58.839092+0000","last_active":"2024-09-21T09:11:07.918477+0000","last_peered":"2024-09-21T09:11:07.918477+0000","last_clean":"2024-09-21T09:11:07.918477+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:11:07.918477+0000","last_undegraded":"2024-09-21T09:11:07.918477+0000","last_fullsized":"2024-09-21T09:11:07.918477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:02.458655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873603+0000","last_change":"2024-09-21T09:10:56.865435+0000","last_active":"2024-09-21T09:11:07.873603+0000","last_peered":"2024-09-21T09:11:07.873603+0000","last_clean":"2024-09-21T09:11:07.873603+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:11:07.873603+0000","last_undegraded":"2024-09-21T09:11:07.873603+0000","last_fullsized":"2024-09-21T09:11:07.873603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861885+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:11:07.861885+0000","last_peered":"2024-09-21T09:11:07.861885+0000","last_clean":"2024-09-21T09:11:07.861885+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:11:07.861885+0000","last_undegraded":"2024-09-21T09:11:07.861885+0000","last_fullsized":"2024-09-21T09:11:07.861885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:10.134818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"36'12","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.807408+0000","last_change":"2024-09-21T09:11:02.879895+0000","last_active":"2024-09-21T09:11:08.807408+0000","last_peered":"2024-09-21T09:11:08.807408+0000","last_clean":"2024-09-21T09:11:08.807408+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:11:08.807408+0000","last_undegraded":"2024-09-21T09:11:08.807408+0000","last_fullsized":"2024-09-21T09:11:08.807408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.858700+0000","last_change":"2024-09-21T09:11:04.859761+0000","last_active":"2024-09-21T09:11:07.858700+0000","last_peered":"2024-09-21T09:11:07.858700+0000","last_clean":"2024-09-21T09:11:07.858700+0000","last_became_active":"2024-09-21T09:11:04.859053+0000","last_became_peered":"2024-09-21T09:11:04.859053+0000","last_unstale":"2024-09-21T09:11:07.858700+0000","last_undegraded":"2024-09-21T09:11:07.858700+0000","last_fullsized":"2024-09-21T09:11:07.858700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:52.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873124+0000","last_change":"2024-09-21T09:11:06.896002+0000","last_active":"2024-09-21T09:11:07.873124+0000","last_peered":"2024-09-21T09:11:07.873124+0000","last_clean":"2024-09-21T09:11:07.873124+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:11:07.873124+0000","last_undegraded":"2024-09-21T09:11:07.873124+0000","last_fullsized":"2024-09-21T09:11:07.873124+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:01.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879756+0000","last_change":"2024-09-21T09:10:58.868892+0000","last_active":"2024-09-21T09:11:07.879756+0000","last_peered":"2024-09-21T09:11:07.879756+0000","last_clean":"2024-09-21T09:11:07.879756+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:11:07.879756+0000","last_undegraded":"2024-09-21T09:11:07.879756+0000","last_fullsized":"2024-09-21T09:11:07.879756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877837+0000","last_change":"2024-09-21T09:10:56.827351+0000","last_active":"2024-09-21T09:11:07.877837+0000","last_peered":"2024-09-21T09:11:07.877837+0000","last_clean":"2024-09-21T09:11:07.877837+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:11:07.877837+0000","last_undegraded":"2024-09-21T09:11:07.877837+0000","last_fullsized":"2024-09-21T09:11:07.877837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:49.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860750+0000","last_change":"2024-09-21T09:11:00.845324+0000","last_active":"2024-09-21T09:11:07.860750+0000","last_peered":"2024-09-21T09:11:07.860750+0000","last_clean":"2024-09-21T09:11:07.860750+0000","last_became_active":"2024-09-21T09:11:00.844506+0000","last_became_peered":"2024-09-21T09:11:00.844506+0000","last_unstale":"2024-09-21T09:11:07.860750+0000","last_undegraded":"2024-09-21T09:11:07.860750+0000","last_fullsized":"2024-09-21T09:11:07.860750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'15","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.581042+0000","last_change":"2024-09-21T09:11:02.862497+0000","last_active":"2024-09-21T09:11:08.581042+0000","last_peered":"2024-09-21T09:11:08.581042+0000","last_clean":"2024-09-21T09:11:08.581042+0000","last_became_active":"2024-09-21T09:11:02.861320+0000","last_became_peered":"2024-09-21T09:11:02.861320+0000","last_unstale":"2024-09-21T09:11:08.581042+0000","last_undegraded":"2024-09-21T09:11:08.581042+0000","last_fullsized":"2024-09-21T09:11:08.581042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:34.798519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873292+0000","last_change":"2024-09-21T09:11:04.890782+0000","last_active":"2024-09-21T09:11:07.873292+0000","last_peered":"2024-09-21T09:11:07.873292+0000","last_clean":"2024-09-21T09:11:07.873292+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:11:07.873292+0000","last_undegraded":"2024-09-21T09:11:07.873292+0000","last_fullsized":"2024-09-21T09:11:07.873292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:42.740558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919148+0000","last_change":"2024-09-21T09:11:06.889510+0000","last_active":"2024-09-21T09:11:07.919148+0000","last_peered":"2024-09-21T09:11:07.919148+0000","last_clean":"2024-09-21T09:11:07.919148+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:11:07.919148+0000","last_undegraded":"2024-09-21T09:11:07.919148+0000","last_fullsized":"2024-09-21T09:11:07.919148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:38.377418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891501+0000","last_change":"2024-09-21T09:10:58.854750+0000","last_active":"2024-09-21T09:11:07.891501+0000","last_peered":"2024-09-21T09:11:07.891501+0000","last_clean":"2024-09-21T09:11:07.891501+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:11:07.891501+0000","last_undegraded":"2024-09-21T09:11:07.891501+0000","last_fullsized":"2024-09-21T09:11:07.891501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.559151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887566+0000","last_change":"2024-09-21T09:10:56.863198+0000","last_active":"2024-09-21T09:11:07.887566+0000","last_peered":"2024-09-21T09:11:07.887566+0000","last_clean":"2024-09-21T09:11:07.887566+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:11:07.887566+0000","last_undegraded":"2024-09-21T09:11:07.887566+0000","last_fullsized":"2024-09-21T09:11:07.887566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859624+0000","last_change":"2024-09-21T09:11:00.828423+0000","last_active":"2024-09-21T09:11:07.859624+0000","last_peered":"2024-09-21T09:11:07.859624+0000","last_clean":"2024-09-21T09:11:07.859624+0000","last_became_active":"2024-09-21T09:11:00.827935+0000","last_became_peered":"2024-09-21T09:11:00.827935+0000","last_unstale":"2024-09-21T09:11:07.859624+0000","last_undegraded":"2024-09-21T09:11:07.859624+0000","last_fullsized":"2024-09-21T09:11:07.859624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:55.012417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'11","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.785929+0000","last_change":"2024-09-21T09:11:02.879188+0000","last_active":"2024-09-21T09:11:08.785929+0000","last_peered":"2024-09-21T09:11:08.785929+0000","last_clean":"2024-09-21T09:11:08.785929+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:11:08.785929+0000","last_undegraded":"2024-09-21T09:11:08.785929+0000","last_fullsized":"2024-09-21T09:11:08.785929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:37.208901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891442+0000","last_change":"2024-09-21T09:11:04.880786+0000","last_active":"2024-09-21T09:11:07.891442+0000","last_peered":"2024-09-21T09:11:07.891442+0000","last_clean":"2024-09-21T09:11:07.891442+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:11:07.891442+0000","last_undegraded":"2024-09-21T09:11:07.891442+0000","last_fullsized":"2024-09-21T09:11:07.891442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:54.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917010+0000","last_change":"2024-09-21T09:11:06.898517+0000","last_active":"2024-09-21T09:11:07.917010+0000","last_peered":"2024-09-21T09:11:07.917010+0000","last_clean":"2024-09-21T09:11:07.917010+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:11:07.917010+0000","last_undegraded":"2024-09-21T09:11:07.917010+0000","last_fullsized":"2024-09-21T09:11:07.917010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:46.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880449+0000","last_change":"2024-09-21T09:10:58.868807+0000","last_active":"2024-09-21T09:11:07.880449+0000","last_peered":"2024-09-21T09:11:07.880449+0000","last_clean":"2024-09-21T09:11:07.880449+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:11:07.880449+0000","last_undegraded":"2024-09-21T09:11:07.880449+0000","last_fullsized":"2024-09-21T09:11:07.880449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.574650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880065+0000","last_change":"2024-09-21T09:10:56.851205+0000","last_active":"2024-09-21T09:11:07.880065+0000","last_peered":"2024-09-21T09:11:07.880065+0000","last_clean":"2024-09-21T09:11:07.880065+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:11:07.880065+0000","last_undegraded":"2024-09-21T09:11:07.880065+0000","last_fullsized":"2024-09-21T09:11:07.880065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:52.423650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878444+0000","last_change":"2024-09-21T09:11:00.856830+0000","last_active":"2024-09-21T09:11:07.878444+0000","last_peered":"2024-09-21T09:11:07.878444+0000","last_clean":"2024-09-21T09:11:07.878444+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:11:07.878444+0000","last_undegraded":"2024-09-21T09:11:07.878444+0000","last_fullsized":"2024-09-21T09:11:07.878444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:45.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"36'10","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.762664+0000","last_change":"2024-09-21T09:11:02.865472+0000","last_active":"2024-09-21T09:11:08.762664+0000","last_peered":"2024-09-21T09:11:08.762664+0000","last_clean":"2024-09-21T09:11:08.762664+0000","last_became_active":"2024-09-21T09:11:02.864646+0000","last_became_peered":"2024-09-21T09:11:02.864646+0000","last_unstale":"2024-09-21T09:11:08.762664+0000","last_undegraded":"2024-09-21T09:11:08.762664+0000","last_fullsized":"2024-09-21T09:11:08.762664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:13.507947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.864442+0000","last_change":"2024-09-21T09:11:04.870463+0000","last_active":"2024-09-21T09:11:07.864442+0000","last_peered":"2024-09-21T09:11:07.864442+0000","last_clean":"2024-09-21T09:11:07.864442+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:11:07.864442+0000","last_undegraded":"2024-09-21T09:11:07.864442+0000","last_fullsized":"2024-09-21T09:11:07.864442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:30.495090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.916758+0000","last_change":"2024-09-21T09:11:06.883550+0000","last_active":"2024-09-21T09:11:07.916758+0000","last_peered":"2024-09-21T09:11:07.916758+0000","last_clean":"2024-09-21T09:11:07.916758+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:11:07.916758+0000","last_undegraded":"2024-09-21T09:11:07.916758+0000","last_fullsized":"2024-09-21T09:11:07.916758+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:56.825424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859567+0000","last_change":"2024-09-21T09:10:58.845744+0000","last_active":"2024-09-21T09:11:07.859567+0000","last_peered":"2024-09-21T09:11:07.859567+0000","last_clean":"2024-09-21T09:11:07.859567+0000","last_became_active":"2024-09-21T09:10:58.845470+0000","last_became_peered":"2024-09-21T09:10:58.845470+0000","last_unstale":"2024-09-21T09:11:07.859567+0000","last_undegraded":"2024-09-21T09:11:07.859567+0000","last_fullsized":"2024-09-21T09:11:07.859567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886470+0000","last_change":"2024-09-21T09:10:56.852586+0000","last_active":"2024-09-21T09:11:07.886470+0000","last_peered":"2024-09-21T09:11:07.886470+0000","last_clean":"2024-09-21T09:11:07.886470+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:11:07.886470+0000","last_undegraded":"2024-09-21T09:11:07.886470+0000","last_fullsized":"2024-09-21T09:11:07.886470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887122+0000","last_change":"2024-09-21T09:11:00.839800+0000","last_active":"2024-09-21T09:11:07.887122+0000","last_peered":"2024-09-21T09:11:07.887122+0000","last_clean":"2024-09-21T09:11:07.887122+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:11:07.887122+0000","last_undegraded":"2024-09-21T09:11:07.887122+0000","last_fullsized":"2024-09-21T09:11:07.887122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:21.140377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'15","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.797908+0000","last_change":"2024-09-21T09:11:02.857087+0000","last_active":"2024-09-21T09:11:08.797908+0000","last_peered":"2024-09-21T09:11:08.797908+0000","last_clean":"2024-09-21T09:11:08.797908+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:11:08.797908+0000","last_undegraded":"2024-09-21T09:11:08.797908+0000","last_fullsized":"2024-09-21T09:11:08.797908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.876808+0000","last_change":"2024-09-21T09:11:04.872303+0000","last_active":"2024-09-21T09:11:07.876808+0000","last_peered":"2024-09-21T09:11:07.876808+0000","last_clean":"2024-09-21T09:11:07.876808+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:11:07.876808+0000","last_undegraded":"2024-09-21T09:11:07.876808+0000","last_fullsized":"2024-09-21T09:11:07.876808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.517451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886999+0000","last_change":"2024-09-21T09:11:06.873636+0000","last_active":"2024-09-21T09:11:07.886999+0000","last_peered":"2024-09-21T09:11:07.886999+0000","last_clean":"2024-09-21T09:11:07.886999+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:11:07.886999+0000","last_undegraded":"2024-09-21T09:11:07.886999+0000","last_fullsized":"2024-09-21T09:11:07.886999+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:52.693664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857854+0000","last_change":"2024-09-21T09:10:58.835902+0000","last_active":"2024-09-21T09:11:07.857854+0000","last_peered":"2024-09-21T09:11:07.857854+0000","last_clean":"2024-09-21T09:11:07.857854+0000","last_became_active":"2024-09-21T09:10:58.835559+0000","last_became_peered":"2024-09-21T09:10:58.835559+0000","last_unstale":"2024-09-21T09:11:07.857854+0000","last_undegraded":"2024-09-21T09:11:07.857854+0000","last_fullsized":"2024-09-21T09:11:07.857854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919054+0000","last_change":"2024-09-21T09:10:56.856625+0000","last_active":"2024-09-21T09:11:07.919054+0000","last_peered":"2024-09-21T09:11:07.919054+0000","last_clean":"2024-09-21T09:11:07.919054+0000","last_became_active":"2024-09-21T09:10:56.856312+0000","last_became_peered":"2024-09-21T09:10:56.856312+0000","last_unstale":"2024-09-21T09:11:07.919054+0000","last_undegraded":"2024-09-21T09:11:07.919054+0000","last_fullsized":"2024-09-21T09:11:07.919054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:50.998215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859191+0000","last_change":"2024-09-21T09:11:00.845901+0000","last_active":"2024-09-21T09:11:07.859191+0000","last_peered":"2024-09-21T09:11:07.859191+0000","last_clean":"2024-09-21T09:11:07.859191+0000","last_became_active":"2024-09-21T09:11:00.845312+0000","last_became_peered":"2024-09-21T09:11:00.845312+0000","last_unstale":"2024-09-21T09:11:07.859191+0000","last_undegraded":"2024-09-21T09:11:07.859191+0000","last_fullsized":"2024-09-21T09:11:07.859191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:10.134818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.180914+0000","last_change":"2024-09-21T09:11:02.847926+0000","last_active":"2024-09-21T09:11:08.180914+0000","last_peered":"2024-09-21T09:11:08.180914+0000","last_clean":"2024-09-21T09:11:08.180914+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:11:08.180914+0000","last_undegraded":"2024-09-21T09:11:08.180914+0000","last_fullsized":"2024-09-21T09:11:08.180914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:15.592269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917327+0000","last_change":"2024-09-21T09:11:04.880866+0000","last_active":"2024-09-21T09:11:07.917327+0000","last_peered":"2024-09-21T09:11:07.917327+0000","last_clean":"2024-09-21T09:11:07.917327+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:11:07.917327+0000","last_undegraded":"2024-09-21T09:11:07.917327+0000","last_fullsized":"2024-09-21T09:11:07.917327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:02.568576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874007+0000","last_change":"2024-09-21T09:11:06.899493+0000","last_active":"2024-09-21T09:11:07.874007+0000","last_peered":"2024-09-21T09:11:07.874007+0000","last_clean":"2024-09-21T09:11:07.874007+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:11:07.874007+0000","last_undegraded":"2024-09-21T09:11:07.874007+0000","last_fullsized":"2024-09-21T09:11:07.874007+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:50.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890343+0000","last_change":"2024-09-21T09:10:58.856310+0000","last_active":"2024-09-21T09:11:07.890343+0000","last_peered":"2024-09-21T09:11:07.890343+0000","last_clean":"2024-09-21T09:11:07.890343+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:11:07.890343+0000","last_undegraded":"2024-09-21T09:11:07.890343+0000","last_fullsized":"2024-09-21T09:11:07.890343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:12.549438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875375+0000","last_change":"2024-09-21T09:10:56.867139+0000","last_active":"2024-09-21T09:11:07.875375+0000","last_peered":"2024-09-21T09:11:07.875375+0000","last_clean":"2024-09-21T09:11:07.875375+0000","last_became_active":"2024-09-21T09:10:56.865925+0000","last_became_peered":"2024-09-21T09:10:56.865925+0000","last_unstale":"2024-09-21T09:11:07.875375+0000","last_undegraded":"2024-09-21T09:11:07.875375+0000","last_fullsized":"2024-09-21T09:11:07.875375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:32.583435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885466+0000","last_change":"2024-09-21T09:11:00.837141+0000","last_active":"2024-09-21T09:11:07.885466+0000","last_peered":"2024-09-21T09:11:07.885466+0000","last_clean":"2024-09-21T09:11:07.885466+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:11:07.885466+0000","last_undegraded":"2024-09-21T09:11:07.885466+0000","last_fullsized":"2024-09-21T09:11:07.885466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'5","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.403830+0000","last_change":"2024-09-21T09:11:02.868591+0000","last_active":"2024-09-21T09:11:08.403830+0000","last_peered":"2024-09-21T09:11:08.403830+0000","last_clean":"2024-09-21T09:11:08.403830+0000","last_became_active":"2024-09-21T09:11:02.867878+0000","last_became_peered":"2024-09-21T09:11:02.867878+0000","last_unstale":"2024-09-21T09:11:08.403830+0000","last_undegraded":"2024-09-21T09:11:08.403830+0000","last_fullsized":"2024-09-21T09:11:08.403830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917053+0000","last_change":"2024-09-21T09:11:04.887172+0000","last_active":"2024-09-21T09:11:07.917053+0000","last_peered":"2024-09-21T09:11:07.917053+0000","last_clean":"2024-09-21T09:11:07.917053+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:11:07.917053+0000","last_undegraded":"2024-09-21T09:11:07.917053+0000","last_fullsized":"2024-09-21T09:11:07.917053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:01.250555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918433+0000","last_change":"2024-09-21T09:11:06.888366+0000","last_active":"2024-09-21T09:11:07.918433+0000","last_peered":"2024-09-21T09:11:07.918433+0000","last_clean":"2024-09-21T09:11:07.918433+0000","last_became_active":"2024-09-21T09:11:06.887603+0000","last_became_peered":"2024-09-21T09:11:06.887603+0000","last_unstale":"2024-09-21T09:11:07.918433+0000","last_undegraded":"2024-09-21T09:11:07.918433+0000","last_fullsized":"2024-09-21T09:11:07.918433+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:06.920940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857458+0000","last_change":"2024-09-21T09:10:58.867360+0000","last_active":"2024-09-21T09:11:07.857458+0000","last_peered":"2024-09-21T09:11:07.857458+0000","last_clean":"2024-09-21T09:11:07.857458+0000","last_became_active":"2024-09-21T09:10:58.867116+0000","last_became_peered":"2024-09-21T09:10:58.867116+0000","last_unstale":"2024-09-21T09:11:07.857458+0000","last_undegraded":"2024-09-21T09:11:07.857458+0000","last_fullsized":"2024-09-21T09:11:07.857458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875758+0000","last_change":"2024-09-21T09:10:56.861373+0000","last_active":"2024-09-21T09:11:07.875758+0000","last_peered":"2024-09-21T09:11:07.875758+0000","last_clean":"2024-09-21T09:11:07.875758+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:11:07.875758+0000","last_undegraded":"2024-09-21T09:11:07.875758+0000","last_fullsized":"2024-09-21T09:11:07.875758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:45.846021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877071+0000","last_change":"2024-09-21T09:11:00.838647+0000","last_active":"2024-09-21T09:11:07.877071+0000","last_peered":"2024-09-21T09:11:07.877071+0000","last_clean":"2024-09-21T09:11:07.877071+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:11:07.877071+0000","last_undegraded":"2024-09-21T09:11:07.877071+0000","last_fullsized":"2024-09-21T09:11:07.877071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:16.279789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.473280+0000","last_change":"2024-09-21T09:11:02.877357+0000","last_active":"2024-09-21T09:11:08.473280+0000","last_peered":"2024-09-21T09:11:08.473280+0000","last_clean":"2024-09-21T09:11:08.473280+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:11:08.473280+0000","last_undegraded":"2024-09-21T09:11:08.473280+0000","last_fullsized":"2024-09-21T09:11:08.473280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:46.845302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878751+0000","last_change":"2024-09-21T09:11:04.896698+0000","last_active":"2024-09-21T09:11:07.878751+0000","last_peered":"2024-09-21T09:11:07.878751+0000","last_clean":"2024-09-21T09:11:07.878751+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:11:07.878751+0000","last_undegraded":"2024-09-21T09:11:07.878751+0000","last_fullsized":"2024-09-21T09:11:07.878751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:59.924890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863350+0000","last_change":"2024-09-21T09:11:06.894453+0000","last_active":"2024-09-21T09:11:07.863350+0000","last_peered":"2024-09-21T09:11:07.863350+0000","last_clean":"2024-09-21T09:11:07.863350+0000","last_became_active":"2024-09-21T09:11:06.893707+0000","last_became_peered":"2024-09-21T09:11:06.893707+0000","last_unstale":"2024-09-21T09:11:07.863350+0000","last_undegraded":"2024-09-21T09:11:07.863350+0000","last_fullsized":"2024-09-21T09:11:07.863350+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:10.502126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880595+0000","last_change":"2024-09-21T09:10:58.865842+0000","last_active":"2024-09-21T09:11:07.880595+0000","last_peered":"2024-09-21T09:11:07.880595+0000","last_clean":"2024-09-21T09:11:07.880595+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:11:07.880595+0000","last_undegraded":"2024-09-21T09:11:07.880595+0000","last_fullsized":"2024-09-21T09:11:07.880595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:10.069785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857746+0000","last_change":"2024-09-21T09:10:56.858160+0000","last_active":"2024-09-21T09:11:07.857746+0000","last_peered":"2024-09-21T09:11:07.857746+0000","last_clean":"2024-09-21T09:11:07.857746+0000","last_became_active":"2024-09-21T09:10:56.851283+0000","last_became_peered":"2024-09-21T09:10:56.851283+0000","last_unstale":"2024-09-21T09:11:07.857746+0000","last_undegraded":"2024-09-21T09:11:07.857746+0000","last_fullsized":"2024-09-21T09:11:07.857746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892213+0000","last_change":"2024-09-21T09:10:58.871267+0000","last_active":"2024-09-21T09:11:07.892213+0000","last_peered":"2024-09-21T09:11:07.892213+0000","last_clean":"2024-09-21T09:11:07.892213+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:11:07.892213+0000","last_undegraded":"2024-09-21T09:11:07.892213+0000","last_fullsized":"2024-09-21T09:11:07.892213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890192+0000","last_change":"2024-09-21T09:10:56.847914+0000","last_active":"2024-09-21T09:11:07.890192+0000","last_peered":"2024-09-21T09:11:07.890192+0000","last_clean":"2024-09-21T09:11:07.890192+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:11:07.890192+0000","last_undegraded":"2024-09-21T09:11:07.890192+0000","last_fullsized":"2024-09-21T09:11:07.890192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918688+0000","last_change":"2024-09-21T09:10:58.837841+0000","last_active":"2024-09-21T09:11:07.918688+0000","last_peered":"2024-09-21T09:11:07.918688+0000","last_clean":"2024-09-21T09:11:07.918688+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:11:07.918688+0000","last_undegraded":"2024-09-21T09:11:07.918688+0000","last_fullsized":"2024-09-21T09:11:07.918688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:54.101397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918387+0000","last_change":"2024-09-21T09:10:56.861995+0000","last_active":"2024-09-21T09:11:07.918387+0000","last_peered":"2024-09-21T09:11:07.918387+0000","last_clean":"2024-09-21T09:11:07.918387+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:11:07.918387+0000","last_undegraded":"2024-09-21T09:11:07.918387+0000","last_fullsized":"2024-09-21T09:11:07.918387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:44.655482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874314+0000","last_change":"2024-09-21T09:10:58.835449+0000","last_active":"2024-09-21T09:11:07.874314+0000","last_peered":"2024-09-21T09:11:07.874314+0000","last_clean":"2024-09-21T09:11:07.874314+0000","last_became_active":"2024-09-21T09:10:58.834588+0000","last_became_peered":"2024-09-21T09:10:58.834588+0000","last_unstale":"2024-09-21T09:11:07.874314+0000","last_undegraded":"2024-09-21T09:11:07.874314+0000","last_fullsized":"2024-09-21T09:11:07.874314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:39.496248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874354+0000","last_change":"2024-09-21T09:10:56.866139+0000","last_active":"2024-09-21T09:11:07.874354+0000","last_peered":"2024-09-21T09:11:07.874354+0000","last_clean":"2024-09-21T09:11:07.874354+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:11:07.874354+0000","last_undegraded":"2024-09-21T09:11:07.874354+0000","last_fullsized":"2024-09-21T09:11:07.874354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:33.551996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873847+0000","last_change":"2024-09-21T09:10:58.840408+0000","last_active":"2024-09-21T09:11:07.873847+0000","last_peered":"2024-09-21T09:11:07.873847+0000","last_clean":"2024-09-21T09:11:07.873847+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:11:07.873847+0000","last_undegraded":"2024-09-21T09:11:07.873847+0000","last_fullsized":"2024-09-21T09:11:07.873847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:42.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861529+0000","last_change":"2024-09-21T09:10:56.860054+0000","last_active":"2024-09-21T09:11:07.861529+0000","last_peered":"2024-09-21T09:11:07.861529+0000","last_clean":"2024-09-21T09:11:07.861529+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:11:07.861529+0000","last_undegraded":"2024-09-21T09:11:07.861529+0000","last_fullsized":"2024-09-21T09:11:07.861529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860756+0000","last_change":"2024-09-21T09:10:58.836500+0000","last_active":"2024-09-21T09:11:07.860756+0000","last_peered":"2024-09-21T09:11:07.860756+0000","last_clean":"2024-09-21T09:11:07.860756+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:11:07.860756+0000","last_undegraded":"2024-09-21T09:11:07.860756+0000","last_fullsized":"2024-09-21T09:11:07.860756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861569+0000","last_change":"2024-09-21T09:10:56.862765+0000","last_active":"2024-09-21T09:11:07.861569+0000","last_peered":"2024-09-21T09:11:07.861569+0000","last_clean":"2024-09-21T09:11:07.861569+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:11:07.861569+0000","last_undegraded":"2024-09-21T09:11:07.861569+0000","last_fullsized":"2024-09-21T09:11:07.861569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860273+0000","last_change":"2024-09-21T09:10:58.826466+0000","last_active":"2024-09-21T09:11:07.860273+0000","last_peered":"2024-09-21T09:11:07.860273+0000","last_clean":"2024-09-21T09:11:07.860273+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:11:07.860273+0000","last_undegraded":"2024-09-21T09:11:07.860273+0000","last_fullsized":"2024-09-21T09:11:07.860273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862158+0000","last_change":"2024-09-21T09:10:56.865042+0000","last_active":"2024-09-21T09:11:07.862158+0000","last_peered":"2024-09-21T09:11:07.862158+0000","last_clean":"2024-09-21T09:11:07.862158+0000","last_became_active":"2024-09-21T09:10:56.858460+0000","last_became_peered":"2024-09-21T09:10:56.858460+0000","last_unstale":"2024-09-21T09:11:07.862158+0000","last_undegraded":"2024-09-21T09:11:07.862158+0000","last_fullsized":"2024-09-21T09:11:07.862158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886438+0000","last_change":"2024-09-21T09:10:58.872072+0000","last_active":"2024-09-21T09:11:07.886438+0000","last_peered":"2024-09-21T09:11:07.886438+0000","last_clean":"2024-09-21T09:11:07.886438+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:11:07.886438+0000","last_undegraded":"2024-09-21T09:11:07.886438+0000","last_fullsized":"2024-09-21T09:11:07.886438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875487+0000","last_change":"2024-09-21T09:10:56.861072+0000","last_active":"2024-09-21T09:11:07.875487+0000","last_peered":"2024-09-21T09:11:07.875487+0000","last_clean":"2024-09-21T09:11:07.875487+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:11:07.875487+0000","last_undegraded":"2024-09-21T09:11:07.875487+0000","last_fullsized":"2024-09-21T09:11:07.875487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892531+0000","last_change":"2024-09-21T09:10:58.856982+0000","last_active":"2024-09-21T09:11:07.892531+0000","last_peered":"2024-09-21T09:11:07.892531+0000","last_clean":"2024-09-21T09:11:07.892531+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:11:07.892531+0000","last_undegraded":"2024-09-21T09:11:07.892531+0000","last_fullsized":"2024-09-21T09:11:07.892531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917570+0000","last_change":"2024-09-21T09:10:56.847793+0000","last_active":"2024-09-21T09:11:07.917570+0000","last_peered":"2024-09-21T09:11:07.917570+0000","last_clean":"2024-09-21T09:11:07.917570+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:11:07.917570+0000","last_undegraded":"2024-09-21T09:11:07.917570+0000","last_fullsized":"2024-09-21T09:11:07.917570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:22.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.864128+0000","last_change":"2024-09-21T09:10:58.851481+0000","last_active":"2024-09-21T09:11:07.864128+0000","last_peered":"2024-09-21T09:11:07.864128+0000","last_clean":"2024-09-21T09:11:07.864128+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:11:07.864128+0000","last_undegraded":"2024-09-21T09:11:07.864128+0000","last_fullsized":"2024-09-21T09:11:07.864128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:42.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872808+0000","last_change":"2024-09-21T09:10:56.869306+0000","last_active":"2024-09-21T09:11:07.872808+0000","last_peered":"2024-09-21T09:11:07.872808+0000","last_clean":"2024-09-21T09:11:07.872808+0000","last_became_active":"2024-09-21T09:10:56.868642+0000","last_became_peered":"2024-09-21T09:10:56.868642+0000","last_unstale":"2024-09-21T09:11:07.872808+0000","last_undegraded":"2024-09-21T09:11:07.872808+0000","last_fullsized":"2024-09-21T09:11:07.872808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:41.032517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874447+0000","last_change":"2024-09-21T09:10:58.843673+0000","last_active":"2024-09-21T09:11:07.874447+0000","last_peered":"2024-09-21T09:11:07.874447+0000","last_clean":"2024-09-21T09:11:07.874447+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:11:07.874447+0000","last_undegraded":"2024-09-21T09:11:07.874447+0000","last_fullsized":"2024-09-21T09:11:07.874447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:19.133330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887411+0000","last_change":"2024-09-21T09:10:56.838835+0000","last_active":"2024-09-21T09:11:07.887411+0000","last_peered":"2024-09-21T09:11:07.887411+0000","last_clean":"2024-09-21T09:11:07.887411+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:11:07.887411+0000","last_undegraded":"2024-09-21T09:11:07.887411+0000","last_fullsized":"2024-09-21T09:11:07.887411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886151+0000","last_change":"2024-09-21T09:10:58.869168+0000","last_active":"2024-09-21T09:11:07.886151+0000","last_peered":"2024-09-21T09:11:07.886151+0000","last_clean":"2024-09-21T09:11:07.886151+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:11:07.886151+0000","last_undegraded":"2024-09-21T09:11:07.886151+0000","last_fullsized":"2024-09-21T09:11:07.886151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879317+0000","last_change":"2024-09-21T09:10:56.830478+0000","last_active":"2024-09-21T09:11:07.879317+0000","last_peered":"2024-09-21T09:11:07.879317+0000","last_clean":"2024-09-21T09:11:07.879317+0000","last_became_active":"2024-09-21T09:10:56.829720+0000","last_became_peered":"2024-09-21T09:10:56.829720+0000","last_unstale":"2024-09-21T09:11:07.879317+0000","last_undegraded":"2024-09-21T09:11:07.879317+0000","last_fullsized":"2024-09-21T09:11:07.879317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:31.318290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885849+0000","last_change":"2024-09-21T09:10:58.840930+0000","last_active":"2024-09-21T09:11:07.885849+0000","last_peered":"2024-09-21T09:11:07.885849+0000","last_clean":"2024-09-21T09:11:07.885849+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:11:07.885849+0000","last_undegraded":"2024-09-21T09:11:07.885849+0000","last_fullsized":"2024-09-21T09:11:07.885849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863192+0000","last_change":"2024-09-21T09:10:56.841366+0000","last_active":"2024-09-21T09:11:07.863192+0000","last_peered":"2024-09-21T09:11:07.863192+0000","last_clean":"2024-09-21T09:11:07.863192+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:11:07.863192+0000","last_undegraded":"2024-09-21T09:11:07.863192+0000","last_fullsized":"2024-09-21T09:11:07.863192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:15.948479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890566+0000","last_change":"2024-09-21T09:10:58.873865+0000","last_active":"2024-09-21T09:11:07.890566+0000","last_peered":"2024-09-21T09:11:07.890566+0000","last_clean":"2024-09-21T09:11:07.890566+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:11:07.890566+0000","last_undegraded":"2024-09-21T09:11:07.890566+0000","last_fullsized":"2024-09-21T09:11:07.890566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919229+0000","last_change":"2024-09-21T09:10:56.843359+0000","last_active":"2024-09-21T09:11:07.919229+0000","last_peered":"2024-09-21T09:11:07.919229+0000","last_clean":"2024-09-21T09:11:07.919229+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:11:07.919229+0000","last_undegraded":"2024-09-21T09:11:07.919229+0000","last_fullsized":"2024-09-21T09:11:07.919229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:17.126175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877694+0000","last_change":"2024-09-21T09:10:58.864268+0000","last_active":"2024-09-21T09:11:07.877694+0000","last_peered":"2024-09-21T09:11:07.877694+0000","last_clean":"2024-09-21T09:11:07.877694+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:11:07.877694+0000","last_undegraded":"2024-09-21T09:11:07.877694+0000","last_fullsized":"2024-09-21T09:11:07.877694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:22.929821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892486+0000","last_change":"2024-09-21T09:10:56.868852+0000","last_active":"2024-09-21T09:11:07.892486+0000","last_peered":"2024-09-21T09:11:07.892486+0000","last_clean":"2024-09-21T09:11:07.892486+0000","last_became_active":"2024-09-21T09:10:56.868190+0000","last_became_peered":"2024-09-21T09:10:56.868190+0000","last_unstale":"2024-09-21T09:11:07.892486+0000","last_undegraded":"2024-09-21T09:11:07.892486+0000","last_fullsized":"2024-09-21T09:11:07.892486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886290+0000","last_change":"2024-09-21T09:10:58.840040+0000","last_active":"2024-09-21T09:11:07.886290+0000","last_peered":"2024-09-21T09:11:07.886290+0000","last_clean":"2024-09-21T09:11:07.886290+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:11:07.886290+0000","last_undegraded":"2024-09-21T09:11:07.886290+0000","last_fullsized":"2024-09-21T09:11:07.886290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919156+0000","last_change":"2024-09-21T09:10:56.845828+0000","last_active":"2024-09-21T09:11:07.919156+0000","last_peered":"2024-09-21T09:11:07.919156+0000","last_clean":"2024-09-21T09:11:07.919156+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:11:07.919156+0000","last_undegraded":"2024-09-21T09:11:07.919156+0000","last_fullsized":"2024-09-21T09:11:07.919156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:37.489093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917457+0000","last_change":"2024-09-21T09:10:56.850266+0000","last_active":"2024-09-21T09:11:07.917457+0000","last_peered":"2024-09-21T09:11:07.917457+0000","last_clean":"2024-09-21T09:11:07.917457+0000","last_became_active":"2024-09-21T09:10:56.849742+0000","last_became_peered":"2024-09-21T09:10:56.849742+0000","last_unstale":"2024-09-21T09:11:07.917457+0000","last_undegraded":"2024-09-21T09:11:07.917457+0000","last_fullsized":"2024-09-21T09:11:07.917457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:55.985441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880307+0000","last_change":"2024-09-21T09:10:58.871879+0000","last_active":"2024-09-21T09:11:07.880307+0000","last_peered":"2024-09-21T09:11:07.880307+0000","last_clean":"2024-09-21T09:11:07.880307+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:11:07.880307+0000","last_undegraded":"2024-09-21T09:11:07.880307+0000","last_fullsized":"2024-09-21T09:11:07.880307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:28.117298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872697+0000","last_change":"2024-09-21T09:10:56.862439+0000","last_active":"2024-09-21T09:11:07.872697+0000","last_peered":"2024-09-21T09:11:07.872697+0000","last_clean":"2024-09-21T09:11:07.872697+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:11:07.872697+0000","last_undegraded":"2024-09-21T09:11:07.872697+0000","last_fullsized":"2024-09-21T09:11:07.872697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887152+0000","last_change":"2024-09-21T09:10:58.828974+0000","last_active":"2024-09-21T09:11:07.887152+0000","last_peered":"2024-09-21T09:11:07.887152+0000","last_clean":"2024-09-21T09:11:07.887152+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:11:07.887152+0000","last_undegraded":"2024-09-21T09:11:07.887152+0000","last_fullsized":"2024-09-21T09:11:07.887152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":434176,"data_stored":175852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":430080,"data_stored":174914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":765373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":425984,"data_stored":174740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":409600,"data_stored":174781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1048576,"data_stored":765867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":176510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":438272,"data_stored":175487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:11:14.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:11:15.209 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:11:15.215 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:11:15.232 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-21T09:11:14.952595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529,"ondisk_log_size":529,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270716,"kb_used_data":4560,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754704004,"statfs":{"total":773094113280,"available":772816900096,"internally_reserved":0,"allocated":4669440,"data_stored":2583524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.098031"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.864680+0000","last_change":"2024-09-21T09:10:56.846463+0000","last_active":"2024-09-21T09:11:07.864680+0000","last_peered":"2024-09-21T09:11:07.864680+0000","last_clean":"2024-09-21T09:11:07.864680+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:11:07.864680+0000","last_undegraded":"2024-09-21T09:11:07.864680+0000","last_fullsized":"2024-09-21T09:11:07.864680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886157+0000","last_change":"2024-09-21T09:10:58.836923+0000","last_active":"2024-09-21T09:11:07.886157+0000","last_peered":"2024-09-21T09:11:07.886157+0000","last_clean":"2024-09-21T09:11:07.886157+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:11:07.886157+0000","last_undegraded":"2024-09-21T09:11:07.886157+0000","last_fullsized":"2024-09-21T09:11:07.886157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:30.880333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875342+0000","last_change":"2024-09-21T09:10:56.865056+0000","last_active":"2024-09-21T09:11:07.875342+0000","last_peered":"2024-09-21T09:11:07.875342+0000","last_clean":"2024-09-21T09:11:07.875342+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:11:07.875342+0000","last_undegraded":"2024-09-21T09:11:07.875342+0000","last_fullsized":"2024-09-21T09:11:07.875342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917692+0000","last_change":"2024-09-21T09:10:58.835355+0000","last_active":"2024-09-21T09:11:07.917692+0000","last_peered":"2024-09-21T09:11:07.917692+0000","last_clean":"2024-09-21T09:11:07.917692+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:11:07.917692+0000","last_undegraded":"2024-09-21T09:11:07.917692+0000","last_fullsized":"2024-09-21T09:11:07.917692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:24.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874591+0000","last_change":"2024-09-21T09:10:56.861504+0000","last_active":"2024-09-21T09:11:07.874591+0000","last_peered":"2024-09-21T09:11:07.874591+0000","last_clean":"2024-09-21T09:11:07.874591+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:11:07.874591+0000","last_undegraded":"2024-09-21T09:11:07.874591+0000","last_fullsized":"2024-09-21T09:11:07.874591+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:00.409267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917558+0000","last_change":"2024-09-21T09:10:58.842892+0000","last_active":"2024-09-21T09:11:07.917558+0000","last_peered":"2024-09-21T09:11:07.917558+0000","last_clean":"2024-09-21T09:11:07.917558+0000","last_became_active":"2024-09-21T09:10:58.842456+0000","last_became_peered":"2024-09-21T09:10:58.842456+0000","last_unstale":"2024-09-21T09:11:07.917558+0000","last_undegraded":"2024-09-21T09:11:07.917558+0000","last_fullsized":"2024-09-21T09:11:07.917558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:02.970645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860752+0000","last_change":"2024-09-21T09:10:56.825059+0000","last_active":"2024-09-21T09:11:07.860752+0000","last_peered":"2024-09-21T09:11:07.860752+0000","last_clean":"2024-09-21T09:11:07.860752+0000","last_became_active":"2024-09-21T09:10:56.824415+0000","last_became_peered":"2024-09-21T09:10:56.824415+0000","last_unstale":"2024-09-21T09:11:07.860752+0000","last_undegraded":"2024-09-21T09:11:07.860752+0000","last_fullsized":"2024-09-21T09:11:07.860752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879454+0000","last_change":"2024-09-21T09:10:58.864483+0000","last_active":"2024-09-21T09:11:07.879454+0000","last_peered":"2024-09-21T09:11:07.879454+0000","last_clean":"2024-09-21T09:11:07.879454+0000","last_became_active":"2024-09-21T09:10:58.857109+0000","last_became_peered":"2024-09-21T09:10:58.857109+0000","last_unstale":"2024-09-21T09:11:07.879454+0000","last_undegraded":"2024-09-21T09:11:07.879454+0000","last_fullsized":"2024-09-21T09:11:07.879454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:32:38.780066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862652+0000","last_change":"2024-09-21T09:10:56.863607+0000","last_active":"2024-09-21T09:11:07.862652+0000","last_peered":"2024-09-21T09:11:07.862652+0000","last_clean":"2024-09-21T09:11:07.862652+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:11:07.862652+0000","last_undegraded":"2024-09-21T09:11:07.862652+0000","last_fullsized":"2024-09-21T09:11:07.862652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862242+0000","last_change":"2024-09-21T09:10:58.851357+0000","last_active":"2024-09-21T09:11:07.862242+0000","last_peered":"2024-09-21T09:11:07.862242+0000","last_clean":"2024-09-21T09:11:07.862242+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:11:07.862242+0000","last_undegraded":"2024-09-21T09:11:07.862242+0000","last_fullsized":"2024-09-21T09:11:07.862242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.858664+0000","last_change":"2024-09-21T09:10:56.823432+0000","last_active":"2024-09-21T09:11:07.858664+0000","last_peered":"2024-09-21T09:11:07.858664+0000","last_clean":"2024-09-21T09:11:07.858664+0000","last_became_active":"2024-09-21T09:10:56.822819+0000","last_became_peered":"2024-09-21T09:10:56.822819+0000","last_unstale":"2024-09-21T09:11:07.858664+0000","last_undegraded":"2024-09-21T09:11:07.858664+0000","last_fullsized":"2024-09-21T09:11:07.858664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863632+0000","last_change":"2024-09-21T09:10:58.825880+0000","last_active":"2024-09-21T09:11:07.863632+0000","last_peered":"2024-09-21T09:11:07.863632+0000","last_clean":"2024-09-21T09:11:07.863632+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:11:07.863632+0000","last_undegraded":"2024-09-21T09:11:07.863632+0000","last_fullsized":"2024-09-21T09:11:07.863632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:46.662637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861708+0000","last_change":"2024-09-21T09:10:56.851331+0000","last_active":"2024-09-21T09:11:07.861708+0000","last_peered":"2024-09-21T09:11:07.861708+0000","last_clean":"2024-09-21T09:11:07.861708+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:11:07.861708+0000","last_undegraded":"2024-09-21T09:11:07.861708+0000","last_fullsized":"2024-09-21T09:11:07.861708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861607+0000","last_change":"2024-09-21T09:10:58.868708+0000","last_active":"2024-09-21T09:11:07.861607+0000","last_peered":"2024-09-21T09:11:07.861607+0000","last_clean":"2024-09-21T09:11:07.861607+0000","last_became_active":"2024-09-21T09:10:58.868277+0000","last_became_peered":"2024-09-21T09:10:58.868277+0000","last_unstale":"2024-09-21T09:11:07.861607+0000","last_undegraded":"2024-09-21T09:11:07.861607+0000","last_fullsized":"2024-09-21T09:11:07.861607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872599+0000","last_change":"2024-09-21T09:10:56.864409+0000","last_active":"2024-09-21T09:11:07.872599+0000","last_peered":"2024-09-21T09:11:07.872599+0000","last_clean":"2024-09-21T09:11:07.872599+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:11:07.872599+0000","last_undegraded":"2024-09-21T09:11:07.872599+0000","last_fullsized":"2024-09-21T09:11:07.872599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875747+0000","last_change":"2024-09-21T09:10:58.837006+0000","last_active":"2024-09-21T09:11:07.875747+0000","last_peered":"2024-09-21T09:11:07.875747+0000","last_clean":"2024-09-21T09:11:07.875747+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:11:07.875747+0000","last_undegraded":"2024-09-21T09:11:07.875747+0000","last_fullsized":"2024-09-21T09:11:07.875747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:52.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917168+0000","last_change":"2024-09-21T09:10:58.853249+0000","last_active":"2024-09-21T09:11:07.917168+0000","last_peered":"2024-09-21T09:11:07.917168+0000","last_clean":"2024-09-21T09:11:07.917168+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:11:07.917168+0000","last_undegraded":"2024-09-21T09:11:07.917168+0000","last_fullsized":"2024-09-21T09:11:07.917168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:03.692219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887881+0000","last_change":"2024-09-21T09:10:56.838955+0000","last_active":"2024-09-21T09:11:07.887881+0000","last_peered":"2024-09-21T09:11:07.887881+0000","last_clean":"2024-09-21T09:11:07.887881+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:11:07.887881+0000","last_undegraded":"2024-09-21T09:11:07.887881+0000","last_fullsized":"2024-09-21T09:11:07.887881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861489+0000","last_change":"2024-09-21T09:10:58.869303+0000","last_active":"2024-09-21T09:11:07.861489+0000","last_peered":"2024-09-21T09:11:07.861489+0000","last_clean":"2024-09-21T09:11:07.861489+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:11:07.861489+0000","last_undegraded":"2024-09-21T09:11:07.861489+0000","last_fullsized":"2024-09-21T09:11:07.861489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.864346+0000","last_change":"2024-09-21T09:10:56.866497+0000","last_active":"2024-09-21T09:11:07.864346+0000","last_peered":"2024-09-21T09:11:07.864346+0000","last_clean":"2024-09-21T09:11:07.864346+0000","last_became_active":"2024-09-21T09:10:56.866213+0000","last_became_peered":"2024-09-21T09:10:56.866213+0000","last_unstale":"2024-09-21T09:11:07.864346+0000","last_undegraded":"2024-09-21T09:11:07.864346+0000","last_fullsized":"2024-09-21T09:11:07.864346+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:33.551996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885862+0000","last_change":"2024-09-21T09:10:58.840976+0000","last_active":"2024-09-21T09:11:07.885862+0000","last_peered":"2024-09-21T09:11:07.885862+0000","last_clean":"2024-09-21T09:11:07.885862+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:11:07.885862+0000","last_undegraded":"2024-09-21T09:11:07.885862+0000","last_fullsized":"2024-09-21T09:11:07.885862+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863890+0000","last_change":"2024-09-21T09:10:56.853888+0000","last_active":"2024-09-21T09:11:07.863890+0000","last_peered":"2024-09-21T09:11:07.863890+0000","last_clean":"2024-09-21T09:11:07.863890+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:11:07.863890+0000","last_undegraded":"2024-09-21T09:11:07.863890+0000","last_fullsized":"2024-09-21T09:11:07.863890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860687+0000","last_change":"2024-09-21T09:10:58.838132+0000","last_active":"2024-09-21T09:11:07.860687+0000","last_peered":"2024-09-21T09:11:07.860687+0000","last_clean":"2024-09-21T09:11:07.860687+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:11:07.860687+0000","last_undegraded":"2024-09-21T09:11:07.860687+0000","last_fullsized":"2024-09-21T09:11:07.860687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862733+0000","last_change":"2024-09-21T09:10:56.845923+0000","last_active":"2024-09-21T09:11:07.862733+0000","last_peered":"2024-09-21T09:11:07.862733+0000","last_clean":"2024-09-21T09:11:07.862733+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:11:07.862733+0000","last_undegraded":"2024-09-21T09:11:07.862733+0000","last_fullsized":"2024-09-21T09:11:07.862733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873591+0000","last_change":"2024-09-21T09:10:58.848326+0000","last_active":"2024-09-21T09:11:07.873591+0000","last_peered":"2024-09-21T09:11:07.873591+0000","last_clean":"2024-09-21T09:11:07.873591+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:11:07.873591+0000","last_undegraded":"2024-09-21T09:11:07.873591+0000","last_fullsized":"2024-09-21T09:11:07.873591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:44.318321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861552+0000","last_change":"2024-09-21T09:10:56.859019+0000","last_active":"2024-09-21T09:11:07.861552+0000","last_peered":"2024-09-21T09:11:07.861552+0000","last_clean":"2024-09-21T09:11:07.861552+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:11:07.861552+0000","last_undegraded":"2024-09-21T09:11:07.861552+0000","last_fullsized":"2024-09-21T09:11:07.861552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886865+0000","last_change":"2024-09-21T09:10:58.830335+0000","last_active":"2024-09-21T09:11:07.886865+0000","last_peered":"2024-09-21T09:11:07.886865+0000","last_clean":"2024-09-21T09:11:07.886865+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:11:07.886865+0000","last_undegraded":"2024-09-21T09:11:07.886865+0000","last_fullsized":"2024-09-21T09:11:07.886865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860588+0000","last_change":"2024-09-21T09:10:56.862662+0000","last_active":"2024-09-21T09:11:07.860588+0000","last_peered":"2024-09-21T09:11:07.860588+0000","last_clean":"2024-09-21T09:11:07.860588+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:11:07.860588+0000","last_undegraded":"2024-09-21T09:11:07.860588+0000","last_fullsized":"2024-09-21T09:11:07.860588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860144+0000","last_change":"2024-09-21T09:11:06.898983+0000","last_active":"2024-09-21T09:11:07.860144+0000","last_peered":"2024-09-21T09:11:07.860144+0000","last_clean":"2024-09-21T09:11:07.860144+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:11:07.860144+0000","last_undegraded":"2024-09-21T09:11:07.860144+0000","last_fullsized":"2024-09-21T09:11:07.860144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861279+0000","last_change":"2024-09-21T09:10:58.876069+0000","last_active":"2024-09-21T09:11:07.861279+0000","last_peered":"2024-09-21T09:11:07.861279+0000","last_clean":"2024-09-21T09:11:07.861279+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:11:07.861279+0000","last_undegraded":"2024-09-21T09:11:07.861279+0000","last_fullsized":"2024-09-21T09:11:07.861279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917597+0000","last_change":"2024-09-21T09:10:56.848523+0000","last_active":"2024-09-21T09:11:07.917597+0000","last_peered":"2024-09-21T09:11:07.917597+0000","last_clean":"2024-09-21T09:11:07.917597+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:11:07.917597+0000","last_undegraded":"2024-09-21T09:11:07.917597+0000","last_fullsized":"2024-09-21T09:11:07.917597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:19.819608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919936+0000","last_change":"2024-09-21T09:11:00.842168+0000","last_active":"2024-09-21T09:11:07.919936+0000","last_peered":"2024-09-21T09:11:07.919936+0000","last_clean":"2024-09-21T09:11:07.919936+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:11:07.919936+0000","last_undegraded":"2024-09-21T09:11:07.919936+0000","last_fullsized":"2024-09-21T09:11:07.919936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:33.920548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.253499+0000","last_change":"2024-09-21T09:11:02.866403+0000","last_active":"2024-09-21T09:11:08.253499+0000","last_peered":"2024-09-21T09:11:08.253499+0000","last_clean":"2024-09-21T09:11:08.253499+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:11:08.253499+0000","last_undegraded":"2024-09-21T09:11:08.253499+0000","last_fullsized":"2024-09-21T09:11:08.253499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:12.124539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887073+0000","last_change":"2024-09-21T09:11:04.894715+0000","last_active":"2024-09-21T09:11:07.887073+0000","last_peered":"2024-09-21T09:11:07.887073+0000","last_clean":"2024-09-21T09:11:07.887073+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:11:07.887073+0000","last_undegraded":"2024-09-21T09:11:07.887073+0000","last_fullsized":"2024-09-21T09:11:07.887073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:59.579572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885315+0000","last_change":"2024-09-21T09:11:06.885484+0000","last_active":"2024-09-21T09:11:07.885315+0000","last_peered":"2024-09-21T09:11:07.885315+0000","last_clean":"2024-09-21T09:11:07.885315+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:11:07.885315+0000","last_undegraded":"2024-09-21T09:11:07.885315+0000","last_fullsized":"2024-09-21T09:11:07.885315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:13.165470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919329+0000","last_change":"2024-09-21T09:10:58.842832+0000","last_active":"2024-09-21T09:11:07.919329+0000","last_peered":"2024-09-21T09:11:07.919329+0000","last_clean":"2024-09-21T09:11:07.919329+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:11:07.919329+0000","last_undegraded":"2024-09-21T09:11:07.919329+0000","last_fullsized":"2024-09-21T09:11:07.919329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:12.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861312+0000","last_change":"2024-09-21T09:10:56.849428+0000","last_active":"2024-09-21T09:11:07.861312+0000","last_peered":"2024-09-21T09:11:07.861312+0000","last_clean":"2024-09-21T09:11:07.861312+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:11:07.861312+0000","last_undegraded":"2024-09-21T09:11:07.861312+0000","last_fullsized":"2024-09-21T09:11:07.861312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879247+0000","last_change":"2024-09-21T09:11:00.833428+0000","last_active":"2024-09-21T09:11:07.879247+0000","last_peered":"2024-09-21T09:11:07.879247+0000","last_clean":"2024-09-21T09:11:07.879247+0000","last_became_active":"2024-09-21T09:11:00.832336+0000","last_became_peered":"2024-09-21T09:11:00.832336+0000","last_unstale":"2024-09-21T09:11:07.879247+0000","last_undegraded":"2024-09-21T09:11:07.879247+0000","last_fullsized":"2024-09-21T09:11:07.879247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:51.221746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.652738+0000","last_change":"2024-09-21T09:11:02.866594+0000","last_active":"2024-09-21T09:11:08.652738+0000","last_peered":"2024-09-21T09:11:08.652738+0000","last_clean":"2024-09-21T09:11:08.652738+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:11:08.652738+0000","last_undegraded":"2024-09-21T09:11:08.652738+0000","last_fullsized":"2024-09-21T09:11:08.652738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886658+0000","last_change":"2024-09-21T09:11:04.887299+0000","last_active":"2024-09-21T09:11:07.886658+0000","last_peered":"2024-09-21T09:11:07.886658+0000","last_clean":"2024-09-21T09:11:07.886658+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:11:07.886658+0000","last_undegraded":"2024-09-21T09:11:07.886658+0000","last_fullsized":"2024-09-21T09:11:07.886658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:08.490686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860069+0000","last_change":"2024-09-21T09:11:06.891369+0000","last_active":"2024-09-21T09:11:07.860069+0000","last_peered":"2024-09-21T09:11:07.860069+0000","last_clean":"2024-09-21T09:11:07.860069+0000","last_became_active":"2024-09-21T09:11:06.890505+0000","last_became_peered":"2024-09-21T09:11:06.890505+0000","last_unstale":"2024-09-21T09:11:07.860069+0000","last_undegraded":"2024-09-21T09:11:07.860069+0000","last_fullsized":"2024-09-21T09:11:07.860069+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:10.502126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875104+0000","last_change":"2024-09-21T09:10:58.851370+0000","last_active":"2024-09-21T09:11:07.875104+0000","last_peered":"2024-09-21T09:11:07.875104+0000","last_clean":"2024-09-21T09:11:07.875104+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:11:07.875104+0000","last_undegraded":"2024-09-21T09:11:07.875104+0000","last_fullsized":"2024-09-21T09:11:07.875104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:05.984687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917939+0000","last_change":"2024-09-21T09:10:56.836939+0000","last_active":"2024-09-21T09:11:07.917939+0000","last_peered":"2024-09-21T09:11:07.917939+0000","last_clean":"2024-09-21T09:11:07.917939+0000","last_became_active":"2024-09-21T09:10:56.836378+0000","last_became_peered":"2024-09-21T09:10:56.836378+0000","last_unstale":"2024-09-21T09:11:07.917939+0000","last_undegraded":"2024-09-21T09:11:07.917939+0000","last_fullsized":"2024-09-21T09:11:07.917939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:09.594344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879871+0000","last_change":"2024-09-21T09:11:00.845836+0000","last_active":"2024-09-21T09:11:07.879871+0000","last_peered":"2024-09-21T09:11:07.879871+0000","last_clean":"2024-09-21T09:11:07.879871+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:11:07.879871+0000","last_undegraded":"2024-09-21T09:11:07.879871+0000","last_fullsized":"2024-09-21T09:11:07.879871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:06.353993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.714205+0000","last_change":"2024-09-21T09:11:02.852500+0000","last_active":"2024-09-21T09:11:08.714205+0000","last_peered":"2024-09-21T09:11:08.714205+0000","last_clean":"2024-09-21T09:11:08.714205+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:11:08.714205+0000","last_undegraded":"2024-09-21T09:11:08.714205+0000","last_fullsized":"2024-09-21T09:11:08.714205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:19.073540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.920233+0000","last_change":"2024-09-21T09:11:04.895087+0000","last_active":"2024-09-21T09:11:07.920233+0000","last_peered":"2024-09-21T09:11:07.920233+0000","last_clean":"2024-09-21T09:11:07.920233+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:11:07.920233+0000","last_undegraded":"2024-09-21T09:11:07.920233+0000","last_fullsized":"2024-09-21T09:11:07.920233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:11.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.858265+0000","last_change":"2024-09-21T09:11:06.895556+0000","last_active":"2024-09-21T09:11:07.858265+0000","last_peered":"2024-09-21T09:11:07.858265+0000","last_clean":"2024-09-21T09:11:07.858265+0000","last_became_active":"2024-09-21T09:11:06.894677+0000","last_became_peered":"2024-09-21T09:11:06.894677+0000","last_unstale":"2024-09-21T09:11:07.858265+0000","last_undegraded":"2024-09-21T09:11:07.858265+0000","last_fullsized":"2024-09-21T09:11:07.858265+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:20.449346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875410+0000","last_change":"2024-09-21T09:10:58.837602+0000","last_active":"2024-09-21T09:11:07.875410+0000","last_peered":"2024-09-21T09:11:07.875410+0000","last_clean":"2024-09-21T09:11:07.875410+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:11:07.875410+0000","last_undegraded":"2024-09-21T09:11:07.875410+0000","last_fullsized":"2024-09-21T09:11:07.875410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:36.269116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886673+0000","last_change":"2024-09-21T09:10:56.844292+0000","last_active":"2024-09-21T09:11:07.886673+0000","last_peered":"2024-09-21T09:11:07.886673+0000","last_clean":"2024-09-21T09:11:07.886673+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:11:07.886673+0000","last_undegraded":"2024-09-21T09:11:07.886673+0000","last_fullsized":"2024-09-21T09:11:07.886673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918367+0000","last_change":"2024-09-21T09:11:00.852984+0000","last_active":"2024-09-21T09:11:07.918367+0000","last_peered":"2024-09-21T09:11:07.918367+0000","last_clean":"2024-09-21T09:11:07.918367+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:11:07.918367+0000","last_undegraded":"2024-09-21T09:11:07.918367+0000","last_fullsized":"2024-09-21T09:11:07.918367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:33.175145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.719267+0000","last_change":"2024-09-21T09:11:02.878317+0000","last_active":"2024-09-21T09:11:08.719267+0000","last_peered":"2024-09-21T09:11:08.719267+0000","last_clean":"2024-09-21T09:11:08.719267+0000","last_became_active":"2024-09-21T09:11:02.877537+0000","last_became_peered":"2024-09-21T09:11:02.877537+0000","last_unstale":"2024-09-21T09:11:08.719267+0000","last_undegraded":"2024-09-21T09:11:08.719267+0000","last_fullsized":"2024-09-21T09:11:08.719267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:23.147293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874181+0000","last_change":"2024-09-21T09:11:04.894947+0000","last_active":"2024-09-21T09:11:07.874181+0000","last_peered":"2024-09-21T09:11:07.874181+0000","last_clean":"2024-09-21T09:11:07.874181+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:11:07.874181+0000","last_undegraded":"2024-09-21T09:11:07.874181+0000","last_fullsized":"2024-09-21T09:11:07.874181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:21.481386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917278+0000","last_change":"2024-09-21T09:10:58.841384+0000","last_active":"2024-09-21T09:11:07.917278+0000","last_peered":"2024-09-21T09:11:07.917278+0000","last_clean":"2024-09-21T09:11:07.917278+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:11:07.917278+0000","last_undegraded":"2024-09-21T09:11:07.917278+0000","last_fullsized":"2024-09-21T09:11:07.917278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:08.308265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.864852+0000","last_change":"2024-09-21T09:10:56.846710+0000","last_active":"2024-09-21T09:11:07.864852+0000","last_peered":"2024-09-21T09:11:07.864852+0000","last_clean":"2024-09-21T09:11:07.864852+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:11:07.864852+0000","last_undegraded":"2024-09-21T09:11:07.864852+0000","last_fullsized":"2024-09-21T09:11:07.864852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885709+0000","last_change":"2024-09-21T09:11:00.839560+0000","last_active":"2024-09-21T09:11:07.885709+0000","last_peered":"2024-09-21T09:11:07.885709+0000","last_clean":"2024-09-21T09:11:07.885709+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:11:07.885709+0000","last_undegraded":"2024-09-21T09:11:07.885709+0000","last_fullsized":"2024-09-21T09:11:07.885709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:41.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'19","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.819908+0000","last_change":"2024-09-21T09:11:02.872323+0000","last_active":"2024-09-21T09:11:08.819908+0000","last_peered":"2024-09-21T09:11:08.819908+0000","last_clean":"2024-09-21T09:11:08.819908+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:11:08.819908+0000","last_undegraded":"2024-09-21T09:11:08.819908+0000","last_fullsized":"2024-09-21T09:11:08.819908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860330+0000","last_change":"2024-09-21T09:11:04.886593+0000","last_active":"2024-09-21T09:11:07.860330+0000","last_peered":"2024-09-21T09:11:07.860330+0000","last_clean":"2024-09-21T09:11:07.860330+0000","last_became_active":"2024-09-21T09:11:04.886030+0000","last_became_peered":"2024-09-21T09:11:04.886030+0000","last_unstale":"2024-09-21T09:11:07.860330+0000","last_undegraded":"2024-09-21T09:11:07.860330+0000","last_fullsized":"2024-09-21T09:11:07.860330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:09.002676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859374+0000","last_change":"2024-09-21T09:11:06.892001+0000","last_active":"2024-09-21T09:11:07.859374+0000","last_peered":"2024-09-21T09:11:07.859374+0000","last_clean":"2024-09-21T09:11:07.859374+0000","last_became_active":"2024-09-21T09:11:06.891156+0000","last_became_peered":"2024-09-21T09:11:06.891156+0000","last_unstale":"2024-09-21T09:11:07.859374+0000","last_undegraded":"2024-09-21T09:11:07.859374+0000","last_fullsized":"2024-09-21T09:11:07.859374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886013+0000","last_change":"2024-09-21T09:10:58.839960+0000","last_active":"2024-09-21T09:11:07.886013+0000","last_peered":"2024-09-21T09:11:07.886013+0000","last_clean":"2024-09-21T09:11:07.886013+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:11:07.886013+0000","last_undegraded":"2024-09-21T09:11:07.886013+0000","last_fullsized":"2024-09-21T09:11:07.886013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862328+0000","last_change":"2024-09-21T09:10:56.865060+0000","last_active":"2024-09-21T09:11:07.862328+0000","last_peered":"2024-09-21T09:11:07.862328+0000","last_clean":"2024-09-21T09:11:07.862328+0000","last_became_active":"2024-09-21T09:10:56.851666+0000","last_became_peered":"2024-09-21T09:10:56.851666+0000","last_unstale":"2024-09-21T09:11:07.862328+0000","last_undegraded":"2024-09-21T09:11:07.862328+0000","last_fullsized":"2024-09-21T09:11:07.862328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859495+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:11:07.859495+0000","last_peered":"2024-09-21T09:11:07.859495+0000","last_clean":"2024-09-21T09:11:07.859495+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:11:07.859495+0000","last_undegraded":"2024-09-21T09:11:07.859495+0000","last_fullsized":"2024-09-21T09:11:07.859495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:48.669684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.691078+0000","last_change":"2024-09-21T09:11:02.866165+0000","last_active":"2024-09-21T09:11:08.691078+0000","last_peered":"2024-09-21T09:11:08.691078+0000","last_clean":"2024-09-21T09:11:08.691078+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:11:08.691078+0000","last_undegraded":"2024-09-21T09:11:08.691078+0000","last_fullsized":"2024-09-21T09:11:08.691078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:54:48.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877248+0000","last_change":"2024-09-21T09:11:04.871999+0000","last_active":"2024-09-21T09:11:07.877248+0000","last_peered":"2024-09-21T09:11:07.877248+0000","last_clean":"2024-09-21T09:11:07.877248+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:11:07.877248+0000","last_undegraded":"2024-09-21T09:11:07.877248+0000","last_fullsized":"2024-09-21T09:11:07.877248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:03.218684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885937+0000","last_change":"2024-09-21T09:11:06.888476+0000","last_active":"2024-09-21T09:11:07.885937+0000","last_peered":"2024-09-21T09:11:07.885937+0000","last_clean":"2024-09-21T09:11:07.885937+0000","last_became_active":"2024-09-21T09:11:06.887587+0000","last_became_peered":"2024-09-21T09:11:06.887587+0000","last_unstale":"2024-09-21T09:11:07.885937+0000","last_undegraded":"2024-09-21T09:11:07.885937+0000","last_fullsized":"2024-09-21T09:11:07.885937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:44.751998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.858161+0000","last_change":"2024-09-21T09:10:58.844864+0000","last_active":"2024-09-21T09:11:07.858161+0000","last_peered":"2024-09-21T09:11:07.858161+0000","last_clean":"2024-09-21T09:11:07.858161+0000","last_became_active":"2024-09-21T09:10:58.844473+0000","last_became_peered":"2024-09-21T09:10:58.844473+0000","last_unstale":"2024-09-21T09:11:07.858161+0000","last_undegraded":"2024-09-21T09:11:07.858161+0000","last_fullsized":"2024-09-21T09:11:07.858161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918775+0000","last_change":"2024-09-21T09:10:56.842697+0000","last_active":"2024-09-21T09:11:07.918775+0000","last_peered":"2024-09-21T09:11:07.918775+0000","last_clean":"2024-09-21T09:11:07.918775+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:11:07.918775+0000","last_undegraded":"2024-09-21T09:11:07.918775+0000","last_fullsized":"2024-09-21T09:11:07.918775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:42.311166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873152+0000","last_change":"2024-09-21T09:11:00.852970+0000","last_active":"2024-09-21T09:11:07.873152+0000","last_peered":"2024-09-21T09:11:07.873152+0000","last_clean":"2024-09-21T09:11:07.873152+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:11:07.873152+0000","last_undegraded":"2024-09-21T09:11:07.873152+0000","last_fullsized":"2024-09-21T09:11:07.873152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:35.201984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"36'15","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.601523+0000","last_change":"2024-09-21T09:11:02.859081+0000","last_active":"2024-09-21T09:11:08.601523+0000","last_peered":"2024-09-21T09:11:08.601523+0000","last_clean":"2024-09-21T09:11:08.601523+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:11:08.601523+0000","last_undegraded":"2024-09-21T09:11:08.601523+0000","last_fullsized":"2024-09-21T09:11:08.601523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:19.576627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872379+0000","last_change":"2024-09-21T09:11:04.895980+0000","last_active":"2024-09-21T09:11:07.872379+0000","last_peered":"2024-09-21T09:11:07.872379+0000","last_clean":"2024-09-21T09:11:07.872379+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:11:07.872379+0000","last_undegraded":"2024-09-21T09:11:07.872379+0000","last_fullsized":"2024-09-21T09:11:07.872379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:57.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861986+0000","last_change":"2024-09-21T09:11:06.890295+0000","last_active":"2024-09-21T09:11:07.861986+0000","last_peered":"2024-09-21T09:11:07.861986+0000","last_clean":"2024-09-21T09:11:07.861986+0000","last_became_active":"2024-09-21T09:11:06.889522+0000","last_became_peered":"2024-09-21T09:11:06.889522+0000","last_unstale":"2024-09-21T09:11:07.861986+0000","last_undegraded":"2024-09-21T09:11:07.861986+0000","last_fullsized":"2024-09-21T09:11:07.861986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:02.337068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874028+0000","last_change":"2024-09-21T09:10:58.871951+0000","last_active":"2024-09-21T09:11:07.874028+0000","last_peered":"2024-09-21T09:11:07.874028+0000","last_clean":"2024-09-21T09:11:07.874028+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:11:07.874028+0000","last_undegraded":"2024-09-21T09:11:07.874028+0000","last_fullsized":"2024-09-21T09:11:07.874028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:16.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863329+0000","last_change":"2024-09-21T09:10:56.855073+0000","last_active":"2024-09-21T09:11:07.863329+0000","last_peered":"2024-09-21T09:11:07.863329+0000","last_clean":"2024-09-21T09:11:07.863329+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:11:07.863329+0000","last_undegraded":"2024-09-21T09:11:07.863329+0000","last_fullsized":"2024-09-21T09:11:07.863329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:43.818365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860105+0000","last_change":"2024-09-21T09:11:00.845552+0000","last_active":"2024-09-21T09:11:07.860105+0000","last_peered":"2024-09-21T09:11:07.860105+0000","last_clean":"2024-09-21T09:11:07.860105+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:11:07.860105+0000","last_undegraded":"2024-09-21T09:11:07.860105+0000","last_fullsized":"2024-09-21T09:11:07.860105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:44.841947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"36'12","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.222737+0000","last_change":"2024-09-21T09:11:02.868260+0000","last_active":"2024-09-21T09:11:08.222737+0000","last_peered":"2024-09-21T09:11:08.222737+0000","last_clean":"2024-09-21T09:11:08.222737+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:11:08.222737+0000","last_undegraded":"2024-09-21T09:11:08.222737+0000","last_fullsized":"2024-09-21T09:11:08.222737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:38.299285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873176+0000","last_change":"2024-09-21T09:11:04.890815+0000","last_active":"2024-09-21T09:11:07.873176+0000","last_peered":"2024-09-21T09:11:07.873176+0000","last_clean":"2024-09-21T09:11:07.873176+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:11:07.873176+0000","last_undegraded":"2024-09-21T09:11:07.873176+0000","last_fullsized":"2024-09-21T09:11:07.873176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:26.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892269+0000","last_change":"2024-09-21T09:11:06.888148+0000","last_active":"2024-09-21T09:11:07.892269+0000","last_peered":"2024-09-21T09:11:07.892269+0000","last_clean":"2024-09-21T09:11:07.892269+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:11:07.892269+0000","last_undegraded":"2024-09-21T09:11:07.892269+0000","last_fullsized":"2024-09-21T09:11:07.892269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862967+0000","last_change":"2024-09-21T09:10:58.871840+0000","last_active":"2024-09-21T09:11:07.862967+0000","last_peered":"2024-09-21T09:11:07.862967+0000","last_clean":"2024-09-21T09:11:07.862967+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:11:07.862967+0000","last_undegraded":"2024-09-21T09:11:07.862967+0000","last_fullsized":"2024-09-21T09:11:07.862967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891863+0000","last_change":"2024-09-21T09:10:56.855886+0000","last_active":"2024-09-21T09:11:07.891863+0000","last_peered":"2024-09-21T09:11:07.891863+0000","last_clean":"2024-09-21T09:11:07.891863+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:11:07.891863+0000","last_undegraded":"2024-09-21T09:11:07.891863+0000","last_fullsized":"2024-09-21T09:11:07.891863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891220+0000","last_change":"2024-09-21T09:11:00.850308+0000","last_active":"2024-09-21T09:11:07.891220+0000","last_peered":"2024-09-21T09:11:07.891220+0000","last_clean":"2024-09-21T09:11:07.891220+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:11:07.891220+0000","last_undegraded":"2024-09-21T09:11:07.891220+0000","last_fullsized":"2024-09-21T09:11:07.891220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:13.608546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"36'11","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.754747+0000","last_change":"2024-09-21T09:11:02.866122+0000","last_active":"2024-09-21T09:11:08.754747+0000","last_peered":"2024-09-21T09:11:08.754747+0000","last_clean":"2024-09-21T09:11:08.754747+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:11:08.754747+0000","last_undegraded":"2024-09-21T09:11:08.754747+0000","last_fullsized":"2024-09-21T09:11:08.754747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892034+0000","last_change":"2024-09-21T09:11:04.880608+0000","last_active":"2024-09-21T09:11:07.892034+0000","last_peered":"2024-09-21T09:11:07.892034+0000","last_clean":"2024-09-21T09:11:07.892034+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:11:07.892034+0000","last_undegraded":"2024-09-21T09:11:07.892034+0000","last_fullsized":"2024-09-21T09:11:07.892034+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:39.226968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872131+0000","last_change":"2024-09-21T09:11:06.892201+0000","last_active":"2024-09-21T09:11:07.872131+0000","last_peered":"2024-09-21T09:11:07.872131+0000","last_clean":"2024-09-21T09:11:07.872131+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:11:07.872131+0000","last_undegraded":"2024-09-21T09:11:07.872131+0000","last_fullsized":"2024-09-21T09:11:07.872131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:32.463353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919867+0000","last_change":"2024-09-21T09:10:58.838223+0000","last_active":"2024-09-21T09:11:07.919867+0000","last_peered":"2024-09-21T09:11:07.919867+0000","last_clean":"2024-09-21T09:11:07.919867+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:11:07.919867+0000","last_undegraded":"2024-09-21T09:11:07.919867+0000","last_fullsized":"2024-09-21T09:11:07.919867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:01.253234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918668+0000","last_change":"2024-09-21T09:10:56.841106+0000","last_active":"2024-09-21T09:11:07.918668+0000","last_peered":"2024-09-21T09:11:07.918668+0000","last_clean":"2024-09-21T09:11:07.918668+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:11:07.918668+0000","last_undegraded":"2024-09-21T09:11:07.918668+0000","last_fullsized":"2024-09-21T09:11:07.918668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:40.827746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873468+0000","last_change":"2024-09-21T09:11:00.841164+0000","last_active":"2024-09-21T09:11:07.873468+0000","last_peered":"2024-09-21T09:11:07.873468+0000","last_clean":"2024-09-21T09:11:07.873468+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:11:07.873468+0000","last_undegraded":"2024-09-21T09:11:07.873468+0000","last_fullsized":"2024-09-21T09:11:07.873468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:05.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"36'15","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.829827+0000","last_change":"2024-09-21T09:11:02.852292+0000","last_active":"2024-09-21T09:11:08.829827+0000","last_peered":"2024-09-21T09:11:08.829827+0000","last_clean":"2024-09-21T09:11:08.829827+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:11:08.829827+0000","last_undegraded":"2024-09-21T09:11:08.829827+0000","last_fullsized":"2024-09-21T09:11:08.829827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:12.322229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891842+0000","last_change":"2024-09-21T09:11:04.892391+0000","last_active":"2024-09-21T09:11:07.891842+0000","last_peered":"2024-09-21T09:11:07.891842+0000","last_clean":"2024-09-21T09:11:07.891842+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:11:07.891842+0000","last_undegraded":"2024-09-21T09:11:07.891842+0000","last_fullsized":"2024-09-21T09:11:07.891842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:52.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859871+0000","last_change":"2024-09-21T09:11:06.883898+0000","last_active":"2024-09-21T09:11:07.859871+0000","last_peered":"2024-09-21T09:11:07.859871+0000","last_clean":"2024-09-21T09:11:07.859871+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:11:07.859871+0000","last_undegraded":"2024-09-21T09:11:07.859871+0000","last_fullsized":"2024-09-21T09:11:07.859871+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861295+0000","last_change":"2024-09-21T09:10:58.837935+0000","last_active":"2024-09-21T09:11:07.861295+0000","last_peered":"2024-09-21T09:11:07.861295+0000","last_clean":"2024-09-21T09:11:07.861295+0000","last_became_active":"2024-09-21T09:10:58.837642+0000","last_became_peered":"2024-09-21T09:10:58.837642+0000","last_unstale":"2024-09-21T09:11:07.861295+0000","last_undegraded":"2024-09-21T09:11:07.861295+0000","last_fullsized":"2024-09-21T09:11:07.861295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:30.880333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917989+0000","last_change":"2024-09-21T09:10:56.844590+0000","last_active":"2024-09-21T09:11:07.917989+0000","last_peered":"2024-09-21T09:11:07.917989+0000","last_clean":"2024-09-21T09:11:07.917989+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:11:07.917989+0000","last_undegraded":"2024-09-21T09:11:07.917989+0000","last_fullsized":"2024-09-21T09:11:07.917989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:20.839825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887676+0000","last_change":"2024-09-21T09:11:00.839056+0000","last_active":"2024-09-21T09:11:07.887676+0000","last_peered":"2024-09-21T09:11:07.887676+0000","last_clean":"2024-09-21T09:11:07.887676+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:11:07.887676+0000","last_undegraded":"2024-09-21T09:11:07.887676+0000","last_fullsized":"2024-09-21T09:11:07.887676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:07.991734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.610824+0000","last_change":"2024-09-21T09:11:02.876439+0000","last_active":"2024-09-21T09:11:08.610824+0000","last_peered":"2024-09-21T09:11:08.610824+0000","last_clean":"2024-09-21T09:11:08.610824+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:11:08.610824+0000","last_undegraded":"2024-09-21T09:11:08.610824+0000","last_fullsized":"2024-09-21T09:11:08.610824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886756+0000","last_change":"2024-09-21T09:11:04.884790+0000","last_active":"2024-09-21T09:11:07.886756+0000","last_peered":"2024-09-21T09:11:07.886756+0000","last_clean":"2024-09-21T09:11:07.886756+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:11:07.886756+0000","last_undegraded":"2024-09-21T09:11:07.886756+0000","last_fullsized":"2024-09-21T09:11:07.886756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:00.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857883+0000","last_change":"2024-09-21T09:11:06.887820+0000","last_active":"2024-09-21T09:11:07.857883+0000","last_peered":"2024-09-21T09:11:07.857883+0000","last_clean":"2024-09-21T09:11:07.857883+0000","last_became_active":"2024-09-21T09:11:06.886984+0000","last_became_peered":"2024-09-21T09:11:06.886984+0000","last_unstale":"2024-09-21T09:11:07.857883+0000","last_undegraded":"2024-09-21T09:11:07.857883+0000","last_fullsized":"2024-09-21T09:11:07.857883+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:09.296705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892688+0000","last_change":"2024-09-21T09:10:58.873730+0000","last_active":"2024-09-21T09:11:07.892688+0000","last_peered":"2024-09-21T09:11:07.892688+0000","last_clean":"2024-09-21T09:11:07.892688+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:11:07.892688+0000","last_undegraded":"2024-09-21T09:11:07.892688+0000","last_fullsized":"2024-09-21T09:11:07.892688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877889+0000","last_change":"2024-09-21T09:10:56.849104+0000","last_active":"2024-09-21T09:11:07.877889+0000","last_peered":"2024-09-21T09:11:07.877889+0000","last_clean":"2024-09-21T09:11:07.877889+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:11:07.877889+0000","last_undegraded":"2024-09-21T09:11:07.877889+0000","last_fullsized":"2024-09-21T09:11:07.877889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:34.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918861+0000","last_change":"2024-09-21T09:11:00.841893+0000","last_active":"2024-09-21T09:11:07.918861+0000","last_peered":"2024-09-21T09:11:07.918861+0000","last_clean":"2024-09-21T09:11:07.918861+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:11:07.918861+0000","last_undegraded":"2024-09-21T09:11:07.918861+0000","last_fullsized":"2024-09-21T09:11:07.918861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:55.253483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'17","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.747430+0000","last_change":"2024-09-21T09:11:02.867833+0000","last_active":"2024-09-21T09:11:08.747430+0000","last_peered":"2024-09-21T09:11:08.747430+0000","last_clean":"2024-09-21T09:11:08.747430+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:11:08.747430+0000","last_undegraded":"2024-09-21T09:11:08.747430+0000","last_fullsized":"2024-09-21T09:11:08.747430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860111+0000","last_change":"2024-09-21T09:11:04.890721+0000","last_active":"2024-09-21T09:11:07.860111+0000","last_peered":"2024-09-21T09:11:07.860111+0000","last_clean":"2024-09-21T09:11:07.860111+0000","last_became_active":"2024-09-21T09:11:04.889444+0000","last_became_peered":"2024-09-21T09:11:04.889444+0000","last_unstale":"2024-09-21T09:11:07.860111+0000","last_undegraded":"2024-09-21T09:11:07.860111+0000","last_fullsized":"2024-09-21T09:11:07.860111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:39.226968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890722+0000","last_change":"2024-09-21T09:11:06.883751+0000","last_active":"2024-09-21T09:11:07.890722+0000","last_peered":"2024-09-21T09:11:07.890722+0000","last_clean":"2024-09-21T09:11:07.890722+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:11:07.890722+0000","last_undegraded":"2024-09-21T09:11:07.890722+0000","last_fullsized":"2024-09-21T09:11:07.890722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:09.296705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918972+0000","last_change":"2024-09-21T09:10:58.838888+0000","last_active":"2024-09-21T09:11:07.918972+0000","last_peered":"2024-09-21T09:11:07.918972+0000","last_clean":"2024-09-21T09:11:07.918972+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:11:07.918972+0000","last_undegraded":"2024-09-21T09:11:07.918972+0000","last_fullsized":"2024-09-21T09:11:07.918972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:53.547541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":196,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886954+0000","last_change":"2024-09-21T09:10:44.726458+0000","last_active":"2024-09-21T09:11:07.886954+0000","last_peered":"2024-09-21T09:11:07.886954+0000","last_clean":"2024-09-21T09:11:07.886954+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:11:07.886954+0000","last_undegraded":"2024-09-21T09:11:07.886954+0000","last_fullsized":"2024-09-21T09:11:07.886954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_clean_scrub_stamp":"2024-09-21T09:10:43.702491+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:07.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917895+0000","last_change":"2024-09-21T09:10:50.784701+0000","last_active":"2024-09-21T09:11:07.917895+0000","last_peered":"2024-09-21T09:11:07.917895+0000","last_clean":"2024-09-21T09:11:07.917895+0000","last_became_active":"2024-09-21T09:10:48.763536+0000","last_became_peered":"2024-09-21T09:10:48.763536+0000","last_unstale":"2024-09-21T09:11:07.917895+0000","last_undegraded":"2024-09-21T09:11:07.917895+0000","last_fullsized":"2024-09-21T09:11:07.917895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:24.622195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878733+0000","last_change":"2024-09-21T09:10:56.830300+0000","last_active":"2024-09-21T09:11:07.878733+0000","last_peered":"2024-09-21T09:11:07.878733+0000","last_clean":"2024-09-21T09:11:07.878733+0000","last_became_active":"2024-09-21T09:10:56.829179+0000","last_became_peered":"2024-09-21T09:10:56.829179+0000","last_unstale":"2024-09-21T09:11:07.878733+0000","last_undegraded":"2024-09-21T09:11:07.878733+0000","last_fullsized":"2024-09-21T09:11:07.878733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:38.639861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861984+0000","last_change":"2024-09-21T09:11:00.845448+0000","last_active":"2024-09-21T09:11:07.861984+0000","last_peered":"2024-09-21T09:11:07.861984+0000","last_clean":"2024-09-21T09:11:07.861984+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:11:07.861984+0000","last_undegraded":"2024-09-21T09:11:07.861984+0000","last_fullsized":"2024-09-21T09:11:07.861984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"36'13","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.538084+0000","last_change":"2024-09-21T09:11:02.863275+0000","last_active":"2024-09-21T09:11:08.538084+0000","last_peered":"2024-09-21T09:11:08.538084+0000","last_clean":"2024-09-21T09:11:08.538084+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:11:08.538084+0000","last_undegraded":"2024-09-21T09:11:08.538084+0000","last_fullsized":"2024-09-21T09:11:08.538084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:39.968749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874817+0000","last_change":"2024-09-21T09:11:04.894538+0000","last_active":"2024-09-21T09:11:07.874817+0000","last_peered":"2024-09-21T09:11:07.874817+0000","last_clean":"2024-09-21T09:11:07.874817+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:11:07.874817+0000","last_undegraded":"2024-09-21T09:11:07.874817+0000","last_fullsized":"2024-09-21T09:11:07.874817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.154030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861304+0000","last_change":"2024-09-21T09:11:06.891095+0000","last_active":"2024-09-21T09:11:07.861304+0000","last_peered":"2024-09-21T09:11:07.861304+0000","last_clean":"2024-09-21T09:11:07.861304+0000","last_became_active":"2024-09-21T09:11:06.890235+0000","last_became_peered":"2024-09-21T09:11:06.890235+0000","last_unstale":"2024-09-21T09:11:07.861304+0000","last_undegraded":"2024-09-21T09:11:07.861304+0000","last_fullsized":"2024-09-21T09:11:07.861304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875154+0000","last_change":"2024-09-21T09:10:58.855489+0000","last_active":"2024-09-21T09:11:07.875154+0000","last_peered":"2024-09-21T09:11:07.875154+0000","last_clean":"2024-09-21T09:11:07.875154+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:11:07.875154+0000","last_undegraded":"2024-09-21T09:11:07.875154+0000","last_fullsized":"2024-09-21T09:11:07.875154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:04.859633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917709+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:11:07.917709+0000","last_peered":"2024-09-21T09:11:07.917709+0000","last_clean":"2024-09-21T09:11:07.917709+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:11:07.917709+0000","last_undegraded":"2024-09-21T09:11:07.917709+0000","last_fullsized":"2024-09-21T09:11:07.917709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:09.405380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860547+0000","last_change":"2024-09-21T09:10:56.862992+0000","last_active":"2024-09-21T09:11:07.860547+0000","last_peered":"2024-09-21T09:11:07.860547+0000","last_clean":"2024-09-21T09:11:07.860547+0000","last_became_active":"2024-09-21T09:10:56.862302+0000","last_became_peered":"2024-09-21T09:10:56.862302+0000","last_unstale":"2024-09-21T09:11:07.860547+0000","last_undegraded":"2024-09-21T09:11:07.860547+0000","last_fullsized":"2024-09-21T09:11:07.860547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918024+0000","last_change":"2024-09-21T09:11:00.845917+0000","last_active":"2024-09-21T09:11:07.918024+0000","last_peered":"2024-09-21T09:11:07.918024+0000","last_clean":"2024-09-21T09:11:07.918024+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:11:07.918024+0000","last_undegraded":"2024-09-21T09:11:07.918024+0000","last_fullsized":"2024-09-21T09:11:07.918024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:59.152254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'23","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.738848+0000","last_change":"2024-09-21T09:11:02.871422+0000","last_active":"2024-09-21T09:11:08.738848+0000","last_peered":"2024-09-21T09:11:08.738848+0000","last_clean":"2024-09-21T09:11:08.738848+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:11:08.738848+0000","last_undegraded":"2024-09-21T09:11:08.738848+0000","last_fullsized":"2024-09-21T09:11:08.738848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:57.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919701+0000","last_change":"2024-09-21T09:11:04.893734+0000","last_active":"2024-09-21T09:11:07.919701+0000","last_peered":"2024-09-21T09:11:07.919701+0000","last_clean":"2024-09-21T09:11:07.919701+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:11:07.919701+0000","last_undegraded":"2024-09-21T09:11:07.919701+0000","last_fullsized":"2024-09-21T09:11:07.919701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.709917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873529+0000","last_change":"2024-09-21T09:11:06.895362+0000","last_active":"2024-09-21T09:11:07.873529+0000","last_peered":"2024-09-21T09:11:07.873529+0000","last_clean":"2024-09-21T09:11:07.873529+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:11:07.873529+0000","last_undegraded":"2024-09-21T09:11:07.873529+0000","last_fullsized":"2024-09-21T09:11:07.873529+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:23.606134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862492+0000","last_change":"2024-09-21T09:10:58.831552+0000","last_active":"2024-09-21T09:11:07.862492+0000","last_peered":"2024-09-21T09:11:07.862492+0000","last_clean":"2024-09-21T09:11:07.862492+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:11:07.862492+0000","last_undegraded":"2024-09-21T09:11:07.862492+0000","last_fullsized":"2024-09-21T09:11:07.862492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890456+0000","last_change":"2024-09-21T09:10:51.587265+0000","last_active":"2024-09-21T09:11:07.890456+0000","last_peered":"2024-09-21T09:11:07.890456+0000","last_clean":"2024-09-21T09:11:07.890456+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:11:07.890456+0000","last_undegraded":"2024-09-21T09:11:07.890456+0000","last_fullsized":"2024-09-21T09:11:07.890456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872905+0000","last_change":"2024-09-21T09:10:56.866005+0000","last_active":"2024-09-21T09:11:07.872905+0000","last_peered":"2024-09-21T09:11:07.872905+0000","last_clean":"2024-09-21T09:11:07.872905+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:11:07.872905+0000","last_undegraded":"2024-09-21T09:11:07.872905+0000","last_fullsized":"2024-09-21T09:11:07.872905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891995+0000","last_change":"2024-09-21T09:11:00.850206+0000","last_active":"2024-09-21T09:11:07.891995+0000","last_peered":"2024-09-21T09:11:07.891995+0000","last_clean":"2024-09-21T09:11:07.891995+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:11:07.891995+0000","last_undegraded":"2024-09-21T09:11:07.891995+0000","last_fullsized":"2024-09-21T09:11:07.891995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:26.137691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.743648+0000","last_change":"2024-09-21T09:11:02.873117+0000","last_active":"2024-09-21T09:11:08.743648+0000","last_peered":"2024-09-21T09:11:08.743648+0000","last_clean":"2024-09-21T09:11:08.743648+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:11:08.743648+0000","last_undegraded":"2024-09-21T09:11:08.743648+0000","last_fullsized":"2024-09-21T09:11:08.743648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879516+0000","last_change":"2024-09-21T09:11:04.873369+0000","last_active":"2024-09-21T09:11:07.879516+0000","last_peered":"2024-09-21T09:11:07.879516+0000","last_clean":"2024-09-21T09:11:07.879516+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:11:07.879516+0000","last_undegraded":"2024-09-21T09:11:07.879516+0000","last_fullsized":"2024-09-21T09:11:07.879516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.868816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877621+0000","last_change":"2024-09-21T09:11:06.896298+0000","last_active":"2024-09-21T09:11:07.877621+0000","last_peered":"2024-09-21T09:11:07.877621+0000","last_clean":"2024-09-21T09:11:07.877621+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:11:07.877621+0000","last_undegraded":"2024-09-21T09:11:07.877621+0000","last_fullsized":"2024-09-21T09:11:07.877621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:42.784843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861573+0000","last_change":"2024-09-21T09:10:58.838558+0000","last_active":"2024-09-21T09:11:07.861573+0000","last_peered":"2024-09-21T09:11:07.861573+0000","last_clean":"2024-09-21T09:11:07.861573+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:11:07.861573+0000","last_undegraded":"2024-09-21T09:11:07.861573+0000","last_fullsized":"2024-09-21T09:11:07.861573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919560+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:11:07.919560+0000","last_peered":"2024-09-21T09:11:07.919560+0000","last_clean":"2024-09-21T09:11:07.919560+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:11:07.919560+0000","last_undegraded":"2024-09-21T09:11:07.919560+0000","last_fullsized":"2024-09-21T09:11:07.919560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:07.894252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862899+0000","last_change":"2024-09-21T09:10:56.860578+0000","last_active":"2024-09-21T09:11:07.862899+0000","last_peered":"2024-09-21T09:11:07.862899+0000","last_clean":"2024-09-21T09:11:07.862899+0000","last_became_active":"2024-09-21T09:10:56.859985+0000","last_became_peered":"2024-09-21T09:10:56.859985+0000","last_unstale":"2024-09-21T09:11:07.862899+0000","last_undegraded":"2024-09-21T09:11:07.862899+0000","last_fullsized":"2024-09-21T09:11:07.862899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891301+0000","last_change":"2024-09-21T09:11:00.852944+0000","last_active":"2024-09-21T09:11:07.891301+0000","last_peered":"2024-09-21T09:11:07.891301+0000","last_clean":"2024-09-21T09:11:07.891301+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:11:07.891301+0000","last_undegraded":"2024-09-21T09:11:07.891301+0000","last_fullsized":"2024-09-21T09:11:07.891301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:24.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.575963+0000","last_change":"2024-09-21T09:11:02.856485+0000","last_active":"2024-09-21T09:11:08.575963+0000","last_peered":"2024-09-21T09:11:08.575963+0000","last_clean":"2024-09-21T09:11:08.575963+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:11:08.575963+0000","last_undegraded":"2024-09-21T09:11:08.575963+0000","last_fullsized":"2024-09-21T09:11:08.575963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:05.267197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918854+0000","last_change":"2024-09-21T09:11:04.880602+0000","last_active":"2024-09-21T09:11:07.918854+0000","last_peered":"2024-09-21T09:11:07.918854+0000","last_clean":"2024-09-21T09:11:07.918854+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:11:07.918854+0000","last_undegraded":"2024-09-21T09:11:07.918854+0000","last_fullsized":"2024-09-21T09:11:07.918854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:56.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885116+0000","last_change":"2024-09-21T09:11:06.869065+0000","last_active":"2024-09-21T09:11:07.885116+0000","last_peered":"2024-09-21T09:11:07.885116+0000","last_clean":"2024-09-21T09:11:07.885116+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:11:07.885116+0000","last_undegraded":"2024-09-21T09:11:07.885116+0000","last_fullsized":"2024-09-21T09:11:07.885116+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:28.667296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860321+0000","last_change":"2024-09-21T09:10:58.846835+0000","last_active":"2024-09-21T09:11:07.860321+0000","last_peered":"2024-09-21T09:11:07.860321+0000","last_clean":"2024-09-21T09:11:07.860321+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:11:07.860321+0000","last_undegraded":"2024-09-21T09:11:07.860321+0000","last_fullsized":"2024-09-21T09:11:07.860321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861214+0000","last_change":"2024-09-21T09:10:56.858275+0000","last_active":"2024-09-21T09:11:07.861214+0000","last_peered":"2024-09-21T09:11:07.861214+0000","last_clean":"2024-09-21T09:11:07.861214+0000","last_became_active":"2024-09-21T09:10:56.851223+0000","last_became_peered":"2024-09-21T09:10:56.851223+0000","last_unstale":"2024-09-21T09:11:07.861214+0000","last_undegraded":"2024-09-21T09:11:07.861214+0000","last_fullsized":"2024-09-21T09:11:07.861214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874368+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:11:07.874368+0000","last_peered":"2024-09-21T09:11:07.874368+0000","last_clean":"2024-09-21T09:11:07.874368+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:11:07.874368+0000","last_undegraded":"2024-09-21T09:11:07.874368+0000","last_fullsized":"2024-09-21T09:11:07.874368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878504+0000","last_change":"2024-09-21T09:11:00.855241+0000","last_active":"2024-09-21T09:11:07.878504+0000","last_peered":"2024-09-21T09:11:07.878504+0000","last_clean":"2024-09-21T09:11:07.878504+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:11:07.878504+0000","last_undegraded":"2024-09-21T09:11:07.878504+0000","last_fullsized":"2024-09-21T09:11:07.878504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:56:14.401301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"36'18","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.669526+0000","last_change":"2024-09-21T09:11:02.864623+0000","last_active":"2024-09-21T09:11:08.669526+0000","last_peered":"2024-09-21T09:11:08.669526+0000","last_clean":"2024-09-21T09:11:08.669526+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:11:08.669526+0000","last_undegraded":"2024-09-21T09:11:08.669526+0000","last_fullsized":"2024-09-21T09:11:08.669526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:12.141735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857779+0000","last_change":"2024-09-21T09:11:04.890355+0000","last_active":"2024-09-21T09:11:07.857779+0000","last_peered":"2024-09-21T09:11:07.857779+0000","last_clean":"2024-09-21T09:11:07.857779+0000","last_became_active":"2024-09-21T09:11:04.889578+0000","last_became_peered":"2024-09-21T09:11:04.889578+0000","last_unstale":"2024-09-21T09:11:07.857779+0000","last_undegraded":"2024-09-21T09:11:07.857779+0000","last_fullsized":"2024-09-21T09:11:07.857779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:54.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874804+0000","last_change":"2024-09-21T09:11:06.896833+0000","last_active":"2024-09-21T09:11:07.874804+0000","last_peered":"2024-09-21T09:11:07.874804+0000","last_clean":"2024-09-21T09:11:07.874804+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:11:07.874804+0000","last_undegraded":"2024-09-21T09:11:07.874804+0000","last_fullsized":"2024-09-21T09:11:07.874804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:38.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860990+0000","last_change":"2024-09-21T09:10:58.825808+0000","last_active":"2024-09-21T09:11:07.860990+0000","last_peered":"2024-09-21T09:11:07.860990+0000","last_clean":"2024-09-21T09:11:07.860990+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:11:07.860990+0000","last_undegraded":"2024-09-21T09:11:07.860990+0000","last_fullsized":"2024-09-21T09:11:07.860990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861807+0000","last_change":"2024-09-21T09:10:56.851643+0000","last_active":"2024-09-21T09:11:07.861807+0000","last_peered":"2024-09-21T09:11:07.861807+0000","last_clean":"2024-09-21T09:11:07.861807+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:11:07.861807+0000","last_undegraded":"2024-09-21T09:11:07.861807+0000","last_fullsized":"2024-09-21T09:11:07.861807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918406+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:11:07.918406+0000","last_peered":"2024-09-21T09:11:07.918406+0000","last_clean":"2024-09-21T09:11:07.918406+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:11:07.918406+0000","last_undegraded":"2024-09-21T09:11:07.918406+0000","last_fullsized":"2024-09-21T09:11:07.918406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:24.356684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860285+0000","last_change":"2024-09-21T09:11:00.847115+0000","last_active":"2024-09-21T09:11:07.860285+0000","last_peered":"2024-09-21T09:11:07.860285+0000","last_clean":"2024-09-21T09:11:07.860285+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:11:07.860285+0000","last_undegraded":"2024-09-21T09:11:07.860285+0000","last_fullsized":"2024-09-21T09:11:07.860285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:55.012417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.771506+0000","last_change":"2024-09-21T09:11:02.862921+0000","last_active":"2024-09-21T09:11:08.771506+0000","last_peered":"2024-09-21T09:11:08.771506+0000","last_clean":"2024-09-21T09:11:08.771506+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:11:08.771506+0000","last_undegraded":"2024-09-21T09:11:08.771506+0000","last_fullsized":"2024-09-21T09:11:08.771506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885282+0000","last_change":"2024-09-21T09:11:04.894220+0000","last_active":"2024-09-21T09:11:07.885282+0000","last_peered":"2024-09-21T09:11:07.885282+0000","last_clean":"2024-09-21T09:11:07.885282+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:11:07.885282+0000","last_undegraded":"2024-09-21T09:11:07.885282+0000","last_fullsized":"2024-09-21T09:11:07.885282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:07.285264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892057+0000","last_change":"2024-09-21T09:11:06.881113+0000","last_active":"2024-09-21T09:11:07.892057+0000","last_peered":"2024-09-21T09:11:07.892057+0000","last_clean":"2024-09-21T09:11:07.892057+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:11:07.892057+0000","last_undegraded":"2024-09-21T09:11:07.892057+0000","last_fullsized":"2024-09-21T09:11:07.892057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877629+0000","last_change":"2024-09-21T09:10:58.868894+0000","last_active":"2024-09-21T09:11:07.877629+0000","last_peered":"2024-09-21T09:11:07.877629+0000","last_clean":"2024-09-21T09:11:07.877629+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:11:07.877629+0000","last_undegraded":"2024-09-21T09:11:07.877629+0000","last_fullsized":"2024-09-21T09:11:07.877629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:41.448227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880607+0000","last_change":"2024-09-21T09:10:56.853201+0000","last_active":"2024-09-21T09:11:07.880607+0000","last_peered":"2024-09-21T09:11:07.880607+0000","last_clean":"2024-09-21T09:11:07.880607+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:11:07.880607+0000","last_undegraded":"2024-09-21T09:11:07.880607+0000","last_fullsized":"2024-09-21T09:11:07.880607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:58.587669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880094+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:11:07.880094+0000","last_peered":"2024-09-21T09:11:07.880094+0000","last_clean":"2024-09-21T09:11:07.880094+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:11:07.880094+0000","last_undegraded":"2024-09-21T09:11:07.880094+0000","last_fullsized":"2024-09-21T09:11:07.880094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:03.383843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917409+0000","last_change":"2024-09-21T09:11:00.850095+0000","last_active":"2024-09-21T09:11:07.917409+0000","last_peered":"2024-09-21T09:11:07.917409+0000","last_clean":"2024-09-21T09:11:07.917409+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:11:07.917409+0000","last_undegraded":"2024-09-21T09:11:07.917409+0000","last_fullsized":"2024-09-21T09:11:07.917409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:17.456402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.726686+0000","last_change":"2024-09-21T09:11:02.853229+0000","last_active":"2024-09-21T09:11:08.726686+0000","last_peered":"2024-09-21T09:11:08.726686+0000","last_clean":"2024-09-21T09:11:08.726686+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:11:08.726686+0000","last_undegraded":"2024-09-21T09:11:08.726686+0000","last_fullsized":"2024-09-21T09:11:08.726686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:25.468451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874251+0000","last_change":"2024-09-21T09:11:04.891312+0000","last_active":"2024-09-21T09:11:07.874251+0000","last_peered":"2024-09-21T09:11:07.874251+0000","last_clean":"2024-09-21T09:11:07.874251+0000","last_became_active":"2024-09-21T09:11:04.890437+0000","last_became_peered":"2024-09-21T09:11:04.890437+0000","last_unstale":"2024-09-21T09:11:07.874251+0000","last_undegraded":"2024-09-21T09:11:07.874251+0000","last_fullsized":"2024-09-21T09:11:07.874251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:50.682223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873290+0000","last_change":"2024-09-21T09:11:06.887900+0000","last_active":"2024-09-21T09:11:07.873290+0000","last_peered":"2024-09-21T09:11:07.873290+0000","last_clean":"2024-09-21T09:11:07.873290+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:11:07.873290+0000","last_undegraded":"2024-09-21T09:11:07.873290+0000","last_fullsized":"2024-09-21T09:11:07.873290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:03.433485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859715+0000","last_change":"2024-09-21T09:10:58.837150+0000","last_active":"2024-09-21T09:11:07.859715+0000","last_peered":"2024-09-21T09:11:07.859715+0000","last_clean":"2024-09-21T09:11:07.859715+0000","last_became_active":"2024-09-21T09:10:58.836859+0000","last_became_peered":"2024-09-21T09:10:58.836859+0000","last_unstale":"2024-09-21T09:11:07.859715+0000","last_undegraded":"2024-09-21T09:11:07.859715+0000","last_fullsized":"2024-09-21T09:11:07.859715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879824+0000","last_change":"2024-09-21T09:10:56.849803+0000","last_active":"2024-09-21T09:11:07.879824+0000","last_peered":"2024-09-21T09:11:07.879824+0000","last_clean":"2024-09-21T09:11:07.879824+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:11:07.879824+0000","last_undegraded":"2024-09-21T09:11:07.879824+0000","last_fullsized":"2024-09-21T09:11:07.879824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:47.709157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919337+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:11:07.919337+0000","last_peered":"2024-09-21T09:11:07.919337+0000","last_clean":"2024-09-21T09:11:07.919337+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:11:07.919337+0000","last_undegraded":"2024-09-21T09:11:07.919337+0000","last_fullsized":"2024-09-21T09:11:07.919337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:33.465317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.876823+0000","last_change":"2024-09-21T09:11:00.831510+0000","last_active":"2024-09-21T09:11:07.876823+0000","last_peered":"2024-09-21T09:11:07.876823+0000","last_clean":"2024-09-21T09:11:07.876823+0000","last_became_active":"2024-09-21T09:11:00.830738+0000","last_became_peered":"2024-09-21T09:11:00.830738+0000","last_unstale":"2024-09-21T09:11:07.876823+0000","last_undegraded":"2024-09-21T09:11:07.876823+0000","last_fullsized":"2024-09-21T09:11:07.876823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:13.485361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"36'19","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.704439+0000","last_change":"2024-09-21T09:11:02.856720+0000","last_active":"2024-09-21T09:11:08.704439+0000","last_peered":"2024-09-21T09:11:08.704439+0000","last_clean":"2024-09-21T09:11:08.704439+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:11:08.704439+0000","last_undegraded":"2024-09-21T09:11:08.704439+0000","last_fullsized":"2024-09-21T09:11:08.704439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878168+0000","last_change":"2024-09-21T09:11:04.872979+0000","last_active":"2024-09-21T09:11:07.878168+0000","last_peered":"2024-09-21T09:11:07.878168+0000","last_clean":"2024-09-21T09:11:07.878168+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:11:07.878168+0000","last_undegraded":"2024-09-21T09:11:07.878168+0000","last_fullsized":"2024-09-21T09:11:07.878168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:17.499450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861042+0000","last_change":"2024-09-21T09:11:06.889672+0000","last_active":"2024-09-21T09:11:07.861042+0000","last_peered":"2024-09-21T09:11:07.861042+0000","last_clean":"2024-09-21T09:11:07.861042+0000","last_became_active":"2024-09-21T09:11:06.888516+0000","last_became_peered":"2024-09-21T09:11:06.888516+0000","last_unstale":"2024-09-21T09:11:07.861042+0000","last_undegraded":"2024-09-21T09:11:07.861042+0000","last_fullsized":"2024-09-21T09:11:07.861042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880284+0000","last_change":"2024-09-21T09:11:06.900571+0000","last_active":"2024-09-21T09:11:07.880284+0000","last_peered":"2024-09-21T09:11:07.880284+0000","last_clean":"2024-09-21T09:11:07.880284+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:11:07.880284+0000","last_undegraded":"2024-09-21T09:11:07.880284+0000","last_fullsized":"2024-09-21T09:11:07.880284+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:40.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859795+0000","last_change":"2024-09-21T09:10:58.841597+0000","last_active":"2024-09-21T09:11:07.859795+0000","last_peered":"2024-09-21T09:11:07.859795+0000","last_clean":"2024-09-21T09:11:07.859795+0000","last_became_active":"2024-09-21T09:10:58.839814+0000","last_became_peered":"2024-09-21T09:10:58.839814+0000","last_unstale":"2024-09-21T09:11:07.859795+0000","last_undegraded":"2024-09-21T09:11:07.859795+0000","last_fullsized":"2024-09-21T09:11:07.859795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919902+0000","last_change":"2024-09-21T09:10:56.867413+0000","last_active":"2024-09-21T09:11:07.919902+0000","last_peered":"2024-09-21T09:11:07.919902+0000","last_clean":"2024-09-21T09:11:07.919902+0000","last_became_active":"2024-09-21T09:10:56.867019+0000","last_became_peered":"2024-09-21T09:10:56.867019+0000","last_unstale":"2024-09-21T09:11:07.919902+0000","last_undegraded":"2024-09-21T09:11:07.919902+0000","last_fullsized":"2024-09-21T09:11:07.919902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:06.120617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860398+0000","last_change":"2024-09-21T09:11:00.839217+0000","last_active":"2024-09-21T09:11:07.860398+0000","last_peered":"2024-09-21T09:11:07.860398+0000","last_clean":"2024-09-21T09:11:07.860398+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:11:07.860398+0000","last_undegraded":"2024-09-21T09:11:07.860398+0000","last_fullsized":"2024-09-21T09:11:07.860398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:23.833810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"36'11","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.778784+0000","last_change":"2024-09-21T09:11:02.872614+0000","last_active":"2024-09-21T09:11:08.778784+0000","last_peered":"2024-09-21T09:11:08.778784+0000","last_clean":"2024-09-21T09:11:08.778784+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:11:08.778784+0000","last_undegraded":"2024-09-21T09:11:08.778784+0000","last_fullsized":"2024-09-21T09:11:08.778784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.889951+0000","last_change":"2024-09-21T09:11:04.882308+0000","last_active":"2024-09-21T09:11:07.889951+0000","last_peered":"2024-09-21T09:11:07.889951+0000","last_clean":"2024-09-21T09:11:07.889951+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:11:07.889951+0000","last_undegraded":"2024-09-21T09:11:07.889951+0000","last_fullsized":"2024-09-21T09:11:07.889951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:42.301147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891604+0000","last_change":"2024-09-21T09:11:06.892382+0000","last_active":"2024-09-21T09:11:07.891604+0000","last_peered":"2024-09-21T09:11:07.891604+0000","last_clean":"2024-09-21T09:11:07.891604+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:11:07.891604+0000","last_undegraded":"2024-09-21T09:11:07.891604+0000","last_fullsized":"2024-09-21T09:11:07.891604+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:20.449346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877889+0000","last_change":"2024-09-21T09:10:58.869150+0000","last_active":"2024-09-21T09:11:07.877889+0000","last_peered":"2024-09-21T09:11:07.877889+0000","last_clean":"2024-09-21T09:11:07.877889+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:11:07.877889+0000","last_undegraded":"2024-09-21T09:11:07.877889+0000","last_fullsized":"2024-09-21T09:11:07.877889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:58.386210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863932+0000","last_change":"2024-09-21T09:10:56.854764+0000","last_active":"2024-09-21T09:11:07.863932+0000","last_peered":"2024-09-21T09:11:07.863932+0000","last_clean":"2024-09-21T09:11:07.863932+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:11:07.863932+0000","last_undegraded":"2024-09-21T09:11:07.863932+0000","last_fullsized":"2024-09-21T09:11:07.863932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878033+0000","last_change":"2024-09-21T09:11:00.839265+0000","last_active":"2024-09-21T09:11:07.878033+0000","last_peered":"2024-09-21T09:11:07.878033+0000","last_clean":"2024-09-21T09:11:07.878033+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:11:07.878033+0000","last_undegraded":"2024-09-21T09:11:07.878033+0000","last_fullsized":"2024-09-21T09:11:07.878033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:14.524942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"36'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.228135+0000","last_change":"2024-09-21T09:11:02.859426+0000","last_active":"2024-09-21T09:11:08.228135+0000","last_peered":"2024-09-21T09:11:08.228135+0000","last_clean":"2024-09-21T09:11:08.228135+0000","last_became_active":"2024-09-21T09:11:02.858690+0000","last_became_peered":"2024-09-21T09:11:02.858690+0000","last_unstale":"2024-09-21T09:11:08.228135+0000","last_undegraded":"2024-09-21T09:11:08.228135+0000","last_fullsized":"2024-09-21T09:11:08.228135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:07.586879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857744+0000","last_change":"2024-09-21T09:11:04.860220+0000","last_active":"2024-09-21T09:11:07.857744+0000","last_peered":"2024-09-21T09:11:07.857744+0000","last_clean":"2024-09-21T09:11:07.857744+0000","last_became_active":"2024-09-21T09:11:04.859440+0000","last_became_peered":"2024-09-21T09:11:04.859440+0000","last_unstale":"2024-09-21T09:11:07.857744+0000","last_undegraded":"2024-09-21T09:11:07.857744+0000","last_fullsized":"2024-09-21T09:11:07.857744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:58.916787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861022+0000","last_change":"2024-09-21T09:11:06.879042+0000","last_active":"2024-09-21T09:11:07.861022+0000","last_peered":"2024-09-21T09:11:07.861022+0000","last_clean":"2024-09-21T09:11:07.861022+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:11:07.861022+0000","last_undegraded":"2024-09-21T09:11:07.861022+0000","last_fullsized":"2024-09-21T09:11:07.861022+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:34.670949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877376+0000","last_change":"2024-09-21T09:10:58.864481+0000","last_active":"2024-09-21T09:11:07.877376+0000","last_peered":"2024-09-21T09:11:07.877376+0000","last_clean":"2024-09-21T09:11:07.877376+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:11:07.877376+0000","last_undegraded":"2024-09-21T09:11:07.877376+0000","last_fullsized":"2024-09-21T09:11:07.877376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:33.405020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862086+0000","last_change":"2024-09-21T09:10:56.858748+0000","last_active":"2024-09-21T09:11:07.862086+0000","last_peered":"2024-09-21T09:11:07.862086+0000","last_clean":"2024-09-21T09:11:07.862086+0000","last_became_active":"2024-09-21T09:10:56.858102+0000","last_became_peered":"2024-09-21T09:10:56.858102+0000","last_unstale":"2024-09-21T09:11:07.862086+0000","last_undegraded":"2024-09-21T09:11:07.862086+0000","last_fullsized":"2024-09-21T09:11:07.862086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857279+0000","last_change":"2024-09-21T09:11:00.839191+0000","last_active":"2024-09-21T09:11:07.857279+0000","last_peered":"2024-09-21T09:11:07.857279+0000","last_clean":"2024-09-21T09:11:07.857279+0000","last_became_active":"2024-09-21T09:11:00.838002+0000","last_became_peered":"2024-09-21T09:11:00.838002+0000","last_unstale":"2024-09-21T09:11:07.857279+0000","last_undegraded":"2024-09-21T09:11:07.857279+0000","last_fullsized":"2024-09-21T09:11:07.857279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:23.833810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'11","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.684011+0000","last_change":"2024-09-21T09:11:02.869796+0000","last_active":"2024-09-21T09:11:08.684011+0000","last_peered":"2024-09-21T09:11:08.684011+0000","last_clean":"2024-09-21T09:11:08.684011+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:11:08.684011+0000","last_undegraded":"2024-09-21T09:11:08.684011+0000","last_fullsized":"2024-09-21T09:11:08.684011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:48.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885370+0000","last_change":"2024-09-21T09:11:04.893727+0000","last_active":"2024-09-21T09:11:07.885370+0000","last_peered":"2024-09-21T09:11:07.885370+0000","last_clean":"2024-09-21T09:11:07.885370+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:11:07.885370+0000","last_undegraded":"2024-09-21T09:11:07.885370+0000","last_fullsized":"2024-09-21T09:11:07.885370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:18.437905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919617+0000","last_change":"2024-09-21T09:11:06.893750+0000","last_active":"2024-09-21T09:11:07.919617+0000","last_peered":"2024-09-21T09:11:07.919617+0000","last_clean":"2024-09-21T09:11:07.919617+0000","last_became_active":"2024-09-21T09:11:06.892766+0000","last_became_peered":"2024-09-21T09:11:06.892766+0000","last_unstale":"2024-09-21T09:11:07.919617+0000","last_undegraded":"2024-09-21T09:11:07.919617+0000","last_fullsized":"2024-09-21T09:11:07.919617+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:03.695046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890242+0000","last_change":"2024-09-21T09:10:58.859005+0000","last_active":"2024-09-21T09:11:07.890242+0000","last_peered":"2024-09-21T09:11:07.890242+0000","last_clean":"2024-09-21T09:11:07.890242+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:11:07.890242+0000","last_undegraded":"2024-09-21T09:11:07.890242+0000","last_fullsized":"2024-09-21T09:11:07.890242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:38.110596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875879+0000","last_change":"2024-09-21T09:10:56.860416+0000","last_active":"2024-09-21T09:11:07.875879+0000","last_peered":"2024-09-21T09:11:07.875879+0000","last_clean":"2024-09-21T09:11:07.875879+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:11:07.875879+0000","last_undegraded":"2024-09-21T09:11:07.875879+0000","last_fullsized":"2024-09-21T09:11:07.875879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:48.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917007+0000","last_change":"2024-09-21T09:11:00.842215+0000","last_active":"2024-09-21T09:11:07.917007+0000","last_peered":"2024-09-21T09:11:07.917007+0000","last_clean":"2024-09-21T09:11:07.917007+0000","last_became_active":"2024-09-21T09:11:00.841367+0000","last_became_peered":"2024-09-21T09:11:00.841367+0000","last_unstale":"2024-09-21T09:11:07.917007+0000","last_undegraded":"2024-09-21T09:11:07.917007+0000","last_fullsized":"2024-09-21T09:11:07.917007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:46.657240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.452217+0000","last_change":"2024-09-21T09:11:02.872950+0000","last_active":"2024-09-21T09:11:08.452217+0000","last_peered":"2024-09-21T09:11:08.452217+0000","last_clean":"2024-09-21T09:11:08.452217+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:11:08.452217+0000","last_undegraded":"2024-09-21T09:11:08.452217+0000","last_fullsized":"2024-09-21T09:11:08.452217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891000+0000","last_change":"2024-09-21T09:11:04.885912+0000","last_active":"2024-09-21T09:11:07.891000+0000","last_peered":"2024-09-21T09:11:07.891000+0000","last_clean":"2024-09-21T09:11:07.891000+0000","last_became_active":"2024-09-21T09:11:04.884734+0000","last_became_peered":"2024-09-21T09:11:04.884734+0000","last_unstale":"2024-09-21T09:11:07.891000+0000","last_undegraded":"2024-09-21T09:11:07.891000+0000","last_fullsized":"2024-09-21T09:11:07.891000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:58.916787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918477+0000","last_change":"2024-09-21T09:10:58.839092+0000","last_active":"2024-09-21T09:11:07.918477+0000","last_peered":"2024-09-21T09:11:07.918477+0000","last_clean":"2024-09-21T09:11:07.918477+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:11:07.918477+0000","last_undegraded":"2024-09-21T09:11:07.918477+0000","last_fullsized":"2024-09-21T09:11:07.918477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:02.458655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873603+0000","last_change":"2024-09-21T09:10:56.865435+0000","last_active":"2024-09-21T09:11:07.873603+0000","last_peered":"2024-09-21T09:11:07.873603+0000","last_clean":"2024-09-21T09:11:07.873603+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:11:07.873603+0000","last_undegraded":"2024-09-21T09:11:07.873603+0000","last_fullsized":"2024-09-21T09:11:07.873603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861885+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:11:07.861885+0000","last_peered":"2024-09-21T09:11:07.861885+0000","last_clean":"2024-09-21T09:11:07.861885+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:11:07.861885+0000","last_undegraded":"2024-09-21T09:11:07.861885+0000","last_fullsized":"2024-09-21T09:11:07.861885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:10.134818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"36'12","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.807408+0000","last_change":"2024-09-21T09:11:02.879895+0000","last_active":"2024-09-21T09:11:08.807408+0000","last_peered":"2024-09-21T09:11:08.807408+0000","last_clean":"2024-09-21T09:11:08.807408+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:11:08.807408+0000","last_undegraded":"2024-09-21T09:11:08.807408+0000","last_fullsized":"2024-09-21T09:11:08.807408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.858700+0000","last_change":"2024-09-21T09:11:04.859761+0000","last_active":"2024-09-21T09:11:07.858700+0000","last_peered":"2024-09-21T09:11:07.858700+0000","last_clean":"2024-09-21T09:11:07.858700+0000","last_became_active":"2024-09-21T09:11:04.859053+0000","last_became_peered":"2024-09-21T09:11:04.859053+0000","last_unstale":"2024-09-21T09:11:07.858700+0000","last_undegraded":"2024-09-21T09:11:07.858700+0000","last_fullsized":"2024-09-21T09:11:07.858700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:52.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873124+0000","last_change":"2024-09-21T09:11:06.896002+0000","last_active":"2024-09-21T09:11:07.873124+0000","last_peered":"2024-09-21T09:11:07.873124+0000","last_clean":"2024-09-21T09:11:07.873124+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:11:07.873124+0000","last_undegraded":"2024-09-21T09:11:07.873124+0000","last_fullsized":"2024-09-21T09:11:07.873124+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:01.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879756+0000","last_change":"2024-09-21T09:10:58.868892+0000","last_active":"2024-09-21T09:11:07.879756+0000","last_peered":"2024-09-21T09:11:07.879756+0000","last_clean":"2024-09-21T09:11:07.879756+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:11:07.879756+0000","last_undegraded":"2024-09-21T09:11:07.879756+0000","last_fullsized":"2024-09-21T09:11:07.879756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877837+0000","last_change":"2024-09-21T09:10:56.827351+0000","last_active":"2024-09-21T09:11:07.877837+0000","last_peered":"2024-09-21T09:11:07.877837+0000","last_clean":"2024-09-21T09:11:07.877837+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:11:07.877837+0000","last_undegraded":"2024-09-21T09:11:07.877837+0000","last_fullsized":"2024-09-21T09:11:07.877837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:49.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860750+0000","last_change":"2024-09-21T09:11:00.845324+0000","last_active":"2024-09-21T09:11:07.860750+0000","last_peered":"2024-09-21T09:11:07.860750+0000","last_clean":"2024-09-21T09:11:07.860750+0000","last_became_active":"2024-09-21T09:11:00.844506+0000","last_became_peered":"2024-09-21T09:11:00.844506+0000","last_unstale":"2024-09-21T09:11:07.860750+0000","last_undegraded":"2024-09-21T09:11:07.860750+0000","last_fullsized":"2024-09-21T09:11:07.860750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'15","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.581042+0000","last_change":"2024-09-21T09:11:02.862497+0000","last_active":"2024-09-21T09:11:08.581042+0000","last_peered":"2024-09-21T09:11:08.581042+0000","last_clean":"2024-09-21T09:11:08.581042+0000","last_became_active":"2024-09-21T09:11:02.861320+0000","last_became_peered":"2024-09-21T09:11:02.861320+0000","last_unstale":"2024-09-21T09:11:08.581042+0000","last_undegraded":"2024-09-21T09:11:08.581042+0000","last_fullsized":"2024-09-21T09:11:08.581042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:34.798519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873292+0000","last_change":"2024-09-21T09:11:04.890782+0000","last_active":"2024-09-21T09:11:07.873292+0000","last_peered":"2024-09-21T09:11:07.873292+0000","last_clean":"2024-09-21T09:11:07.873292+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:11:07.873292+0000","last_undegraded":"2024-09-21T09:11:07.873292+0000","last_fullsized":"2024-09-21T09:11:07.873292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:42.740558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919148+0000","last_change":"2024-09-21T09:11:06.889510+0000","last_active":"2024-09-21T09:11:07.919148+0000","last_peered":"2024-09-21T09:11:07.919148+0000","last_clean":"2024-09-21T09:11:07.919148+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:11:07.919148+0000","last_undegraded":"2024-09-21T09:11:07.919148+0000","last_fullsized":"2024-09-21T09:11:07.919148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:38.377418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891501+0000","last_change":"2024-09-21T09:10:58.854750+0000","last_active":"2024-09-21T09:11:07.891501+0000","last_peered":"2024-09-21T09:11:07.891501+0000","last_clean":"2024-09-21T09:11:07.891501+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:11:07.891501+0000","last_undegraded":"2024-09-21T09:11:07.891501+0000","last_fullsized":"2024-09-21T09:11:07.891501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.559151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887566+0000","last_change":"2024-09-21T09:10:56.863198+0000","last_active":"2024-09-21T09:11:07.887566+0000","last_peered":"2024-09-21T09:11:07.887566+0000","last_clean":"2024-09-21T09:11:07.887566+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:11:07.887566+0000","last_undegraded":"2024-09-21T09:11:07.887566+0000","last_fullsized":"2024-09-21T09:11:07.887566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859624+0000","last_change":"2024-09-21T09:11:00.828423+0000","last_active":"2024-09-21T09:11:07.859624+0000","last_peered":"2024-09-21T09:11:07.859624+0000","last_clean":"2024-09-21T09:11:07.859624+0000","last_became_active":"2024-09-21T09:11:00.827935+0000","last_became_peered":"2024-09-21T09:11:00.827935+0000","last_unstale":"2024-09-21T09:11:07.859624+0000","last_undegraded":"2024-09-21T09:11:07.859624+0000","last_fullsized":"2024-09-21T09:11:07.859624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:55.012417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'11","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.785929+0000","last_change":"2024-09-21T09:11:02.879188+0000","last_active":"2024-09-21T09:11:08.785929+0000","last_peered":"2024-09-21T09:11:08.785929+0000","last_clean":"2024-09-21T09:11:08.785929+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:11:08.785929+0000","last_undegraded":"2024-09-21T09:11:08.785929+0000","last_fullsized":"2024-09-21T09:11:08.785929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:37.208901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.891442+0000","last_change":"2024-09-21T09:11:04.880786+0000","last_active":"2024-09-21T09:11:07.891442+0000","last_peered":"2024-09-21T09:11:07.891442+0000","last_clean":"2024-09-21T09:11:07.891442+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:11:07.891442+0000","last_undegraded":"2024-09-21T09:11:07.891442+0000","last_fullsized":"2024-09-21T09:11:07.891442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:54.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917010+0000","last_change":"2024-09-21T09:11:06.898517+0000","last_active":"2024-09-21T09:11:07.917010+0000","last_peered":"2024-09-21T09:11:07.917010+0000","last_clean":"2024-09-21T09:11:07.917010+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:11:07.917010+0000","last_undegraded":"2024-09-21T09:11:07.917010+0000","last_fullsized":"2024-09-21T09:11:07.917010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:46.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880449+0000","last_change":"2024-09-21T09:10:58.868807+0000","last_active":"2024-09-21T09:11:07.880449+0000","last_peered":"2024-09-21T09:11:07.880449+0000","last_clean":"2024-09-21T09:11:07.880449+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:11:07.880449+0000","last_undegraded":"2024-09-21T09:11:07.880449+0000","last_fullsized":"2024-09-21T09:11:07.880449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.574650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880065+0000","last_change":"2024-09-21T09:10:56.851205+0000","last_active":"2024-09-21T09:11:07.880065+0000","last_peered":"2024-09-21T09:11:07.880065+0000","last_clean":"2024-09-21T09:11:07.880065+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:11:07.880065+0000","last_undegraded":"2024-09-21T09:11:07.880065+0000","last_fullsized":"2024-09-21T09:11:07.880065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:52.423650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878444+0000","last_change":"2024-09-21T09:11:00.856830+0000","last_active":"2024-09-21T09:11:07.878444+0000","last_peered":"2024-09-21T09:11:07.878444+0000","last_clean":"2024-09-21T09:11:07.878444+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:11:07.878444+0000","last_undegraded":"2024-09-21T09:11:07.878444+0000","last_fullsized":"2024-09-21T09:11:07.878444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:45.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"36'10","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.762664+0000","last_change":"2024-09-21T09:11:02.865472+0000","last_active":"2024-09-21T09:11:08.762664+0000","last_peered":"2024-09-21T09:11:08.762664+0000","last_clean":"2024-09-21T09:11:08.762664+0000","last_became_active":"2024-09-21T09:11:02.864646+0000","last_became_peered":"2024-09-21T09:11:02.864646+0000","last_unstale":"2024-09-21T09:11:08.762664+0000","last_undegraded":"2024-09-21T09:11:08.762664+0000","last_fullsized":"2024-09-21T09:11:08.762664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:39:13.507947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.864442+0000","last_change":"2024-09-21T09:11:04.870463+0000","last_active":"2024-09-21T09:11:07.864442+0000","last_peered":"2024-09-21T09:11:07.864442+0000","last_clean":"2024-09-21T09:11:07.864442+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:11:07.864442+0000","last_undegraded":"2024-09-21T09:11:07.864442+0000","last_fullsized":"2024-09-21T09:11:07.864442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:30.495090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.916758+0000","last_change":"2024-09-21T09:11:06.883550+0000","last_active":"2024-09-21T09:11:07.916758+0000","last_peered":"2024-09-21T09:11:07.916758+0000","last_clean":"2024-09-21T09:11:07.916758+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:11:07.916758+0000","last_undegraded":"2024-09-21T09:11:07.916758+0000","last_fullsized":"2024-09-21T09:11:07.916758+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:56.825424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859567+0000","last_change":"2024-09-21T09:10:58.845744+0000","last_active":"2024-09-21T09:11:07.859567+0000","last_peered":"2024-09-21T09:11:07.859567+0000","last_clean":"2024-09-21T09:11:07.859567+0000","last_became_active":"2024-09-21T09:10:58.845470+0000","last_became_peered":"2024-09-21T09:10:58.845470+0000","last_unstale":"2024-09-21T09:11:07.859567+0000","last_undegraded":"2024-09-21T09:11:07.859567+0000","last_fullsized":"2024-09-21T09:11:07.859567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886470+0000","last_change":"2024-09-21T09:10:56.852586+0000","last_active":"2024-09-21T09:11:07.886470+0000","last_peered":"2024-09-21T09:11:07.886470+0000","last_clean":"2024-09-21T09:11:07.886470+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:11:07.886470+0000","last_undegraded":"2024-09-21T09:11:07.886470+0000","last_fullsized":"2024-09-21T09:11:07.886470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887122+0000","last_change":"2024-09-21T09:11:00.839800+0000","last_active":"2024-09-21T09:11:07.887122+0000","last_peered":"2024-09-21T09:11:07.887122+0000","last_clean":"2024-09-21T09:11:07.887122+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:11:07.887122+0000","last_undegraded":"2024-09-21T09:11:07.887122+0000","last_fullsized":"2024-09-21T09:11:07.887122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:21.140377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'15","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.797908+0000","last_change":"2024-09-21T09:11:02.857087+0000","last_active":"2024-09-21T09:11:08.797908+0000","last_peered":"2024-09-21T09:11:08.797908+0000","last_clean":"2024-09-21T09:11:08.797908+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:11:08.797908+0000","last_undegraded":"2024-09-21T09:11:08.797908+0000","last_fullsized":"2024-09-21T09:11:08.797908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.876808+0000","last_change":"2024-09-21T09:11:04.872303+0000","last_active":"2024-09-21T09:11:07.876808+0000","last_peered":"2024-09-21T09:11:07.876808+0000","last_clean":"2024-09-21T09:11:07.876808+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:11:07.876808+0000","last_undegraded":"2024-09-21T09:11:07.876808+0000","last_fullsized":"2024-09-21T09:11:07.876808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.517451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886999+0000","last_change":"2024-09-21T09:11:06.873636+0000","last_active":"2024-09-21T09:11:07.886999+0000","last_peered":"2024-09-21T09:11:07.886999+0000","last_clean":"2024-09-21T09:11:07.886999+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:11:07.886999+0000","last_undegraded":"2024-09-21T09:11:07.886999+0000","last_fullsized":"2024-09-21T09:11:07.886999+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:52.693664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857854+0000","last_change":"2024-09-21T09:10:58.835902+0000","last_active":"2024-09-21T09:11:07.857854+0000","last_peered":"2024-09-21T09:11:07.857854+0000","last_clean":"2024-09-21T09:11:07.857854+0000","last_became_active":"2024-09-21T09:10:58.835559+0000","last_became_peered":"2024-09-21T09:10:58.835559+0000","last_unstale":"2024-09-21T09:11:07.857854+0000","last_undegraded":"2024-09-21T09:11:07.857854+0000","last_fullsized":"2024-09-21T09:11:07.857854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919054+0000","last_change":"2024-09-21T09:10:56.856625+0000","last_active":"2024-09-21T09:11:07.919054+0000","last_peered":"2024-09-21T09:11:07.919054+0000","last_clean":"2024-09-21T09:11:07.919054+0000","last_became_active":"2024-09-21T09:10:56.856312+0000","last_became_peered":"2024-09-21T09:10:56.856312+0000","last_unstale":"2024-09-21T09:11:07.919054+0000","last_undegraded":"2024-09-21T09:11:07.919054+0000","last_fullsized":"2024-09-21T09:11:07.919054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:50.998215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.859191+0000","last_change":"2024-09-21T09:11:00.845901+0000","last_active":"2024-09-21T09:11:07.859191+0000","last_peered":"2024-09-21T09:11:07.859191+0000","last_clean":"2024-09-21T09:11:07.859191+0000","last_became_active":"2024-09-21T09:11:00.845312+0000","last_became_peered":"2024-09-21T09:11:00.845312+0000","last_unstale":"2024-09-21T09:11:07.859191+0000","last_undegraded":"2024-09-21T09:11:07.859191+0000","last_fullsized":"2024-09-21T09:11:07.859191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:10.134818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.180914+0000","last_change":"2024-09-21T09:11:02.847926+0000","last_active":"2024-09-21T09:11:08.180914+0000","last_peered":"2024-09-21T09:11:08.180914+0000","last_clean":"2024-09-21T09:11:08.180914+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:11:08.180914+0000","last_undegraded":"2024-09-21T09:11:08.180914+0000","last_fullsized":"2024-09-21T09:11:08.180914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:15.592269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917327+0000","last_change":"2024-09-21T09:11:04.880866+0000","last_active":"2024-09-21T09:11:07.917327+0000","last_peered":"2024-09-21T09:11:07.917327+0000","last_clean":"2024-09-21T09:11:07.917327+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:11:07.917327+0000","last_undegraded":"2024-09-21T09:11:07.917327+0000","last_fullsized":"2024-09-21T09:11:07.917327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:02.568576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874007+0000","last_change":"2024-09-21T09:11:06.899493+0000","last_active":"2024-09-21T09:11:07.874007+0000","last_peered":"2024-09-21T09:11:07.874007+0000","last_clean":"2024-09-21T09:11:07.874007+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:11:07.874007+0000","last_undegraded":"2024-09-21T09:11:07.874007+0000","last_fullsized":"2024-09-21T09:11:07.874007+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:50.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890343+0000","last_change":"2024-09-21T09:10:58.856310+0000","last_active":"2024-09-21T09:11:07.890343+0000","last_peered":"2024-09-21T09:11:07.890343+0000","last_clean":"2024-09-21T09:11:07.890343+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:11:07.890343+0000","last_undegraded":"2024-09-21T09:11:07.890343+0000","last_fullsized":"2024-09-21T09:11:07.890343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:12.549438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875375+0000","last_change":"2024-09-21T09:10:56.867139+0000","last_active":"2024-09-21T09:11:07.875375+0000","last_peered":"2024-09-21T09:11:07.875375+0000","last_clean":"2024-09-21T09:11:07.875375+0000","last_became_active":"2024-09-21T09:10:56.865925+0000","last_became_peered":"2024-09-21T09:10:56.865925+0000","last_unstale":"2024-09-21T09:11:07.875375+0000","last_undegraded":"2024-09-21T09:11:07.875375+0000","last_fullsized":"2024-09-21T09:11:07.875375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:32.583435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885466+0000","last_change":"2024-09-21T09:11:00.837141+0000","last_active":"2024-09-21T09:11:07.885466+0000","last_peered":"2024-09-21T09:11:07.885466+0000","last_clean":"2024-09-21T09:11:07.885466+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:11:07.885466+0000","last_undegraded":"2024-09-21T09:11:07.885466+0000","last_fullsized":"2024-09-21T09:11:07.885466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'5","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.403830+0000","last_change":"2024-09-21T09:11:02.868591+0000","last_active":"2024-09-21T09:11:08.403830+0000","last_peered":"2024-09-21T09:11:08.403830+0000","last_clean":"2024-09-21T09:11:08.403830+0000","last_became_active":"2024-09-21T09:11:02.867878+0000","last_became_peered":"2024-09-21T09:11:02.867878+0000","last_unstale":"2024-09-21T09:11:08.403830+0000","last_undegraded":"2024-09-21T09:11:08.403830+0000","last_fullsized":"2024-09-21T09:11:08.403830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917053+0000","last_change":"2024-09-21T09:11:04.887172+0000","last_active":"2024-09-21T09:11:07.917053+0000","last_peered":"2024-09-21T09:11:07.917053+0000","last_clean":"2024-09-21T09:11:07.917053+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:11:07.917053+0000","last_undegraded":"2024-09-21T09:11:07.917053+0000","last_fullsized":"2024-09-21T09:11:07.917053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:01.250555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918433+0000","last_change":"2024-09-21T09:11:06.888366+0000","last_active":"2024-09-21T09:11:07.918433+0000","last_peered":"2024-09-21T09:11:07.918433+0000","last_clean":"2024-09-21T09:11:07.918433+0000","last_became_active":"2024-09-21T09:11:06.887603+0000","last_became_peered":"2024-09-21T09:11:06.887603+0000","last_unstale":"2024-09-21T09:11:07.918433+0000","last_undegraded":"2024-09-21T09:11:07.918433+0000","last_fullsized":"2024-09-21T09:11:07.918433+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:06.920940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857458+0000","last_change":"2024-09-21T09:10:58.867360+0000","last_active":"2024-09-21T09:11:07.857458+0000","last_peered":"2024-09-21T09:11:07.857458+0000","last_clean":"2024-09-21T09:11:07.857458+0000","last_became_active":"2024-09-21T09:10:58.867116+0000","last_became_peered":"2024-09-21T09:10:58.867116+0000","last_unstale":"2024-09-21T09:11:07.857458+0000","last_undegraded":"2024-09-21T09:11:07.857458+0000","last_fullsized":"2024-09-21T09:11:07.857458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875758+0000","last_change":"2024-09-21T09:10:56.861373+0000","last_active":"2024-09-21T09:11:07.875758+0000","last_peered":"2024-09-21T09:11:07.875758+0000","last_clean":"2024-09-21T09:11:07.875758+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:11:07.875758+0000","last_undegraded":"2024-09-21T09:11:07.875758+0000","last_fullsized":"2024-09-21T09:11:07.875758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:45.846021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877071+0000","last_change":"2024-09-21T09:11:00.838647+0000","last_active":"2024-09-21T09:11:07.877071+0000","last_peered":"2024-09-21T09:11:07.877071+0000","last_clean":"2024-09-21T09:11:07.877071+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:11:07.877071+0000","last_undegraded":"2024-09-21T09:11:07.877071+0000","last_fullsized":"2024-09-21T09:11:07.877071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:16.279789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:08.473280+0000","last_change":"2024-09-21T09:11:02.877357+0000","last_active":"2024-09-21T09:11:08.473280+0000","last_peered":"2024-09-21T09:11:08.473280+0000","last_clean":"2024-09-21T09:11:08.473280+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:11:08.473280+0000","last_undegraded":"2024-09-21T09:11:08.473280+0000","last_fullsized":"2024-09-21T09:11:08.473280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:46.845302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.878751+0000","last_change":"2024-09-21T09:11:04.896698+0000","last_active":"2024-09-21T09:11:07.878751+0000","last_peered":"2024-09-21T09:11:07.878751+0000","last_clean":"2024-09-21T09:11:07.878751+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:11:07.878751+0000","last_undegraded":"2024-09-21T09:11:07.878751+0000","last_fullsized":"2024-09-21T09:11:07.878751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:59.924890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863350+0000","last_change":"2024-09-21T09:11:06.894453+0000","last_active":"2024-09-21T09:11:07.863350+0000","last_peered":"2024-09-21T09:11:07.863350+0000","last_clean":"2024-09-21T09:11:07.863350+0000","last_became_active":"2024-09-21T09:11:06.893707+0000","last_became_peered":"2024-09-21T09:11:06.893707+0000","last_unstale":"2024-09-21T09:11:07.863350+0000","last_undegraded":"2024-09-21T09:11:07.863350+0000","last_fullsized":"2024-09-21T09:11:07.863350+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:10.502126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880595+0000","last_change":"2024-09-21T09:10:58.865842+0000","last_active":"2024-09-21T09:11:07.880595+0000","last_peered":"2024-09-21T09:11:07.880595+0000","last_clean":"2024-09-21T09:11:07.880595+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:11:07.880595+0000","last_undegraded":"2024-09-21T09:11:07.880595+0000","last_fullsized":"2024-09-21T09:11:07.880595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:10.069785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.857746+0000","last_change":"2024-09-21T09:10:56.858160+0000","last_active":"2024-09-21T09:11:07.857746+0000","last_peered":"2024-09-21T09:11:07.857746+0000","last_clean":"2024-09-21T09:11:07.857746+0000","last_became_active":"2024-09-21T09:10:56.851283+0000","last_became_peered":"2024-09-21T09:10:56.851283+0000","last_unstale":"2024-09-21T09:11:07.857746+0000","last_undegraded":"2024-09-21T09:11:07.857746+0000","last_fullsized":"2024-09-21T09:11:07.857746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892213+0000","last_change":"2024-09-21T09:10:58.871267+0000","last_active":"2024-09-21T09:11:07.892213+0000","last_peered":"2024-09-21T09:11:07.892213+0000","last_clean":"2024-09-21T09:11:07.892213+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:11:07.892213+0000","last_undegraded":"2024-09-21T09:11:07.892213+0000","last_fullsized":"2024-09-21T09:11:07.892213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890192+0000","last_change":"2024-09-21T09:10:56.847914+0000","last_active":"2024-09-21T09:11:07.890192+0000","last_peered":"2024-09-21T09:11:07.890192+0000","last_clean":"2024-09-21T09:11:07.890192+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:11:07.890192+0000","last_undegraded":"2024-09-21T09:11:07.890192+0000","last_fullsized":"2024-09-21T09:11:07.890192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918688+0000","last_change":"2024-09-21T09:10:58.837841+0000","last_active":"2024-09-21T09:11:07.918688+0000","last_peered":"2024-09-21T09:11:07.918688+0000","last_clean":"2024-09-21T09:11:07.918688+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:11:07.918688+0000","last_undegraded":"2024-09-21T09:11:07.918688+0000","last_fullsized":"2024-09-21T09:11:07.918688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:54.101397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.918387+0000","last_change":"2024-09-21T09:10:56.861995+0000","last_active":"2024-09-21T09:11:07.918387+0000","last_peered":"2024-09-21T09:11:07.918387+0000","last_clean":"2024-09-21T09:11:07.918387+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:11:07.918387+0000","last_undegraded":"2024-09-21T09:11:07.918387+0000","last_fullsized":"2024-09-21T09:11:07.918387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:44.655482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874314+0000","last_change":"2024-09-21T09:10:58.835449+0000","last_active":"2024-09-21T09:11:07.874314+0000","last_peered":"2024-09-21T09:11:07.874314+0000","last_clean":"2024-09-21T09:11:07.874314+0000","last_became_active":"2024-09-21T09:10:58.834588+0000","last_became_peered":"2024-09-21T09:10:58.834588+0000","last_unstale":"2024-09-21T09:11:07.874314+0000","last_undegraded":"2024-09-21T09:11:07.874314+0000","last_fullsized":"2024-09-21T09:11:07.874314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:39.496248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874354+0000","last_change":"2024-09-21T09:10:56.866139+0000","last_active":"2024-09-21T09:11:07.874354+0000","last_peered":"2024-09-21T09:11:07.874354+0000","last_clean":"2024-09-21T09:11:07.874354+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:11:07.874354+0000","last_undegraded":"2024-09-21T09:11:07.874354+0000","last_fullsized":"2024-09-21T09:11:07.874354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:33.551996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.873847+0000","last_change":"2024-09-21T09:10:58.840408+0000","last_active":"2024-09-21T09:11:07.873847+0000","last_peered":"2024-09-21T09:11:07.873847+0000","last_clean":"2024-09-21T09:11:07.873847+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:11:07.873847+0000","last_undegraded":"2024-09-21T09:11:07.873847+0000","last_fullsized":"2024-09-21T09:11:07.873847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:42.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861529+0000","last_change":"2024-09-21T09:10:56.860054+0000","last_active":"2024-09-21T09:11:07.861529+0000","last_peered":"2024-09-21T09:11:07.861529+0000","last_clean":"2024-09-21T09:11:07.861529+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:11:07.861529+0000","last_undegraded":"2024-09-21T09:11:07.861529+0000","last_fullsized":"2024-09-21T09:11:07.861529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860756+0000","last_change":"2024-09-21T09:10:58.836500+0000","last_active":"2024-09-21T09:11:07.860756+0000","last_peered":"2024-09-21T09:11:07.860756+0000","last_clean":"2024-09-21T09:11:07.860756+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:11:07.860756+0000","last_undegraded":"2024-09-21T09:11:07.860756+0000","last_fullsized":"2024-09-21T09:11:07.860756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.861569+0000","last_change":"2024-09-21T09:10:56.862765+0000","last_active":"2024-09-21T09:11:07.861569+0000","last_peered":"2024-09-21T09:11:07.861569+0000","last_clean":"2024-09-21T09:11:07.861569+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:11:07.861569+0000","last_undegraded":"2024-09-21T09:11:07.861569+0000","last_fullsized":"2024-09-21T09:11:07.861569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.860273+0000","last_change":"2024-09-21T09:10:58.826466+0000","last_active":"2024-09-21T09:11:07.860273+0000","last_peered":"2024-09-21T09:11:07.860273+0000","last_clean":"2024-09-21T09:11:07.860273+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:11:07.860273+0000","last_undegraded":"2024-09-21T09:11:07.860273+0000","last_fullsized":"2024-09-21T09:11:07.860273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.862158+0000","last_change":"2024-09-21T09:10:56.865042+0000","last_active":"2024-09-21T09:11:07.862158+0000","last_peered":"2024-09-21T09:11:07.862158+0000","last_clean":"2024-09-21T09:11:07.862158+0000","last_became_active":"2024-09-21T09:10:56.858460+0000","last_became_peered":"2024-09-21T09:10:56.858460+0000","last_unstale":"2024-09-21T09:11:07.862158+0000","last_undegraded":"2024-09-21T09:11:07.862158+0000","last_fullsized":"2024-09-21T09:11:07.862158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886438+0000","last_change":"2024-09-21T09:10:58.872072+0000","last_active":"2024-09-21T09:11:07.886438+0000","last_peered":"2024-09-21T09:11:07.886438+0000","last_clean":"2024-09-21T09:11:07.886438+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:11:07.886438+0000","last_undegraded":"2024-09-21T09:11:07.886438+0000","last_fullsized":"2024-09-21T09:11:07.886438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.875487+0000","last_change":"2024-09-21T09:10:56.861072+0000","last_active":"2024-09-21T09:11:07.875487+0000","last_peered":"2024-09-21T09:11:07.875487+0000","last_clean":"2024-09-21T09:11:07.875487+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:11:07.875487+0000","last_undegraded":"2024-09-21T09:11:07.875487+0000","last_fullsized":"2024-09-21T09:11:07.875487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892531+0000","last_change":"2024-09-21T09:10:58.856982+0000","last_active":"2024-09-21T09:11:07.892531+0000","last_peered":"2024-09-21T09:11:07.892531+0000","last_clean":"2024-09-21T09:11:07.892531+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:11:07.892531+0000","last_undegraded":"2024-09-21T09:11:07.892531+0000","last_fullsized":"2024-09-21T09:11:07.892531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917570+0000","last_change":"2024-09-21T09:10:56.847793+0000","last_active":"2024-09-21T09:11:07.917570+0000","last_peered":"2024-09-21T09:11:07.917570+0000","last_clean":"2024-09-21T09:11:07.917570+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:11:07.917570+0000","last_undegraded":"2024-09-21T09:11:07.917570+0000","last_fullsized":"2024-09-21T09:11:07.917570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:22.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.864128+0000","last_change":"2024-09-21T09:10:58.851481+0000","last_active":"2024-09-21T09:11:07.864128+0000","last_peered":"2024-09-21T09:11:07.864128+0000","last_clean":"2024-09-21T09:11:07.864128+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:11:07.864128+0000","last_undegraded":"2024-09-21T09:11:07.864128+0000","last_fullsized":"2024-09-21T09:11:07.864128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:42.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872808+0000","last_change":"2024-09-21T09:10:56.869306+0000","last_active":"2024-09-21T09:11:07.872808+0000","last_peered":"2024-09-21T09:11:07.872808+0000","last_clean":"2024-09-21T09:11:07.872808+0000","last_became_active":"2024-09-21T09:10:56.868642+0000","last_became_peered":"2024-09-21T09:10:56.868642+0000","last_unstale":"2024-09-21T09:11:07.872808+0000","last_undegraded":"2024-09-21T09:11:07.872808+0000","last_fullsized":"2024-09-21T09:11:07.872808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:41.032517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.874447+0000","last_change":"2024-09-21T09:10:58.843673+0000","last_active":"2024-09-21T09:11:07.874447+0000","last_peered":"2024-09-21T09:11:07.874447+0000","last_clean":"2024-09-21T09:11:07.874447+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:11:07.874447+0000","last_undegraded":"2024-09-21T09:11:07.874447+0000","last_fullsized":"2024-09-21T09:11:07.874447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:19.133330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887411+0000","last_change":"2024-09-21T09:10:56.838835+0000","last_active":"2024-09-21T09:11:07.887411+0000","last_peered":"2024-09-21T09:11:07.887411+0000","last_clean":"2024-09-21T09:11:07.887411+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:11:07.887411+0000","last_undegraded":"2024-09-21T09:11:07.887411+0000","last_fullsized":"2024-09-21T09:11:07.887411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886151+0000","last_change":"2024-09-21T09:10:58.869168+0000","last_active":"2024-09-21T09:11:07.886151+0000","last_peered":"2024-09-21T09:11:07.886151+0000","last_clean":"2024-09-21T09:11:07.886151+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:11:07.886151+0000","last_undegraded":"2024-09-21T09:11:07.886151+0000","last_fullsized":"2024-09-21T09:11:07.886151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.879317+0000","last_change":"2024-09-21T09:10:56.830478+0000","last_active":"2024-09-21T09:11:07.879317+0000","last_peered":"2024-09-21T09:11:07.879317+0000","last_clean":"2024-09-21T09:11:07.879317+0000","last_became_active":"2024-09-21T09:10:56.829720+0000","last_became_peered":"2024-09-21T09:10:56.829720+0000","last_unstale":"2024-09-21T09:11:07.879317+0000","last_undegraded":"2024-09-21T09:11:07.879317+0000","last_fullsized":"2024-09-21T09:11:07.879317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:31.318290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.885849+0000","last_change":"2024-09-21T09:10:58.840930+0000","last_active":"2024-09-21T09:11:07.885849+0000","last_peered":"2024-09-21T09:11:07.885849+0000","last_clean":"2024-09-21T09:11:07.885849+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:11:07.885849+0000","last_undegraded":"2024-09-21T09:11:07.885849+0000","last_fullsized":"2024-09-21T09:11:07.885849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.863192+0000","last_change":"2024-09-21T09:10:56.841366+0000","last_active":"2024-09-21T09:11:07.863192+0000","last_peered":"2024-09-21T09:11:07.863192+0000","last_clean":"2024-09-21T09:11:07.863192+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:11:07.863192+0000","last_undegraded":"2024-09-21T09:11:07.863192+0000","last_fullsized":"2024-09-21T09:11:07.863192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:15.948479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.890566+0000","last_change":"2024-09-21T09:10:58.873865+0000","last_active":"2024-09-21T09:11:07.890566+0000","last_peered":"2024-09-21T09:11:07.890566+0000","last_clean":"2024-09-21T09:11:07.890566+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:11:07.890566+0000","last_undegraded":"2024-09-21T09:11:07.890566+0000","last_fullsized":"2024-09-21T09:11:07.890566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919229+0000","last_change":"2024-09-21T09:10:56.843359+0000","last_active":"2024-09-21T09:11:07.919229+0000","last_peered":"2024-09-21T09:11:07.919229+0000","last_clean":"2024-09-21T09:11:07.919229+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:11:07.919229+0000","last_undegraded":"2024-09-21T09:11:07.919229+0000","last_fullsized":"2024-09-21T09:11:07.919229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:17.126175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.877694+0000","last_change":"2024-09-21T09:10:58.864268+0000","last_active":"2024-09-21T09:11:07.877694+0000","last_peered":"2024-09-21T09:11:07.877694+0000","last_clean":"2024-09-21T09:11:07.877694+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:11:07.877694+0000","last_undegraded":"2024-09-21T09:11:07.877694+0000","last_fullsized":"2024-09-21T09:11:07.877694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:22.929821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.892486+0000","last_change":"2024-09-21T09:10:56.868852+0000","last_active":"2024-09-21T09:11:07.892486+0000","last_peered":"2024-09-21T09:11:07.892486+0000","last_clean":"2024-09-21T09:11:07.892486+0000","last_became_active":"2024-09-21T09:10:56.868190+0000","last_became_peered":"2024-09-21T09:10:56.868190+0000","last_unstale":"2024-09-21T09:11:07.892486+0000","last_undegraded":"2024-09-21T09:11:07.892486+0000","last_fullsized":"2024-09-21T09:11:07.892486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.886290+0000","last_change":"2024-09-21T09:10:58.840040+0000","last_active":"2024-09-21T09:11:07.886290+0000","last_peered":"2024-09-21T09:11:07.886290+0000","last_clean":"2024-09-21T09:11:07.886290+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:11:07.886290+0000","last_undegraded":"2024-09-21T09:11:07.886290+0000","last_fullsized":"2024-09-21T09:11:07.886290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.919156+0000","last_change":"2024-09-21T09:10:56.845828+0000","last_active":"2024-09-21T09:11:07.919156+0000","last_peered":"2024-09-21T09:11:07.919156+0000","last_clean":"2024-09-21T09:11:07.919156+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:11:07.919156+0000","last_undegraded":"2024-09-21T09:11:07.919156+0000","last_fullsized":"2024-09-21T09:11:07.919156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:37.489093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.917457+0000","last_change":"2024-09-21T09:10:56.850266+0000","last_active":"2024-09-21T09:11:07.917457+0000","last_peered":"2024-09-21T09:11:07.917457+0000","last_clean":"2024-09-21T09:11:07.917457+0000","last_became_active":"2024-09-21T09:10:56.849742+0000","last_became_peered":"2024-09-21T09:10:56.849742+0000","last_unstale":"2024-09-21T09:11:07.917457+0000","last_undegraded":"2024-09-21T09:11:07.917457+0000","last_fullsized":"2024-09-21T09:11:07.917457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:55.985441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.880307+0000","last_change":"2024-09-21T09:10:58.871879+0000","last_active":"2024-09-21T09:11:07.880307+0000","last_peered":"2024-09-21T09:11:07.880307+0000","last_clean":"2024-09-21T09:11:07.880307+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:11:07.880307+0000","last_undegraded":"2024-09-21T09:11:07.880307+0000","last_fullsized":"2024-09-21T09:11:07.880307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:28.117298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.872697+0000","last_change":"2024-09-21T09:10:56.862439+0000","last_active":"2024-09-21T09:11:07.872697+0000","last_peered":"2024-09-21T09:11:07.872697+0000","last_clean":"2024-09-21T09:11:07.872697+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:11:07.872697+0000","last_undegraded":"2024-09-21T09:11:07.872697+0000","last_fullsized":"2024-09-21T09:11:07.872697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T09:11:07.887152+0000","last_change":"2024-09-21T09:10:58.828974+0000","last_active":"2024-09-21T09:11:07.887152+0000","last_peered":"2024-09-21T09:11:07.887152+0000","last_clean":"2024-09-21T09:11:07.887152+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:11:07.887152+0000","last_undegraded":"2024-09-21T09:11:07.887152+0000","last_fullsized":"2024-09-21T09:11:07.887152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":434176,"data_stored":175852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":430080,"data_stored":174914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":765373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":425984,"data_stored":174740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":409600,"data_stored":174781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1048576,"data_stored":765867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":176510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":438272,"data_stored":175487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:11:15.241 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T09:11:15.241 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-21T09:11:15.591 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 36 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-21T09:10:28.086623+0000 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-21T09:11:07.850209+0000 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:crush_version 5 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:full_ratio 0.95 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:backfillfull_ratio 0.9 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:nearfull_ratio 0.85 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:require_min_compat_client luminous 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:min_compat_client jewel 2024-09-21T09:11:15.592 INFO:teuthology.orchestra.run.smithi007.stdout:require_osd_release squid 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:stretch_mode_enabled false 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 23 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 4.98 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 1.13 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 32 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 34 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 36 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:max_osd 8 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6816/1603589667,v1:172.21.15.7:6817/1603589667] [v2:172.21.15.7:6818/1603589667,v1:172.21.15.7:6819/1603589667] exists,up 1d44c360-02ac-4142-a4a1-3ef3bae71ebf 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6824/4002665254,v1:172.21.15.7:6825/4002665254] [v2:172.21.15.7:6826/4002665254,v1:172.21.15.7:6827/4002665254] exists,up 02fc3a59-f3a3-412b-ba73-5f43dc7c4714 2024-09-21T09:11:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6808/992756194,v1:172.21.15.7:6809/992756194] [v2:172.21.15.7:6810/992756194,v1:172.21.15.7:6811/992756194] exists,up 2ad4a646-5d8d-431d-89c1-5f13ae2c6048 2024-09-21T09:11:15.594 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6800/1625592448,v1:172.21.15.7:6801/1625592448] [v2:172.21.15.7:6802/1625592448,v1:172.21.15.7:6803/1625592448] exists,up 99b23411-8e42-453f-917e-8342abf03624 2024-09-21T09:11:15.594 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 up in weight 1 up_from 13 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6802/50317293,v1:172.21.15.50:6803/50317293] [v2:172.21.15.50:6804/50317293,v1:172.21.15.50:6805/50317293] exists,up 7d1e4d92-c6ab-4218-bc8e-2809085574b4 2024-09-21T09:11:15.594 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6818/3773654391,v1:172.21.15.50:6820/3773654391] [v2:172.21.15.50:6822/3773654391,v1:172.21.15.50:6824/3773654391] exists,up 2065653a-bbf5-4d55-b57c-a947d18b5fa7 2024-09-21T09:11:15.594 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6819/2220031654,v1:172.21.15.50:6821/2220031654] [v2:172.21.15.50:6823/2220031654,v1:172.21.15.50:6825/2220031654] exists,up 59146344-8e80-4b04-8947-1c119e33be55 2024-09-21T09:11:15.594 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6810/647878711,v1:172.21.15.50:6811/647878711] [v2:172.21.15.50:6812/647878711,v1:172.21.15.50:6813/647878711] exists,up 2bd65ed0-7bb8-43d1-a5c6-0713c265495a 2024-09-21T09:11:15.611 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6816/1603589667,v1:172.21.15.7:6817/1603589667] [v2:172.21.15.7:6818/1603589667,v1:172.21.15.7:6819/1603589667] exists,up 1d44c360-02ac-4142-a4a1-3ef3bae71ebf', 'osd.1 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6824/4002665254,v1:172.21.15.7:6825/4002665254] [v2:172.21.15.7:6826/4002665254,v1:172.21.15.7:6827/4002665254] exists,up 02fc3a59-f3a3-412b-ba73-5f43dc7c4714', 'osd.2 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6808/992756194,v1:172.21.15.7:6809/992756194] [v2:172.21.15.7:6810/992756194,v1:172.21.15.7:6811/992756194] exists,up 2ad4a646-5d8d-431d-89c1-5f13ae2c6048', 'osd.3 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6800/1625592448,v1:172.21.15.7:6801/1625592448] [v2:172.21.15.7:6802/1625592448,v1:172.21.15.7:6803/1625592448] exists,up 99b23411-8e42-453f-917e-8342abf03624', 'osd.4 up in weight 1 up_from 13 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6802/50317293,v1:172.21.15.50:6803/50317293] [v2:172.21.15.50:6804/50317293,v1:172.21.15.50:6805/50317293] exists,up 7d1e4d92-c6ab-4218-bc8e-2809085574b4', 'osd.5 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6818/3773654391,v1:172.21.15.50:6820/3773654391] [v2:172.21.15.50:6822/3773654391,v1:172.21.15.50:6824/3773654391] exists,up 2065653a-bbf5-4d55-b57c-a947d18b5fa7', 'osd.6 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6819/2220031654,v1:172.21.15.50:6821/2220031654] [v2:172.21.15.50:6823/2220031654,v1:172.21.15.50:6825/2220031654] exists,up 59146344-8e80-4b04-8947-1c119e33be55', 'osd.7 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6810/647878711,v1:172.21.15.50:6811/647878711] [v2:172.21.15.50:6812/647878711,v1:172.21.15.50:6813/647878711] exists,up 2bd65ed0-7bb8-43d1-a5c6-0713c265495a'] 2024-09-21T09:11:15.611 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-21T09:11:15.733 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:15.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mon.a", 2024-09-21T09:11:15.733 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster": "ceph", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "admin_socket_mode": "", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_client_required": "cephx, none", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_cluster_required": "cephx", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_debug": "true", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_service_required": "cephx", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_supported": "cephx", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio": "true", 2024-09-21T09:11:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_poll_ms": "250", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_reap_max": "16", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_async_discard": "false", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_block_size": "4096", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio": "false", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_inflight_ios": "false", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_enable_discard": "false", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_flock_retry": "3", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_inject_crash": "0", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-21T09:11:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring": "false", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring_hipri": "false", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_type": "", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_alloc_size": "1048576", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_allocator": "hybrid", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_buffered_io": "true", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_check_for_zeros": "false", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-21T09:11:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_compact_log_sync": "false", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_max_log_runway": "4194304", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_max_prefetch": "1048576", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_min_flush_size": "524288", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_min_log_runway": "1048576", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_replay_recovery": "false", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-21T09:11:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_sync_write": "false", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_allocation_from_file": "true", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_allocator": "hybrid", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bdev_label_multi": "true", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-21T09:11:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_create": "true", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_create": "false", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_path": "", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_size": "0", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_path": "", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_preallocate_file": "false", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_size": "107374182400", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_create": "false", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_path": "", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_size": "100663296", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs": "true", 2024-09-21T09:11:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_autotune": "true", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size": "0", 2024-09-21T09:11:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_type": "2q", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_clone_cow": "true", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-21T09:11:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_mode": "none", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_csum_type": "crc32c", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_freelist": "false", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-21T09:11:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_small_allocations": "0", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_default_buffered_read": "true", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_default_buffered_write": "false", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-21T09:11:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fail_eio": "false", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mount": "false", 2024-09-21T09:11:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_umount": "false", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_ignore_data_csum": "false", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-21T09:11:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_op_age": "5.000000", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_alloc_size": "0", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size": "0", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_deferred_txc": "32", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size": "0", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_nid_prealloc": "1024", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-21T09:11:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_retry_disk_reads": "3", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_cf": "true", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-21T09:11:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_mem": "512", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_tracing": "false", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-21T09:11:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_zero_block_detection": "false", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-21T09:11:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_cluster_require_signatures": "false", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_cluster_require_version": "2", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_require_signatures": "false", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_require_version": "2", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_service_require_signatures": "false", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_service_require_version": "2", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_sign_messages": "true", 2024-09-21T09:11:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "chdir": "", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_acl_type": "", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_asio_thread_count": "2", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_cache_mid": "0.750000", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_cache_size": "16384", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_caps_release_delay": "5", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_check_pool_perm": "true", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_force_sync_read": "false", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_getattr_caps": "false", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_inject_features": "", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_inject_tick_delay": "0", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-21T09:11:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_die_on_failed_remount": "false", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_dirsize_rbytes": "true", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_force_lazyio": "false", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_fs": "", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_inject_release_failure": "false", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_max_inline_size": "4096", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mds_namespace": "", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_metadata": "", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_gid": "-1", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_timeout": "300", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_uid": "-1", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mountpoint": "/", 2024-09-21T09:11:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_notify_timeout": "10", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc": "true", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_dirty": "104857600", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_objects": "1000", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_size": "209715200", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_target_dirty": "8388608", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_permissions": "true", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_quota": "true", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_quota_df": "true", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_max_bytes": "0", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_max_periods": "4", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_min": "131072", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_reconnect_stale": "false", 2024-09-21T09:11:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_shutdown_timeout": "30", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_snapdir": ".snap", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_tick_interval": "1", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_trace": "", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_try_dentry_invalidate": "false", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_use_faked_inos": "false", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_use_random_mds": "false", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog": "false", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog_port": "12201", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_monitors": "default=true", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog": "false", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-21T09:11:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog_level": "info", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "-", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_network": "", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_network_interface": "", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_isal": "false", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_level": "5", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_winsize": "-15", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zstd_level": "1", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_alien_op_num_threads": "6", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-21T09:11:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_osd_stat_interval": "0", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_seastar_cpu_cores": "", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_seastar_num_threads": "0", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location": "", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location_hook": "", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location_hook_timeout": "10", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "daemonize": "false", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "daos_pool": "tank", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_alienstore": "0/5", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_allow_any_pool_priority": "false", 2024-09-21T09:11:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asok": "1/5", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asok_assert_abort": "false", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asserts_on_shutdown": "true", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_auth": "20/20", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bdev": "1/3", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bluefs": "1/5", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bluestore": "1/5", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_buffer": "0/1", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_ceph_exporter": "1/5", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cephfs_mirror": "0/5", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cephsqlite": "0/5", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_client": "0/5", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_compressor": "1/5", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_context": "0/1", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_crimson_interrupt": "0/5", 2024-09-21T09:11:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_crush": "1/1", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_crypto": "1/5", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cyanstore": "0/5", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_deliberately_leak_memory": "false", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_disable_randomized_ping": "false", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_dpdk": "1/5", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_eventtrace": "1/5", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_filer": "0/1", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_filestore": "1/3", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_finisher": "1/1", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_fuse": "1/5", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_heartbeat_testing_span": "0", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_heartbeatmap": "1/5", 2024-09-21T09:11:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_javaclient": "1/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_journal": "1/3", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_journaler": "0/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_kstore": "1/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_lockdep": "0/1", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mclock": "1/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds": "1/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_balancer": "1/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_locker": "1/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_log": "1/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_log_expire": "1/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_migrator": "1/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_quiesce": "3/5", 2024-09-21T09:11:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_memstore": "1/5", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mgr": "2/5", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mgrc": "1/5", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mon": "20/20", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_monc": "0/10", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_ms": "1/1", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_none": "0/5", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objclass": "0/5", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objectcacher": "0/5", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objecter": "0/1", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_optracker": "0/5", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_osd": "1/5", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_paxos": "20/20", 2024-09-21T09:11:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_perfcounter": "1/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_prioritycache": "1/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rados": "0/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd": "0/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_mirror": "0/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_pwl": "0/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_replay": "0/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_refs": "0/0", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_reserver": "1/1", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw": "1/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_access": "1/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_datacache": "1/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_dbstore": "1/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_flight": "1/5", 2024-09-21T09:11:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_sync": "1/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rocksdb": "4/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore": "0/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_backref": "0/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_cache": "0/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_cleaner": "0/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_device": "0/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_epm": "0/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_journal": "0/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_lba": "0/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_odata": "0/5", 2024-09-21T09:11:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_omap": "0/5", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_onode": "0/5", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_t": "0/5", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_tm": "0/5", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_striper": "0/1", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_test": "0/5", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_throttle": "1/1", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_timer": "0/1", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_tp": "0/5", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_trace": "1/5", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "device_failure_prediction_mode": "none", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-21T09:11:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_graylog": "false", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_journald": "false", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_stderr": "true", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_syslog": "false", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event_tracing": "false", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_addr": "0.0.0.0", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_http_port": "9926", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_prio_limit": "5", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_sort_metrics": "true", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_stats_period": "5", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "fake_statfs_for_testing": "0", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "fatal_signal_handlers": "true", 2024-09-21T09:11:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "filer_max_purge_ops": "10", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filer_max_truncate_ops": "128", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_apply_finisher_threads": "1", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_blackhole": "false", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_btrfs_clone_range": "true", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_btrfs_snap": "true", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_caller_concurrency": "10", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_collect_device_partition_information": "true", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_commit_timeout": "600.000000", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_inject_read_err": "false", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_omap_check": "false", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-21T09:11:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_verify_split": "false", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_dump_file": "", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fadvise": "true", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fail_eio": "true", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fd_cache_shards": "16", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fd_cache_size": "128", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fiemap": "false", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fiemap_threshold": "4096", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_inject_stall": "0", 2024-09-21T09:11:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_parallel": "false", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_trailing": "false", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_writeahead": "false", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_kill_at": "0", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs": "0", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-21T09:11:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size": "0", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_merge_threshold": "-10", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_odsync_write": "false", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_backend": "rocksdb", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_backend_path": "", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-21T09:11:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_thread_timeout": "60", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_threads": "2", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_punch_hole": "false", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_ops": "50", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-21T09:11:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_seek_data_hole": "false", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_sloppy_crc": "false", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_splice": "false", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_split_multiple": "2", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_split_rand_factor": "20", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_update_to": "1000", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-21T09:11:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_enable": "true", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_xfs_extsize": "false", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_zfs_snap": "false", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "fio_dir": "/tmp/fio", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_allow_other": "true", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_atomic_o_trunc": "true", 2024-09-21T09:11:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_big_writes": "true", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_debug": "false", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_default_permissions": "false", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_disable_pagecache": "false", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_max_write": "0", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_multithreaded": "true", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_require_active_mds": "true", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_set_user_groups": "true", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_move": "true", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_read": "true", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_write": "true", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_use_invalidate_cb": "true", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-21T09:11:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "gss_target_name": "ceph", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_file": "", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_inject_failure": "0", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_interval": "5", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "host": "smithi007", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-21T09:11:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "inject_early_sigterm": "false", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "jaeger_agent_port": "6799", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "jaeger_tracing_enable": "false", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_aio": "true", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_align_min_size": "65536", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_block_align": "true", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_block_size": "4096", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_dio": "true", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_discard": "false", 2024-09-21T09:11:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_force_aio": "false", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_ignore_corruption": "false", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_max_write_bytes": "10485760", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_max_write_entries": "100", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_replay_from": "0", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_write_header_frequency": "0", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_zero_on_create": "false", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_prefetch_periods": "10", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_prezero_periods": "5", 2024-09-21T09:11:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_write_head_interval": "15", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "keyfile": "", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_backend": "rocksdb", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_default_stripe_size": "65536", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_fsck_on_mount": "false", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_max_bytes": "67108864", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_max_ops": "512", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_nid_prealloc": "1024", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_onode_map_size": "1024", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_sync_submit_transaction": "false", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_sync_transaction": "false", 2024-09-21T09:11:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "librados_thread_count": "2", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "lockdep": "false", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "lockdep_force_backtrace": "false", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_coarse_timestamps": "true", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_flush_on_exit": "false", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_graylog_host": "127.0.0.1", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_graylog_port": "12201", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_max_new": "1000", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_max_recent": "10000", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_stderr_prefix": "", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_stop_at_utilization": "0.970000", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": "true", 2024-09-21T09:11:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_graylog": "false", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_journald": "false", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_stderr": "false", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_syslog": "false", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "max_rotating_auth_attempts": "10", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_action_on_write_error": "1", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_alternate_name_max": "8192", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_asio_thread_count": "2", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_export_pin": "true", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_dirs": "true", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_interval": "5", 2024-09-21T09:11:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_interval": "10", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_max": "-1", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_max_until": "-1", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_merge_size": "50", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_midchunk": "0.300000", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_min_start": "0.200000", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_minchunk": "0.001000", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_mode": "0", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_need_max": "1.200000", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_need_min": "0.800000", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_overload_epochs": "2", 2024-09-21T09:11:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_bits": "3", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_size": "10000", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_target_decay": "10.000000", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_grace": "15.000000", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_interval": "4.000000", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_mid": "0.700000", 2024-09-21T09:11:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_quiesce_delay": "0", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_release_free_interval": "10", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_reservation": "0.050000", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_interval": "1", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_threshold": "262144", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_prealloc_inos": "1000", 2024-09-21T09:11:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_connect_bootstrapping": "false", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_damage_table_max_entries": "10000", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_auth_pins": "false", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_frag": "false", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_scatterstat": "false", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_subtrees": "false", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_decay_halflife": "5.000000", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_default_dir_hash": "2", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_defer_session_stale": "true", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_deny_all_reconnect": "false", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_keys_per_op": "16384", 2024-09-21T09:11:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_max_commit_size": "10", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_max_entries": "0", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_prefetch": "true", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_on_map": "false", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_early_reply": "true", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_enable_op_tracker": "true", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_enforce_unique_name": "true", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_random": "true", 2024-09-21T09:11:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_health_summarize_threshold": "10", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_health_dummy": "false", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-21T09:11:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_migrator_session_race": "false", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_join_fs": "", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_journal_format": "1", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_create_at": "0", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_export_at": "0", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_import_at": "0", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_at": "0", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_expire_at": "0", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_replay_at": "0", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_link_at": "0", 2024-09-21T09:11:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_mdstable_at": "0", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_openc_at": "0", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_rename_at": "0", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_shutdown_at": "0", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_event_large_threshold": "524288", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_events_per_segment": "1024", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_max_events": "-1", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_max_segments": "128", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_pause": "false", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_segment_size": "0", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-21T09:11:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_trim_threshold": "128", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_warn_factor": "2.000000", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_caps_per_client": "1048576", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_completed_flushes": "100000", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_completed_requests": "100000", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_export_size": "20971520", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_file_recover": "32", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_files": "64", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_ops": "8192", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_snaps_per_dir": "100", 2024-09-21T09:11:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_metrics_update_interval": "2", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_min_caps_per_client": "100", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_min_caps_working_set": "10000", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_numa_node": "-1", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_complaint_time": "30.000000", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_duration": "600", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_size": "20", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_slow_op_size": "20", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_log_threshold": "5", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_ping_grace": "15", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_ping_interval": "5", 2024-09-21T09:11:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_caps": "30000", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_warning_threshold": "262144", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_replay_interval": "1.000000", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_root_ino_gid": "0", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_root_ino_uid": "0", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-21T09:11:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_shutdown_check": "0", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_skip_ino": "0", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_max_uid": "4294967294", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_min_uid": "0", 2024-09-21T09:11:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_rstat": "false", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_standby_replay_damaged": "false", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_symlink_recovery": "true", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_thrash_exports": "0", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_thrash_fragments": "0", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_tick_interval": "5.000000", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_valgrind_exit": "false", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_verify_backtrace": "1", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_verify_scatter": "false", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_wipe_sessions": "false", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool_debug": "false", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-21T09:11:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_device_bytes": "1073741824", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_page_set": "false", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_page_size": "65536", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_bytes": "134217728", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_messages": "512", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_disabled_modules": "", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_enable_op_tracker": "true", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_max_pg_num_change": "128", 2024-09-21T09:11:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mds_bytes": "134217728", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mds_messages": "128", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mon_bytes": "134217728", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mon_messages": "128", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_op_history_duration": "600", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_op_history_size": "20", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_op_log_threshold": "5", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_osd_bytes": "536870912", 2024-09-21T09:11:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_osd_messages": "8192", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_pool": "true", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_standby_modules": "true", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_stats_period": "5", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_stats_threshold": "5", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_tick_period": "2", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_allow_pool_delete": "true", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_allow_pool_size_one": "true", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_auth_validate_all_caps": "true", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-21T09:11:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_bytes": "104857600", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_directed_command_retry": "2", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_parallel": "3", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_log_interval": "1.000000", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_ping_interval": "10.000000", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_target_rank": "-1", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-21T09:11:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_file_level": "debug", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_file": "true", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_journald": "false", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_bootstrap": "false", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_start": "false", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_trim": "true", 2024-09-21T09:11:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cpu_threads": "4", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_crush_min_required_version": "hammer", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_daemon_bytes": "419430400", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_avail_crit": "5", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_avail_warn": "5", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_size_warn": "16106127360", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_json": "false", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-21T09:11:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_transactions": "false", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_extra_checks": "false", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_reef": "false", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_squid": "false", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_down_mkfs_grace": "120", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_down_uptime_grace": "60", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_election_default_strategy": "1", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_election_timeout": "5.000000", 2024-09-21T09:11:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ping_divisor": "2", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_enable_op_tracker": "true", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_fake_pool_delete": "false", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_force_quorum_join": "false", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_globalid_prealloc": "10000", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_detail_to_clog": "false", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_log_update_period": "5", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_max_detail": "50", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog": "true", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog_interval": "600", 2024-09-21T09:11:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_host": "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.50", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_host_override": "", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_initial_members": "", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease": "5.000000", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_log_full_interval": "50", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_log_max": "10000", 2024-09-21T09:11:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_log_max_summary": "50", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_log_epochs": "500", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_osd": "10000", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_pg_per_osd": "10000", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_pool_pg_num": "65536", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_force_trim_to": "0", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_skip_sanity": "false", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_memory_autotune": "true", 2024-09-21T09:11:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_memory_target": "2147483648", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_beacon_grace": "30", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_digest_period": "5", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_inactive_grace": "60", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_min_osdmap_epochs": "500", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_complaint_time": "30", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_duration": "600", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_size": "20", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_slow_op_size": "20", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_log_threshold": "5", 2024-09-21T09:11:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_in": "false", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_cache_size": "500", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_down_out_interval": "600", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-21T09:11:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_force_trim_to": "0", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_down_reporters": "2", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-21T09:11:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_report_timeout": "900", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_stuck_threshold": "60", 2024-09-21T09:11:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_probe_timeout": "2.000000", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_max_change": "0.050000", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_max_osds": "4", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-21T09:11:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_interval": "86400", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_max_keys": "100", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_timeout": "300", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_session_timeout": "300", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_smart_report_timeout": "5", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stat_smooth_intervals": "6", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_pool_min_size": "2", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_pool_size": "4", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_debug": "false", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-21T09:11:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_provider_kill_at": "0", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_requester_kill_at": "0", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_timeout": "60.000000", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_target_pg_per_osd": "100", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_tick_interval": "5", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_timecheck_interval": "300.000000", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_use_min_delay_socket": "false", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_older_version_delay": "604800", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-21T09:11:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_misplaced": "false", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_older_version": "true", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-21T09:11:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "monmap": "", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_tracing_enabled": "false", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_op_threads": "3", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_cm": "false", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_device_name": "", 2024-09-21T09:11:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_dscp": "96", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_local_gid": "", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_port_num": "1", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_sl": "3", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_support_srq": "true", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_type": "ib", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_reap_threshold": "5", 2024-09-21T09:11:15.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_before_connect": "false", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_ipv4": "true", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_ipv6": "false", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_msgr1": "true", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_msgr2": "true", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_port_max": "7568", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_port_min": "6800", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_retry_count": "3", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_retry_delay": "5", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_client": "false", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mds": "false", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mgr": "false", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mon": "false", 2024-09-21T09:11:15.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_osd": "false", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_client_mode": "crc secure", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_cluster_mode": "crc secure", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_cluster_type": "", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_compress_secure": "false", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_connection_idle_timeout": "900", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_connection_ready_timeout": "10", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_crc_data": "true", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_crc_header": "true", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_bad_msg": "false", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_bug": "true", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_old_message": "true", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_skipped_message": "false", 2024-09-21T09:11:15.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_coremask": "0xF", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_enable_tso": "true", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hugepages": "", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_lro": "true", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_memory_channel": "4", 2024-09-21T09:11:15.814 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_pmd": "", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_port_id": "0", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dump_on_send": "false", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_initial_backoff": "0.200000", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_max": "1.000000", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_type": "", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_network_congestion": "0", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_socket_failures": "0", 2024-09-21T09:11:15.815 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_learn_addr_from_peer": "true", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_max_accept_failures": "4", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_max_backoff": "15.000000", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_client_mode": "secure crc", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_service_mode": "secure crc", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_osd_compress_min_size": "1024", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_osd_compress_mode": "none", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_pq_min_cost": "65536", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_public_type": "", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_service_mode": "crc secure", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_listen_backlog": "512", 2024-09-21T09:11:15.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_nodelay": "true", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_rcvbuf": "0", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_type": "async+posix", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "no_config_file": "false", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_completion_locks_per_session": "32", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inflight_ops": "1024", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_tick_interval": "5.000000", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_timeout": "10.000000", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "objectstore_blackhole": "false", 2024-09-21T09:11:15.817 INFO:teuthology.orchestra.run.smithi007.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "openssl_engine_opts": "", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_delay_time": "5.000000", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_hist_halflife": "1000", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_max_low_ops": "2", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_max_ops": "4", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_slop": "0.020000", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_asio_thread_count": "2", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_async_recovery_min_cost": "100", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-21T09:11:15.818 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_scan_max": "512", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_scan_min": "64", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_degraded": "false", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_peering": "false", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_unfound": "true", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_beacon_report_interval": "300", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_duration": "30", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_max_block_size": "67108864", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_blkin_trace_all": "false", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-21T09:11:15.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_check_for_log_corruption": "false", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_update_on_start": "true", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_message_cap": "256", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_message_size_cap": "524288000", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_op_priority": "63", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_watch_timeout": "30", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_command_max_records": "256", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_compact_on_start": "false", 2024-09-21T09:11:15.820 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_update_on_start": "true", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_update_weight_set": "true", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_feed_pullee": "-1", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-21T09:11:15.821 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_misdirected_ops": "false", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_no_acting_change": "false", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_no_purge_strays": "false", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_op_order": "false", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_shutdown": "false", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_trim_objects": "false", 2024-09-21T09:11:15.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_snaps": "false", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_keys": "1024", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_stride": "524288", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_default_notify_timeout": "30", 2024-09-21T09:11:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep": "0.000000", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_discard_disconnected_ops": "true", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_enable_op_tracker": "true", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_info": "true", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown": "true", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-21T09:11:15.824 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_function_tracing": "false", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_grace": "20", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_interval": "6", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_peers": "10", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_size": "2000", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_stale": "600", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_max_size": "100000", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_min_size": "1000", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-21T09:11:15.825 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal_size": "5120", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_kill_backfill_at": "0", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_cache_size": "50", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_dedup": "true", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_message_max": "40", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_share_max_epochs": "40", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_attr_name_len": "100", 2024-09-21T09:11:15.826 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_attr_size": "0", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_backfills": "1", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_markdown_count": "5", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_markdown_period": "600", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_name_len": "2048", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_namespace_len": "256", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_size": "134217728", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_blocked_by": "16", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_log_entries": "10000", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pgls": "1024", 2024-09-21T09:11:15.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_push_cost": "8388608", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_push_objects": "10", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_scrubs": "3", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_trimming_pgs": "2", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_write_op_reply_len": "64", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_write_size": "90", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-21T09:11:15.828 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_profile": "balanced", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_base": "805306368", 2024-09-21T09:11:15.829 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_cache_min": "134217728", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target": "4294967296", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target_autotune": "false", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_min_pg_log_entries": "250", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_min_recovery_priority": "0", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_report_interval": "5", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-21T09:11:15.830 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_num_cache_shards": "32", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_num_op_tracker_shard": "32", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_auto_affinity": "true", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_node": "-1", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_prefer_iface": "true", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objecter_finishers": "1", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore": "bluestore", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore_fuse": "false", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore_tracing": "false", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_complaint_time": "30.000000", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_duration": "600", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_size": "20", 2024-09-21T09:11:15.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_slow_op_size": "20", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_log_threshold": "5", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards": "0", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards_hdd": "5", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards_ssd": "8", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_pq_min_cost": "65536", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_queue_cut_off": "high", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-21T09:11:15.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_thread_timeout": "15", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_open_classes_on_start": "true", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_os_flags": "0", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_peering_op_priority": "255", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_delete_cost": "1048576", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_delete_priority": "5", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_trim_max": "10000", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_trim_min": "100", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-21T09:11:15.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_crimson": "false", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-21T09:11:15.834 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flags": "0", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_min_size": "0", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pg_num": "32", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pgp_num": "0", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_read_ratio": "70", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_size": "2", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_type": "replicated", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-21T09:11:15.835 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_push_per_object_cost": "1000", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recover_clone_overlap": "true", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_cost": "20971520", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active": "0", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_single_start": "1", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_op_priority": "3", 2024-09-21T09:11:15.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_priority": "5", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep": "0.000000", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_repair_during_recovery": "false", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_requested_scrub_priority": "120", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_auto_repair": "false", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-21T09:11:15.837 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_begin_hour": "0", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_begin_week_day": "0", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_chunk_max": "25", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_chunk_min": "5", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_cost": "52428800", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_during_recovery": "false", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_end_hour": "0", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_end_week_day": "0", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_event_cost": "4096", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_invalid_stats": "true", 2024-09-21T09:11:15.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_max_preemptions": "5", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_priority": "5", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_sleep": "0.000000", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_skip_data_digest": "false", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_smart_report_timeout": "5", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_cost": "1048576", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_priority": "5", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-21T09:11:15.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_target_transaction_size": "30", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-21T09:11:15.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tracing": "false", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_use_stale_snap": "false", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "osdc_blkin_trace_all": "false", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_kill_at": "0", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_max_join_drift": "10", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_min": "500", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_min_wait": "0.050000", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_propose_interval": "1.000000", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_max": "500", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-21T09:11:15.841 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_min": "250", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_stash_full_interval": "25", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_trim_max": "500", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_trim_min": "250", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "perf": "true", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "-", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrv": "", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "public_bind_addr": "-", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "public_network": "", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "public_network_interface": "", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "qat_compressor_busy_polling": "false", 2024-09-21T09:11:15.842 INFO:teuthology.orchestra.run.smithi007.stdout: "qat_compressor_enabled": "false", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "qat_compressor_session_max_number": "256", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_mon_op_timeout": "0", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_osd_op_timeout": "0", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_tracing": "false", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_atime_update_interval": "60", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_balance_parent_reads": "false", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_balance_snap_reads": "false", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blkin_trace_all": "false", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache": "true", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-21T09:11:15.843 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_policy": "writearound", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_size": "33554432", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_clone_copy_on_read": "false", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_compression_hint": "none", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_concurrent_management_ops": "10", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_clone_format": "auto", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_data_pool": "", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_features": "61", 2024-09-21T09:11:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_format": "2", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_map_options": "", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_order": "22", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_pool": "rbd", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_stripe_count": "0", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_stripe_unit": "0", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_enable_alloc_hint": "true", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_io_scheduler": "simple", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-21T09:11:15.845 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_order": "24", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_pool": "", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_splay_width": "4", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_localize_parent_reads": "false", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_localize_snap_reads": "false", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-21T09:11:15.846 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-21T09:11:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-21T09:11:15.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mtime_update_interval": "60", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_non_blocking_aio": "true", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_op_thread_timeout": "60", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_op_threads": "1", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_parent_cache_enabled": "false", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_plugins": "", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_burst": "0", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_limit": "0", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_exclude_ops": "0", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_burst": "0", 2024-09-21T09:11:15.849 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_limit": "0", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-21T09:11:15.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_read_from_replica_policy": "default", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_skip_partial_discard": "true", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_tracing": "false", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_validate_names": "true", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_validate_pool": "true", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "restapi_base_url": "", 2024-09-21T09:11:15.851 INFO:teuthology.orchestra.run.smithi007.stdout: "restapi_log_level": "", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_acl_grants_max_num": "100", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_admin_entry": "admin", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_backend_store": "rados", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_barbican_url": "", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_beast_enable_async": "true", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_counters_cache": "false", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-21T09:11:15.852 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_enabled": "true", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_expiry_interval": "900", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_lru_size": "25000", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_config_store": "rados", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_content_length_compat": "false", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_copy_obj_progress": "true", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cors_rules_max_num": "100", 2024-09-21T09:11:15.853 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cross_domain_policy": "", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_addr": "", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_password": "", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_username": "", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_require_ssl": "true", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-21T09:11:15.854 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_addr": "", 2024-09-21T09:11:15.855 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_auth": "token", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_namespace": "", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_prefix": "", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_token_file": "", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_buffersize": "524288", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_low_speed_time": "300", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-21T09:11:15.856 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d4n_port": "6379", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_changes_size": "1000", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_num_shards": "128", 2024-09-21T09:11:15.857 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_window": "30", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-21T09:11:15.858 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-21T09:11:15.859 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dns_name": "", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dns_s3website_name": "", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dynamic_resharding": "true", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_gc_threads": "true", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_lc_threads": "true", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_ops_log": "false", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_quota_threads": "true", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_static_website": "false", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_usage_log": "false", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enforce_swift_acls": "true", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_exit_timeout_secs": "120", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_expose_bucket": "false", 2024-09-21T09:11:15.860 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_extended_http_attrs": "", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_filter": "none", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_frontends": "beast port=7480", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_deferred": "50", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_objs": "32", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_processor_period": "3600", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-21T09:11:15.861 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_init_timeout": "300", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_kafka_connection_idle": "300", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_domain": "", 2024-09-21T09:11:15.862 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_password": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_password_path": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_project": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_tenant": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_token": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_token_path": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_user": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_api_version": "2", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_domain": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_password": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_project": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_user": "", 2024-09-21T09:11:15.863 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_url": "", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_debug_interval": "-1", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_lock_max_time": "90", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_objs": "32", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_rules": "1000", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_worker": "3", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_thread_delay": "0", 2024-09-21T09:11:15.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_dnattr": "uid", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_searchfilter": "", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_uri": "", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_http_headers": "", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_object_name_utc": "false", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-21T09:11:15.865 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attr_name_len": "0", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attr_size": "0", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_chunk_size": "4194304", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_listing_results": "1000", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_notify_retries": "10", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_put_param_size": "1048576", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_put_size": "5368709120", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_slo_entries": "1000", 2024-09-21T09:11:15.866 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_md_log_max_shards": "64", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_mp_lock_max_time": "600", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-21T09:11:15.867 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_max_gc": "300", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_num_async_rados_threads": "32", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_num_control_oids": "8", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_numa_node": "-1", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-21T09:11:15.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_chunk_size": "100", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_gc_interval": "600", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_thread_timeout": "600", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_tracing": "false", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_token": "", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_url": "", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_verify_ssl": "true", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_rados": "false", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_socket_path": "", 2024-09-21T09:11:15.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_push_interval": "2.000000", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_cache_lanes": "3", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_cache_partitions": "3", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_print_continue": "true", 2024-09-21T09:11:15.870 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_tracing": "false", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm": "", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm_id": "", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_region": "", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-21T09:11:15.871 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_request_uri": "", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_batch_size": "64", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_max_aio": "128", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_num_logs": "16", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_thread_interval": "600", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_resolve_cname": "false", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_run_sync_thread": "true", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-21T09:11:15.872 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_scheduler_type": "throttler", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_script_uri": "", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_service_provider_name": "", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_client_id": "", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_client_secret": "", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_entry": "sts", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_key": "sts", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_min_session_duration": "900", 2024-09-21T09:11:15.873 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_token_introspection_url": "", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_account_in_url": "false", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_auth_entry": "auth", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_auth_url": "", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_custom_header": "", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_need_stats": "true", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_tenant_name": "", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_token_expiration": "86400", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_url": "", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_url_prefix": "swift", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-21T09:11:15.874 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_lease_period": "120", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_thread_pool_size": "512", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-21T09:11:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_comment": "", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_createby": "", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_encoding": "", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_flag": "false", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_origin": "", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_tracker": "", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_trust_forwarded_https": "false", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_max_shards": "32", 2024-09-21T09:11:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_max_user_shards": "1", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_use_opa_authz": "false", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_counters_cache": "false", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_max_buckets": "1000", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_policies_max_num": "100", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_unique_email": "true", 2024-09-21T09:11:15.877 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_verify_ssl": "true", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone": "", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone_id": "", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup": "", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup_id": "", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rgwlc_auto_session_clear": "true", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_block_size": "4096", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-21T09:11:15.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_size": "536870912", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_index_type": "binary_search", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_partition_filters": "false", 2024-09-21T09:11:15.879 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_perf": "false", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "run_dir": "/var/run/ceph", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_block_create": "true", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_cache_lru_size": "67108864", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_default_max_object_size": "16777216", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_device_size": "53687091200", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_full_integrity_check": "false", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_batch_capacity": "16", 2024-09-21T09:11:15.880 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_main_device_type": "SSD", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_segment_size": "67108864", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "set_keepcaps": "false", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "setgroup": "", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "setuser": "", 2024-09-21T09:11:15.881 INFO:teuthology.orchestra.run.smithi007.stdout: "setuser_match_path": "", 2024-09-21T09:11:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-21T09:11:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "thp": "false", 2024-09-21T09:11:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "threadpool_default_timeout": "60", 2024-09-21T09:11:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-21T09:11:15.882 INFO:teuthology.orchestra.run.smithi007.stdout: "throttler_perf_counter": "true" 2024-09-21T09:11:15.882 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:15.884 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-21T09:11:16.031 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a: {} 2024-09-21T09:11:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T09:11:16.044 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b: {} 2024-09-21T09:11:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T09:11:16.054 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c: {} 2024-09-21T09:11:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T09:11:16.071 DEBUG:teuthology.orchestra.run.smithi007:> type ceph-objectstore-tool 2024-09-21T09:11:16.075 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-21T09:11:16.075 DEBUG:teuthology.orchestra.run.smithi050:> type ceph-objectstore-tool 2024-09-21T09:11:16.081 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-21T09:11:16.081 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T09:11:16.094 INFO:tasks.workunit:Pulling workunits from ref 4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T09:11:16.094 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T09:11:16.094 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T09:11:16.095 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-21T09:11:16.095 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T09:11:16.095 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T09:11:16.095 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-21T09:11:16.095 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-21T09:11:16.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:11:16.096 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-21T09:11:16.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:11:16.096 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-21T09:11:16.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T09:11:16.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:11:16.120 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-21T09:11:16.121 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-21T09:11:16.126 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:16.124+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:16.169 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-21T09:11:16.169 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-21T09:11:16.217 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:16.213+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:16.221 INFO:tasks.workunit:timeout=3h 2024-09-21T09:11:16.221 INFO:tasks.workunit:cleanup=True 2024-09-21T09:11:16.221 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-21T09:11:16.242 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:16.242 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:16.247 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T09:11:16.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:11:16.260 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:16.261 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:16.293 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:16.293 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:16.298 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:16.296+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:16.312 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:16.313 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:16.331 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:16.352 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:16.379 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:16.379 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:16.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:11:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:16.402 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:16.402 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:16.397+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:16.423 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:16.500 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:16.496+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:16.542 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:16.542 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:16.555 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:11:16.601 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:16.600+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:16.686 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:16.686 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:16.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:11:16.702 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:16.697+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:16.803 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:16.797+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:16.828 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:16.829 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:16.843 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:11:16.904 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:16.900+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:16.999 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:16.999 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:17.005 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:17.001+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:17.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:11:17.105 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:17.101+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:17.177 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:17.178 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:17.192 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:11:17.206 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:17.208+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:17.308 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:17.301+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:17.351 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:17.351 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:17.367 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:11:17.409 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:17.404+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-09-21T09:11:17.512 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:17.509+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:17.540 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:17.540 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:17.554 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:11:17.649 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:17.645+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:17.711 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:17.705+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:17.728 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:17.728 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:17.742 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:11:17.829 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:17.825+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:17.912 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:17.912 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:17.913 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:17.908+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:17.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:11:18.017 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:18.013+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:18.100 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:18.101 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:18.114 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:18.109+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:18.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:11:18.215 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:18.209+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:18.249 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:18.250 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:18.264 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:11:18.316 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:18.313+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:18.389 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:18.389 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:18.403 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:11:18.418 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:18.417+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:18.443 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:11:18.519 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:18.516+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:18.523 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:18.523 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:18.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:11:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:18.602 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:18.619 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:18.619 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:18.625 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:18.624+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:18.638 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:18.638 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:18.657 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:18.658 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:18.678 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:18.678 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:18.699 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:18.702 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:18.702 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:18.702 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:18.702 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:18.717 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:11:18.719 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:18.719 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:18.720 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:18.713+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:18.738 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:18.739 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:18.821 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:18.817+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:18.887 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:11:18.887 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:11:18.887 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:18.901 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:11:18.922 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:18.917+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:19.023 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:19.020+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:19.033 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:105 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'67, mlcod=18'64)", 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.077285+0000", 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.955433126999999, 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044933220000000001, 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077285+0000", 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077285+0000", 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077287+0000", 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-06 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077298+0000", 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1678999999999999e-05 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077320+0000", 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1846999999999999e-05 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077343+0000", 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3056000000000001e-05 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077475+0000", 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013190599999999999 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077533+0000", 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7763000000000002e-05 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081682+0000", 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041487779999999997 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081778+0000", 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6606000000000003e-05 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:106 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'68, mlcod=18'64)", 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.078473+0000", 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.954245069999999, 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054399260000000003, 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078473+0000", 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078473+0000", 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078475+0000", 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.917e-06 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078532+0000", 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7065999999999999e-05 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078562+0000", 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9960000000000001e-05 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078576+0000", 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4117000000000001e-05 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078706+0000", 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129825 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078757+0000", 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1409999999999997e-05 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083837+0000", 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050797009999999998 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083913+0000", 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.593e-05 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:107 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'69, mlcod=18'64)", 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.079055+0000", 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.953663560999999, 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049846589999999998, 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079055+0000", 2024-09-21T09:11:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079055+0000", 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079056+0000", 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079065+0000", 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7539999999999995e-06 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079083+0000", 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8675999999999999e-05 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079095+0000", 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1192999999999999e-05 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080121+0000", 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010260919999999999 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080169+0000", 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8622999999999998e-05 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083920+0000", 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037501890000000001 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084039+0000", 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119672 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:108 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'70, mlcod=18'64)", 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.079893+0000", 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.952825007999998, 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060657009999999997, 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079893+0000", 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079893+0000", 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079895+0000", 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7999999999999999e-06 2024-09-21T09:11:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079907+0000", 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1804000000000001e-05 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079936+0000", 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8952999999999999e-05 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079949+0000", 2024-09-21T09:11:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3137e-05 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080782+0000", 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000833146 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080837+0000", 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4676999999999998e-05 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085875+0000", 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050385079999999997 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085959+0000", 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3676000000000003e-05 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:109 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'71, mlcod=18'65)", 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.080883+0000", 2024-09-21T09:11:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.951835160999998, 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051320599999999999, 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080883+0000", 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080883+0000", 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080885+0000", 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8300000000000001e-06 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080949+0000", 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4325000000000005e-05 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080971+0000", 2024-09-21T09:11:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2044000000000001e-05 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080986+0000", 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5033e-05 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081896+0000", 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090971300000000004 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081933+0000", 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7013e-05 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085964+0000", 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040313859999999997 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086015+0000", 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0716e-05 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:110 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'72, mlcod=18'65)", 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.081561+0000", 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.951157190000004, 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068081039999999997, 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081561+0000", 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081561+0000", 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081563+0000", 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081574+0000", 2024-09-21T09:11:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1783000000000001e-05 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081648+0000", 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3219999999999994e-05 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081662+0000", 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4476e-05 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083047+0000", 2024-09-21T09:11:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001385159 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083101+0000", 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3477000000000003e-05 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088271+0000", 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051698569999999999 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088369+0000", 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8371999999999999e-05 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:111 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'73, mlcod=18'65)", 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.082289+0000", 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.950429188999998, 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061528659999999999, 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082289+0000", 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082289+0000", 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082291+0000", 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.243e-06 2024-09-21T09:11:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082303+0000", 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2217e-05 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082338+0000", 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4650000000000002e-05 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082357+0000", 2024-09-21T09:11:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8830000000000001e-05 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084154+0000", 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001796843 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084208+0000", 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3878999999999997e-05 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088378+0000", 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041704339999999998 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088442+0000", 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3769999999999994e-05 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:112 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'65)", 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.082917+0000", 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.949801454000003, 2024-09-21T09:11:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066998520000000001, 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082917+0000", 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082917+0000", 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082919+0000", 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.95e-06 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083051+0000", 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132509 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083073+0000", 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1763000000000002e-05 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083088+0000", 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4759999999999999e-05 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084918+0000", 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018304829999999999 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084951+0000", 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2772999999999999e-05 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089556+0000", 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046048310000000002 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089616+0000", 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0782999999999997e-05 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:113 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'66)", 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.083741+0000", 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.948977202999998, 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005920687, 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083741+0000", 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083741+0000", 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083743+0000", 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7230000000000001e-06 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083757+0000", 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.438e-05 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083785+0000", 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8073e-05 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083801+0000", 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6217000000000001e-05 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086120+0000", 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023185749999999998 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086175+0000", 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4666000000000001e-05 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089619+0000", 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034447100000000001 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089662+0000", 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2342999999999998e-05 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:114 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'66)", 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.084454+0000", 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.948263738000001, 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052759850000000004, 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084454+0000", 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084454+0000", 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084456+0000", 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8700000000000001e-06 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084468+0000", 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2179e-05 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084502+0000", 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3433000000000003e-05 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084523+0000", 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0930000000000001e-05 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086844+0000", 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023216589999999998 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086884+0000", 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9526000000000001e-05 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089663+0000", 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027793819999999999 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089730+0000", 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7006000000000002e-05 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:115 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'66)", 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.085022+0000", 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.947696489999998, 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047624859999999998, 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085022+0000", 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085022+0000", 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085027+0000", 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4129999999999997e-06 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085079+0000", 2024-09-21T09:11:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1826999999999997e-05 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085103+0000", 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4029999999999999e-05 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085115+0000", 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1695999999999999e-05 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.087411+0000", 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002296846 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.087453+0000", 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1205999999999998e-05 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089739+0000", 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002286546 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089784+0000", 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4922000000000001e-05 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:116 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'68)", 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.086116+0000", 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.946602247999998, 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038724229999999998, 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086116+0000", 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086116+0000", 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086117+0000", 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.313e-06 2024-09-21T09:11:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086150+0000", 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2639999999999999e-05 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086174+0000", 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3975999999999999e-05 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086195+0000", 2024-09-21T09:11:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1157000000000001e-05 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088527+0000", 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023322120000000002 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088562+0000", 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5132999999999997e-05 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089854+0000", 2024-09-21T09:11:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012916469999999999 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089988+0000", 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013434499999999999 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:117 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'68)", 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.086625+0000", 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.946093582000003, 2024-09-21T09:11:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039355589999999999, 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086625+0000", 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086625+0000", 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086626+0000", 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086638+0000", 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2313000000000001e-05 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086671+0000", 2024-09-21T09:11:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2626000000000002e-05 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086700+0000", 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9462999999999999e-05 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089210+0000", 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025098540000000002 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089249+0000", 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8452999999999999e-05 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.090456+0000", 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012076540000000001 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.090560+0000", 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103699 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:154 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'108, mlcod=18'105)", 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:46.380168+0000", 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.652550445000003, 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037211079999999999, 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380168+0000", 2024-09-21T09:11:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380168+0000", 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380169+0000", 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5300000000000002e-07 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380181+0000", 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2357e-05 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380201+0000", 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9847000000000002e-05 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380213+0000", 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2556e-05 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380491+0000", 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000277512 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380541+0000", 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9778999999999999e-05 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383827+0000", 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032865479999999998 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383889+0000", 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1556000000000005e-05 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:156 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'110, mlcod=18'105)", 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:46.381673+0000", 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.651045136, 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044253549999999997, 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381673+0000", 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381673+0000", 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381674+0000", 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381690+0000", 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5339e-05 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381715+0000", 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5562999999999999e-05 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381727+0000", 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.185e-05 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382518+0000", 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00079086399999999996 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382567+0000", 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9404000000000003e-05 2024-09-21T09:11:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386033+0000", 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034651830000000002 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386098+0000", 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5691999999999994e-05 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:157 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'111, mlcod=18'105)", 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:46.382226+0000", 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.650492151000002, 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039245130000000001, 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382226+0000", 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382226+0000", 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382227+0000", 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.33e-06 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382245+0000", 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7620000000000001e-05 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382270+0000", 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.548e-05 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382291+0000", 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0789999999999999e-05 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383190+0000", 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00089835000000000002 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383222+0000", 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2923000000000003e-05 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386101+0000", 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028787700000000001 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386150+0000", 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9249999999999998e-05 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:273 6.f 6:f1983ba0:::obj_delete_at_hint.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.013982+0000", 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.018735618999999, 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040761240000000004, 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 273 2024-09-21T09:11:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013982+0000", 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013982+0000", 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013985+0000", 2024-09-21T09:11:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4159999999999998e-06 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013998+0000", 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2763e-05 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014030+0000", 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2756000000000003e-05 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014051+0000", 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0947000000000001e-05 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014204+0000", 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000152709 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014557+0000", 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000353347 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015067+0000", 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00050914899999999997 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.017078+0000", 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020112250000000002 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.017896+0000", 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00081820700000000005 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.017991+0000", 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4993000000000003e-05 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.018059+0000", 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7612000000000003e-05 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.383916+0000", 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.648801708000001, 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037879570000000002, 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 772 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383916+0000", 2024-09-21T09:11:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383916+0000", 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383919+0000", 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2139999999999999e-06 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383930+0000", 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1189000000000001e-05 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383961+0000", 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1612999999999997e-05 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383978+0000", 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.694e-05 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.384133+0000", 2024-09-21T09:11:19.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154189 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.384535+0000", 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040250399999999998 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.385123+0000", 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00058813099999999998 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.386381+0000", 2024-09-21T09:11:19.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001258194 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.387430+0000", 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010481550000000001 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.387587+0000", 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015717899999999999 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.387704+0000", 2024-09-21T09:11:19.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000117649 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.514264+0000", 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.518454500000001, 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003553245, 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.114 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 826 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514264+0000", 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514264+0000", 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514266+0000", 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5399999999999998e-06 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514280+0000", 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3966e-05 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514313+0000", 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3003000000000002e-05 2024-09-21T09:11:19.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514329+0000", 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5945999999999999e-05 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514492+0000", 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016315899999999999 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514882+0000", 2024-09-21T09:11:19.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000389467 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.515469+0000", 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00058772900000000005 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.516749+0000", 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012796109999999999 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.517537+0000", 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00078829699999999998 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.517694+0000", 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015676199999999999 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.517817+0000", 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012276499999999999 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.571517+0000", 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.461200902, 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035514919999999998, 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 850 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.120 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571517+0000", 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571517+0000", 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571519+0000", 2024-09-21T09:11:19.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1459999999999999e-06 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571530+0000", 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0764000000000001e-05 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571562+0000", 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1925999999999999e-05 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571577+0000", 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4970000000000001e-05 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571728+0000", 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015116199999999999 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.572100+0000", 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000371877 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.572719+0000", 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00061880599999999996 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.574053+0000", 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013340120000000001 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.574789+0000", 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073572500000000001 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.574947+0000", 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015836800000000001 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.575069+0000", 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121736 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.125 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:19.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:11:19.127 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:19.128+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:19.228 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:19.225+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:19.302 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:19.302 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:19.302 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:19.303 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:19.316 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:11:19.361 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:19.360+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:19.429 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:19.429+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:19.436 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:19.437 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:19.437 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:11:19.437 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:11:19.437 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:19.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:11:19.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T09:11:19.541 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:19.540+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:19.618 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:19.618 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:19.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:19.618 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:19.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.618 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-21T09:11:19.618 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:19.618 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.722905354, 2024-09-21T09:11:19.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032488320000000001, 2024-09-21T09:11:19.619 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.619 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.619 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.619 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:19.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892890+0000", 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9460000000000001e-06 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892903+0000", 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3191e-05 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892931+0000", 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8263e-05 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892952+0000", 2024-09-21T09:11:19.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.084e-05 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.893079+0000", 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126372 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.893129+0000", 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0575000000000003e-05 2024-09-21T09:11:19.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.896028+0000", 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028986569999999998 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.896137+0000", 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010898799999999999 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.709110612, 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004079816, 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 212 2024-09-21T09:11:19.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906685+0000", 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906698+0000", 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.226e-05 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906738+0000", 2024-09-21T09:11:19.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0790000000000001e-05 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906760+0000", 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1053e-05 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906890+0000", 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013003900000000001 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.907102+0000", 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021250899999999999 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.907740+0000", 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000638158 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.909485+0000", 2024-09-21T09:11:19.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017448299999999999 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910591+0000", 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011057549999999999 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910687+0000", 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6642000000000001e-05 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910763+0000", 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5220000000000001e-05 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:19.630 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.645404490000001, 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032988240000000001, 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 227 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970391+0000", 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2929999999999999e-06 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970403+0000", 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1317e-05 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970434+0000", 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970449+0000", 2024-09-21T09:11:19.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5270000000000001e-05 2024-09-21T09:11:19.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970568+0000", 2024-09-21T09:11:19.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119209 2024-09-21T09:11:19.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970802+0000", 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233482 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.971219+0000", 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041719000000000001 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.972619+0000", 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400466 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973531+0000", 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00091115300000000005 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973619+0000", 2024-09-21T09:11:19.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8451999999999999e-05 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973688+0000", 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8685999999999999e-05 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.638249629000001, 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032094659999999998, 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 229 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977546+0000", 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0099999999999998e-06 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977556+0000", 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0567000000000001e-05 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977587+0000", 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1040000000000001e-05 2024-09-21T09:11:19.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977602+0000", 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4905999999999999e-05 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977714+0000", 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111433 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977932+0000", 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021773800000000001 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.978379+0000", 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044706699999999999 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.979968+0000", 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015892879999999999 2024-09-21T09:11:19.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980596+0000", 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00062846199999999999 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980686+0000", 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9555000000000006e-05 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980753+0000", 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7399999999999998e-05 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.631345118, 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00337558, 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.644 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 231 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984450+0000", 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.996e-06 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984460+0000", 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0084e-05 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984489+0000", 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8306e-05 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984502+0000", 2024-09-21T09:11:19.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3686000000000001e-05 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984650+0000", 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000147646 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984867+0000", 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217355 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.985296+0000", 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042830599999999999 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.986743+0000", 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001447786 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987670+0000", 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092669599999999997 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987757+0000", 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6889000000000001e-05 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987824+0000", 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6829999999999995e-05 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.624408604999999, 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034045730000000001, 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.651 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 233 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991387+0000", 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0229999999999999e-06 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991397+0000", 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.049e-05 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991429+0000", 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1619999999999999e-05 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991444+0000", 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4763000000000001e-05 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991615+0000", 2024-09-21T09:11:19.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000170946 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991838+0000", 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022331099999999999 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.992265+0000", 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042681000000000001 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.993741+0000", 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001475762 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994623+0000", 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088250999999999998 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994721+0000", 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7836000000000003e-05 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994789+0000", 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8502000000000002e-05 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:304 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.594635437999999, 2024-09-21T09:11:19.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036139980000000002, 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 304 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:19.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021161+0000", 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5069999999999999e-06 2024-09-21T09:11:19.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021173+0000", 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2583e-05 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021214+0000", 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1069000000000003e-05 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021241+0000", 2024-09-21T09:11:19.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6906999999999998e-05 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021408+0000", 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000167152 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021731+0000", 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032271399999999999 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:19.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.022158+0000", 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042704700000000001 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023398+0000", 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012401230000000001 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024548+0000", 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011494140000000001 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024666+0000", 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118676 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024772+0000", 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105806 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.21656158, 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037127079999999999, 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 778 2024-09-21T09:11:19.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399235+0000", 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8700000000000001e-06 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399248+0000", 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3366e-05 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399282+0000", 2024-09-21T09:11:19.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3893999999999998e-05 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399298+0000", 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.592e-05 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399460+0000", 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016227200000000001 2024-09-21T09:11:19.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399836+0000", 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037539000000000002 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.400430+0000", 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059482899999999995 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402013+0000", 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001582111 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402653+0000", 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00064022500000000002 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402822+0000", 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016921500000000001 2024-09-21T09:11:19.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402945+0000", 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012261600000000001 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:19.670 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.211520966, 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032620489999999999, 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 780 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404274+0000", 2024-09-21T09:11:19.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7770000000000001e-06 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404288+0000", 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3556e-05 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404322+0000", 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4097000000000002e-05 2024-09-21T09:11:19.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404339+0000", 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7033000000000001e-05 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404488+0000", 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014927899999999999 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404726+0000", 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023736800000000001 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.405211+0000", 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048574000000000002 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.406409+0000", 2024-09-21T09:11:19.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011978010000000001 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407327+0000", 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00091810600000000002 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407415+0000", 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8103000000000007e-05 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407535+0000", 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119189 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.208056829, 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00307639, 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.677 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 781 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407739+0000", 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9039999999999999e-06 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407749+0000", 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0285999999999999e-05 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407776+0000", 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7362999999999999e-05 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407794+0000", 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7343e-05 2024-09-21T09:11:19.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407956+0000", 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000162872 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.408173+0000", 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021697599999999999 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.408519+0000", 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034568000000000001 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.409685+0000", 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001166081 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410657+0000", 2024-09-21T09:11:19.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000972276 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410748+0000", 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0883000000000004e-05 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410813+0000", 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4726000000000003e-05 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.683 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.172504160000001, 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003006463, 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.684 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 796 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443292+0000", 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3360000000000002e-06 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443303+0000", 2024-09-21T09:11:19.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1216999999999999e-05 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443334+0000", 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1007000000000003e-05 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443349+0000", 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5549999999999999e-05 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443498+0000", 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014889800000000001 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443708+0000", 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020971499999999999 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:19.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.444011+0000", 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030331100000000001 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.445066+0000", 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010543390000000001 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446140+0000", 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001074342 2024-09-21T09:11:19.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446230+0000", 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0082999999999998e-05 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446296+0000", 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5665000000000002e-05 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.690 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.008705234000001, 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003056933, 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.691 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 865 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607091+0000", 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2859999999999998e-06 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607102+0000", 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1087000000000001e-05 2024-09-21T09:11:19.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607134+0000", 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2422999999999998e-05 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607149+0000", 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.541e-05 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607277+0000", 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012709900000000001 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607492+0000", 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021501499999999999 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607801+0000", 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030958100000000002 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.609238+0000", 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014371620000000001 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.609990+0000", 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00075128100000000002 2024-09-21T09:11:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.610079+0000", 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9769000000000001e-05 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.610145+0000", 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5820000000000003e-05 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.697 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.004517476, 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029754769999999998, 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.698 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 867 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611278+0000", 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611288+0000", 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0149999999999999e-05 2024-09-21T09:11:19.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611315+0000", 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7080000000000002e-05 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611328+0000", 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3137e-05 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611440+0000", 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111462 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611564+0000", 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012396299999999999 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611831+0000", 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026706100000000002 2024-09-21T09:11:19.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.612759+0000", 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092851299999999995 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614096+0000", 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013366490000000001 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614187+0000", 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0519999999999994e-05 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614251+0000", 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4886000000000002e-05 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:19.704 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.993573825, 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029765310000000001, 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 871 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622222+0000", 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.21e-06 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622233+0000", 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0824e-05 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622264+0000", 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1449999999999999e-05 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622279+0000", 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4600000000000001e-05 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622403+0000", 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012454499999999999 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622633+0000", 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023006200000000001 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622953+0000", 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031925699999999998 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.623929+0000", 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00097615600000000005 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625044+0000", 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011150450000000001 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625131+0000", 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7006e-05 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625196+0000", 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5376000000000006e-05 2024-09-21T09:11:19.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.921258146, 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033591379999999998, 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 901 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694538+0000", 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2900000000000001e-06 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694549+0000", 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1727e-05 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694580+0000", 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1046000000000001e-05 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694595+0000", 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4630000000000001e-05 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694753+0000", 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158209 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.695123+0000", 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036946400000000001 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.695679+0000", 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055595600000000003 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.696976+0000", 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012978569999999999 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697612+0000", 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00063595500000000001 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697772+0000", 2024-09-21T09:11:19.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015977499999999999 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697894+0000", 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012222900000000001 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.717 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.916526771999999, 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033021410000000002, 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 903 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.718 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699269+0000", 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-06 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699279+0000", 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0679999999999999e-05 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699313+0000", 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3492999999999999e-05 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699328+0000", 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5146e-05 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699453+0000", 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012516299999999999 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699695+0000", 2024-09-21T09:11:19.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024171800000000001 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.700179+0000", 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048459000000000002 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.701405+0000", 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012259300000000001 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702295+0000", 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088928599999999998 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702449+0000", 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154146 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702569+0000", 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120149 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.840876425999999, 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031752249999999998, 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.724 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 934 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774919+0000", 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774930+0000", 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0943e-05 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774962+0000", 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2332999999999997e-05 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774981+0000", 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.861e-05 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775151+0000", 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016968500000000001 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775374+0000", 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223408 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775703+0000", 2024-09-21T09:11:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032880099999999998 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.776995+0000", 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001292477 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.777936+0000", 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094082599999999997 2024-09-21T09:11:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.778023+0000", 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6630000000000002e-05 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.778092+0000", 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9511999999999994e-05 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.829309275, 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031504950000000001, 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 939 2024-09-21T09:11:19.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786486+0000", 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.243e-06 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786497+0000", 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0823e-05 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786529+0000", 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1843e-05 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786544+0000", 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4863e-05 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786714+0000", 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016992299999999999 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786857+0000", 2024-09-21T09:11:19.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143485 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.787126+0000", 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268285 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.788229+0000", 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001103234 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789472+0000", 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012431110000000001 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789568+0000", 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5563000000000006e-05 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789635+0000", 2024-09-21T09:11:19.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7121999999999999e-05 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.812520402000001, 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033136279999999999, 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 946 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803275+0000", 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.097e-06 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803286+0000", 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0823e-05 2024-09-21T09:11:19.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803317+0000", 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.095e-05 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803332+0000", 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4816e-05 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803496+0000", 2024-09-21T09:11:19.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000164442 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803870+0000", 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037405700000000001 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.804492+0000", 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00062171500000000001 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.805916+0000", 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001424533 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806305+0000", 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038826399999999998 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806462+0000", 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000156885 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806587+0000", 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125046 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.743 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.808045465999999, 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031808890000000001, 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 948 2024-09-21T09:11:19.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807749+0000", 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.39e-06 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807757+0000", 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7430000000000002e-06 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807780+0000", 2024-09-21T09:11:19.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2480000000000002e-05 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807793+0000", 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807917+0000", 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000123573 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.808151+0000", 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000234625 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.808661+0000", 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00050934999999999999 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.809886+0000", 2024-09-21T09:11:19.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012251230000000001 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810640+0000", 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00075449700000000002 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810803+0000", 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016247899999999999 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:19.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:19.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:19.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810929+0000", 2024-09-21T09:11:19.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126153 2024-09-21T09:11:19.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.750 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:19.750 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:19.750 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:19.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:11:19.752 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:19.745+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:19.852 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:19.848+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:19.924 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:19.925 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:19.925 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:19.925 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:19.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:11:19.953 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:19.949+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:20.054 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:20.052+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:20.100 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:11:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:11:20.100 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:20.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:11:20.157 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:20.156+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:20.256 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:20.252+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:20.291 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:20.291 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:20.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:20.291 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:20.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.291 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:20.291 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:20.291 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.282346262000001, 2024-09-21T09:11:20.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003218832, 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 193 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:20.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006552+0000", 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0430000000000002e-06 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006564+0000", 2024-09-21T09:11:20.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1416999999999999e-05 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006596+0000", 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1899000000000001e-05 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006611+0000", 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5452999999999999e-05 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006757+0000", 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145816 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.007003+0000", 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024615500000000002 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.007288+0000", 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000285304 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.008784+0000", 2024-09-21T09:11:20.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001495449 2024-09-21T09:11:20.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009620+0000", 2024-09-21T09:11:20.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00083642999999999999 2024-09-21T09:11:20.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009701+0000", 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0653000000000002e-05 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009769+0000", 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8213000000000006e-05 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.297 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.402578843000001, 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091541390000000004, 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 208 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886321+0000", 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3500000000000001e-06 2024-09-21T09:11:20.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886355+0000", 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3986000000000003e-05 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886391+0000", 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5947e-05 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886412+0000", 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1022999999999998e-05 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886600+0000", 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018761200000000001 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886611+0000", 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1759999999999999e-05 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.891318+0000", 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004706689 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.891698+0000", 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000380174 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.892508+0000", 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00080938400000000001 2024-09-21T09:11:20.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.893820+0000", 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013127830000000001 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895296+0000", 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014755289999999999 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895394+0000", 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8226000000000004e-05 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895472+0000", 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7676000000000006e-05 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:20.304 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.359631068000001, 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035744320000000002, 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 216 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:20.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929268+0000", 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8229999999999999e-06 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929279+0000", 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1194e-05 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929312+0000", 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2991999999999999e-05 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929328+0000", 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5733999999999999e-05 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929487+0000", 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158579 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929719+0000", 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000232351 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.930129+0000", 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000409687 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.931616+0000", 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014871109999999999 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932688+0000", 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010723359999999999 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932774+0000", 2024-09-21T09:11:20.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5688999999999999e-05 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932840+0000", 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5936e-05 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.351670709, 2024-09-21T09:11:20.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035738390000000001, 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 218 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937228+0000", 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1069999999999999e-06 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937238+0000", 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0349e-05 2024-09-21T09:11:20.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937270+0000", 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1690000000000003e-05 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937285+0000", 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5167000000000001e-05 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937408+0000", 2024-09-21T09:11:20.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000122519 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937628+0000", 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022077800000000001 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.938055+0000", 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042683700000000001 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.939639+0000", 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015836540000000001 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940641+0000", 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001002246 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940735+0000", 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3725000000000001e-05 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940800+0000", 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4766999999999998e-05 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.347717920000001, 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034600199999999998, 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.316 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 219 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941181+0000", 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1399999999999998e-06 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941191+0000", 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0257e-05 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941224+0000", 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2786000000000001e-05 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941247+0000", 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.336e-05 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941345+0000", 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7769000000000005e-05 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941556+0000", 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021123499999999999 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.942003+0000", 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044704 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.943418+0000", 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014148019999999999 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944488+0000", 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001070192 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944576+0000", 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7355999999999995e-05 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944639+0000", 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3083000000000006e-05 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.321 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.328897069, 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033829009999999998, 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 224 2024-09-21T09:11:20.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960001+0000", 2024-09-21T09:11:20.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0329999999999998e-06 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960012+0000", 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0437e-05 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960045+0000", 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2676999999999999e-05 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960068+0000", 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2935999999999999e-05 2024-09-21T09:11:20.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960194+0000", 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012679600000000001 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960446+0000", 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025164099999999998 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960917+0000", 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047095600000000002 2024-09-21T09:11:20.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.962230+0000", 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013132669999999999 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963231+0000", 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010005599999999999 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963321+0000", 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9825000000000001e-05 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963382+0000", 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1773000000000006e-05 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.290308266, 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033658070000000002, 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.327 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 235 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:20.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998590+0000", 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2299999999999998e-06 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998601+0000", 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0959e-05 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998635+0000", 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3420000000000002e-05 2024-09-21T09:11:20.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998658+0000", 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3159999999999998e-05 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998781+0000", 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012267199999999999 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.999025+0000", 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000243892 2024-09-21T09:11:20.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.999452+0000", 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042783699999999998 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.000893+0000", 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001440275 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001739+0000", 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00084627300000000003 2024-09-21T09:11:20.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001834+0000", 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4826000000000003e-05 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001954+0000", 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120263 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:263 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.276618935, 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034424360000000001, 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 263 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.333 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012280+0000", 2024-09-21T09:11:20.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1799999999999999e-06 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012292+0000", 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1763000000000001e-05 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012326+0000", 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4493000000000003e-05 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012343+0000", 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6813e-05 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012527+0000", 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018387899999999999 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012699+0000", 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017209500000000001 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013267+0000", 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056834500000000005 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014605+0000", 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013380899999999999 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015459+0000", 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00085365300000000001 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015612+0000", 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015307600000000001 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015720+0000", 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010804899999999999 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.338 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:297 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.268746006000001, 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033597840000000002, 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 297 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020152+0000", 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020162+0000", 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7829999999999993e-06 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020193+0000", 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1102999999999997e-05 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020214+0000", 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0486999999999999e-05 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020390+0000", 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176369 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020603+0000", 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021285100000000001 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020873+0000", 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026986799999999999 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.022546+0000", 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016730440000000001 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023289+0000", 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074325699999999999 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023412+0000", 2024-09-21T09:11:20.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012286900000000001 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023510+0000", 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8152999999999994e-05 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:373 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.245815327000001, 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032496819999999998, 2024-09-21T09:11:20.344 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 373 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043083+0000", 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3999999999999999e-06 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043110+0000", 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7370000000000001e-05 2024-09-21T09:11:20.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043128+0000", 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8320000000000001e-05 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043139+0000", 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0763e-05 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043748+0000", 2024-09-21T09:11:20.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060880199999999998 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043963+0000", 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000215198 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.044316+0000", 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284100000000001 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045592+0000", 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001275921 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046080+0000", 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048865200000000001 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046216+0000", 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013579600000000001 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046331+0000", 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011461899999999999 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:446 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.219194076999999, 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033921149999999998, 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.350 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 446 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069704+0000", 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7090000000000001e-06 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069713+0000", 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1630000000000002e-06 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069742+0000", 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8739999999999999e-05 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069754+0000", 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2271e-05 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069885+0000", 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013067999999999999 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.070151+0000", 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026643499999999998 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.070748+0000", 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059699500000000001 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.072288+0000", 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015399249999999999 2024-09-21T09:11:20.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.072942+0000", 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00065338199999999999 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.073033+0000", 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0826000000000001e-05 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.073095+0000", 2024-09-21T09:11:20.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1989000000000006e-05 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:452 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.214885095, 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031754840000000001, 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 452 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074013+0000", 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.331e-06 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074022+0000", 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1570000000000006e-06 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074046+0000", 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.374e-05 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074063+0000", 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074172+0000", 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010967300000000001 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074309+0000", 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136489 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074654+0000", 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034524499999999999 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.076228+0000", 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015737209999999999 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077038+0000", 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00081049799999999999 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077121+0000", 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2402000000000002e-05 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077187+0000", 2024-09-21T09:11:20.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6070999999999998e-05 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:493 6.13 6:cd178ae0:reshard::reshard.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.197718912999999, 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038520270000000001, 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.362 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 493 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091180+0000", 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.294e-06 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091202+0000", 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2039999999999999e-05 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091231+0000", 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8756999999999999e-05 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091246+0000", 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.49e-05 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091382+0000", 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136193 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091606+0000", 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022468499999999999 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091931+0000", 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000324171 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.093225+0000", 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012946329999999999 2024-09-21T09:11:20.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.094882+0000", 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016571750000000001 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.094957+0000", 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4991000000000001e-05 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.095030+0000", 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2187999999999994e-05 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:501 6.13 6:cd178ae0:reshard::reshard.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.192740398, 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003138456, 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.368 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 501 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:20.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096158+0000", 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096168+0000", 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0052e-05 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096191+0000", 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2965000000000001e-05 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096211+0000", 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0040000000000001e-05 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096403+0000", 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019186299999999999 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096630+0000", 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022718200000000001 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096990+0000", 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035963 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.098287+0000", 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012970600000000001 2024-09-21T09:11:20.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099072+0000", 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00078496299999999996 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099197+0000", 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012550699999999999 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099295+0000", 2024-09-21T09:11:20.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7194000000000005e-05 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:565 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.156612990999999, 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045932120000000002, 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.374 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 565 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132287+0000", 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2320000000000001e-06 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132300+0000", 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2782999999999999e-05 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132337+0000", 2024-09-21T09:11:20.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7036000000000003e-05 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132373+0000", 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6000000000000001e-05 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132537+0000", 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016473700000000001 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132788+0000", 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025062400000000002 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.133316+0000", 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052850300000000005 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134573+0000", 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012568449999999999 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136729+0000", 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021554590000000002 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136810+0000", 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1236000000000006e-05 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136877+0000", 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6756999999999998e-05 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.379 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:580 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.141355410999999, 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031517770000000001, 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.380 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 580 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147543+0000", 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6479999999999999e-06 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147552+0000", 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1400000000000006e-06 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147578+0000", 2024-09-21T09:11:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5680000000000001e-05 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147591+0000", 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3077e-05 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147726+0000", 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013512600000000001 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.148022+0000", 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029581200000000001 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.148500+0000", 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047833400000000002 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.149801+0000", 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001301024 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150536+0000", 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073525399999999996 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150638+0000", 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010145300000000001 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150693+0000", 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5229000000000003e-05 2024-09-21T09:11:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.862640167, 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030807830000000001, 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.386 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 789 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426258+0000", 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426269+0000", 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0366999999999999e-05 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426300+0000", 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1646000000000002e-05 2024-09-21T09:11:20.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426316+0000", 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5330000000000001e-05 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426464+0000", 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148455 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426728+0000", 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000263451 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.427238+0000", 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00051078300000000001 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.428446+0000", 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001207898 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429175+0000", 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072848399999999995 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429267+0000", 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2373000000000005e-05 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429337+0000", 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9936000000000003e-05 2024-09-21T09:11:20.391 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.810220048, 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003253124, 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.392 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 811 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478679+0000", 2024-09-21T09:11:20.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1629999999999999e-06 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478689+0000", 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.046e-05 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478721+0000", 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1535999999999998e-05 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478736+0000", 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5494000000000001e-05 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478888+0000", 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015226500000000001 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.479263+0000", 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037449100000000002 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.479864+0000", 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060063800000000002 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481130+0000", 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012669000000000001 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481767+0000", 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00063663499999999998 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481856+0000", 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9376999999999995e-05 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481930+0000", 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3164999999999995e-05 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.397 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.623342536999999, 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032567009999999999, 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 889 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665557+0000", 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6359999999999998e-06 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665569+0000", 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2296999999999999e-05 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665602+0000", 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3433000000000003e-05 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665620+0000", 2024-09-21T09:11:20.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7176e-05 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665779+0000", 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015932899999999999 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.666162+0000", 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038277999999999999 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.666737+0000", 2024-09-21T09:11:20.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057502599999999997 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668002+0000", 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001265024 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668648+0000", 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00064676200000000005 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668739+0000", 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0805999999999998e-05 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668811+0000", 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1432000000000003e-05 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.403 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.608746589000001, 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031261549999999998, 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 895 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680152+0000", 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680163+0000", 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0627e-05 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680195+0000", 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2521999999999998e-05 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680211+0000", 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5633000000000001e-05 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680393+0000", 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018196600000000001 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680627+0000", 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023373099999999999 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680971+0000", 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034410099999999998 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.682191+0000", 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012203940000000001 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683114+0000", 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092252999999999996 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683209+0000", 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5651999999999998e-05 2024-09-21T09:11:20.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:20.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:20.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:20.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683276+0000", 2024-09-21T09:11:20.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6855999999999998e-05 2024-09-21T09:11:20.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.409 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:20.409 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:20.409 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:20.410 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:11:20.411 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:20.408+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-09-21T09:11:20.512 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:20.508+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:20.551 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:20.551 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:20.551 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:20.551 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:20.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:11:20.612 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:20.608+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:20.691 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:20.691 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:20.691 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:20.691 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:20.691 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:20.706 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:11:20.754 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:20.749+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:20.757 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:11:20.814 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:20.809+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:20.834 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:20.834 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.949040068, 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.005197709, 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 46 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883306+0000", 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8680000000000001e-06 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883320+0000", 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3777e-05 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883355+0000", 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5457000000000003e-05 2024-09-21T09:11:20.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883381+0000", 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5548e-05 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883631+0000", 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025032199999999998 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883924+0000", 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029322899999999999 2024-09-21T09:11:20.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.884247+0000", 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032292300000000003 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.885849+0000", 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016019459999999999 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888259+0000", 2024-09-21T09:11:20.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024100409999999999 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888397+0000", 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013753600000000001 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888500+0000", 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103062 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113020240896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.943367916, 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058707430000000003, 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 47 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.841 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888977+0000", 2024-09-21T09:11:20.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888990+0000", 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.33e-05 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889036+0000", 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6328000000000001e-05 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889059+0000", 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3048e-05 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889882+0000", 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082253800000000005 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890147+0000", 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026500299999999998 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890549+0000", 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000402323 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.893575+0000", 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030257690000000002 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894522+0000", 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094709000000000004 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894675+0000", 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015305599999999999 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894845+0000", 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016973100000000001 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.846 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.832542566000001, 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035327039999999998, 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 191 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999801+0000", 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999812+0000", 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0183000000000001e-05 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999843+0000", 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1553000000000001e-05 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999858+0000", 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4907e-05 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000009+0000", 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000150786 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000333+0000", 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032434100000000002 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000821+0000", 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048796000000000001 2024-09-21T09:11:20.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.002625+0000", 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001803802 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003193+0000", 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056811000000000003 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003267+0000", 2024-09-21T09:11:20.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3980000000000007e-05 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003332+0000", 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5022000000000002e-05 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.967057783, 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039222459999999999, 2024-09-21T09:11:20.852 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 205 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865287+0000", 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3000000000000002e-06 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865304+0000", 2024-09-21T09:11:20.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6269999999999998e-05 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865349+0000", 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5652999999999998e-05 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865370+0000", 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1117000000000001e-05 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865572+0000", 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020120199999999999 2024-09-21T09:11:20.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865819+0000", 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024759800000000002 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.866195+0000", 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000375557 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.867603+0000", 2024-09-21T09:11:20.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001407967 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.868927+0000", 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013238410000000001 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869095+0000", 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016838899999999999 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869206+0000", 2024-09-21T09:11:20.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111352 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.938625015, 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031054379999999999, 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.858 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 209 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893719+0000", 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3599999999999999e-06 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893731+0000", 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.222e-05 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893765+0000", 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3782999999999998e-05 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893781+0000", 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893906+0000", 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012485299999999999 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894129+0000", 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022317800000000001 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894535+0000", 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040575399999999998 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.895977+0000", 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014418199999999999 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896619+0000", 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064255900000000001 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896704+0000", 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4653000000000004e-05 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896822+0000", 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118285 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.923282901, 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037831409999999998, 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 213 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909062+0000", 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0400000000000001e-06 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909075+0000", 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3094e-05 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909106+0000", 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0426e-05 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909121+0000", 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5903e-05 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909280+0000", 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000158772 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909665+0000", 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038435800000000001 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.910380+0000", 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071585799999999999 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912186+0000", 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018052649999999999 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912661+0000", 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047496399999999997 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912752+0000", 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1445000000000003e-05 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912842+0000", 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0016e-05 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.909039839, 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576779, 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 215 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923305+0000", 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5639999999999999e-06 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923317+0000", 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1956e-05 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923349+0000", 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2706999999999997e-05 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923366+0000", 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6552999999999999e-05 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923539+0000", 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017352200000000001 2024-09-21T09:11:20.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923939+0000", 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000399334 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.924459+0000", 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052057299999999998 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.925959+0000", 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001499703 2024-09-21T09:11:20.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926718+0000", 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075869800000000003 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926799+0000", 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0950000000000003e-05 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926879+0000", 2024-09-21T09:11:20.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0218999999999999e-05 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.885807019, 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031911079999999998, 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.875 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 221 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946537+0000", 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946549+0000", 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1527e-05 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946580+0000", 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1356999999999998e-05 2024-09-21T09:11:20.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946597+0000", 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7093000000000001e-05 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946714+0000", 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116872 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946936+0000", 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022225500000000001 2024-09-21T09:11:20.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.947359+0000", 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042271099999999999 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.948825+0000", 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014661159999999999 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949560+0000", 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073491500000000005 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949644+0000", 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4147000000000006e-05 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949726+0000", 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1854999999999995e-05 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.880 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.867326602, 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030775389999999998, 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 226 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.881 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965018+0000", 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2199999999999999e-06 2024-09-21T09:11:20.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965029+0000", 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1436e-05 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965061+0000", 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2055999999999999e-05 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965077+0000", 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.558e-05 2024-09-21T09:11:20.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965200+0000", 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012353599999999999 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965442+0000", 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024218199999999999 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965830+0000", 2024-09-21T09:11:20.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038740699999999999 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967527+0000", 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001696999 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967943+0000", 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041585999999999999 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968028+0000", 2024-09-21T09:11:20.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.53e-05 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968093+0000", 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4962999999999994e-05 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.491882970000001, 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029016699999999999, 2024-09-21T09:11:20.886 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 754 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340461+0000", 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340471+0000", 2024-09-21T09:11:20.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8199999999999992e-06 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340502+0000", 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1047000000000003e-05 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340527+0000", 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4739000000000001e-05 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340685+0000", 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015804600000000001 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340891+0000", 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020627199999999999 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.341212+0000", 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032101500000000002 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.342549+0000", 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013375469999999999 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343214+0000", 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066447900000000005 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343299+0000", 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5154999999999994e-05 2024-09-21T09:11:20.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343361+0000", 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1569999999999995e-05 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:757 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.485011898, 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029276440000000001, 2024-09-21T09:11:20.892 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 757 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347332+0000", 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0200000000000001e-06 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347343+0000", 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2024-09-21T09:11:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347374+0000", 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1600000000000002e-05 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347389+0000", 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.486e-05 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347509+0000", 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119815 2024-09-21T09:11:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347727+0000", 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217956 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.348046+0000", 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031872699999999999 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.349129+0000", 2024-09-21T09:11:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010836559999999999 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350046+0000", 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091629999999999999 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350135+0000", 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9666999999999994e-05 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350258+0000", 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012226899999999999 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:759 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.481179717, 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002979752, 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 759 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351164+0000", 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.703e-06 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351174+0000", 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0013000000000001e-05 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351205+0000", 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1189999999999998e-05 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351223+0000", 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8003e-05 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351341+0000", 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118306 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351470+0000", 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000129076 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351737+0000", 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026687199999999998 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353037+0000", 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012995509999999999 2024-09-21T09:11:20.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353989+0000", 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095197900000000004 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354076+0000", 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6730000000000005e-05 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354142+0000", 2024-09-21T09:11:20.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6328999999999995e-05 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.453633763999999, 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002900807, 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.904 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 771 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378710+0000", 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.42e-06 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378717+0000", 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4739999999999999e-06 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378740+0000", 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.268e-05 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378751+0000", 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1143e-05 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378925+0000", 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017384900000000001 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379066+0000", 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141712 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379328+0000", 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026180499999999999 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.380651+0000", 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322611 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381467+0000", 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081640100000000002 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381547+0000", 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9705999999999999e-05 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381609+0000", 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2006000000000002e-05 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.909 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.248199708, 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029926800000000002, 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.910 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 856 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584144+0000", 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2469999999999998e-06 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584158+0000", 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3519999999999999e-05 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584191+0000", 2024-09-21T09:11:20.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2617000000000003e-05 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584206+0000", 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5276000000000001e-05 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584325+0000", 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118929 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584567+0000", 2024-09-21T09:11:20.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242525 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584885+0000", 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031785100000000002 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.585978+0000", 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001093246 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.586991+0000", 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00101264 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587071+0000", 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9765999999999995e-05 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587135+0000", 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4063e-05 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:861 6.3 6:c0550c60:::obj_delete_at_hint.0000000094:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.237772641999999, 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00331716, 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 861 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.916 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594571+0000", 2024-09-21T09:11:20.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.686e-06 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594581+0000", 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8870000000000004e-06 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594612+0000", 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1433000000000002e-05 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594630+0000", 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7589999999999999e-05 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594779+0000", 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014932199999999999 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595030+0000", 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025084100000000002 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595533+0000", 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050262699999999996 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.596870+0000", 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013373580000000001 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597612+0000", 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074164800000000003 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597770+0000", 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015815499999999999 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597886+0000", 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116613 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:20.921 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.16119396, 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030306669999999999, 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 892 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:20.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:20.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671150+0000", 2024-09-21T09:11:20.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.097e-06 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671161+0000", 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0499999999999999e-05 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671191+0000", 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0383e-05 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671206+0000", 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5437000000000001e-05 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671359+0000", 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152189 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671584+0000", 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022531499999999999 2024-09-21T09:11:20.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671899+0000", 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031528399999999999 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673019+0000", 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011199560000000001 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673900+0000", 2024-09-21T09:11:20.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088067799999999997 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674066+0000", 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016586500000000001 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674179+0000", 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112963 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.929 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:904 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.131548234, 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003078852, 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 904 2024-09-21T09:11:20.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700796+0000", 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1840000000000002e-06 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700807+0000", 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1049999999999999e-05 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700836+0000", 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8833e-05 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700851+0000", 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4813e-05 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700970+0000", 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119456 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701187+0000", 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021738899999999999 2024-09-21T09:11:20.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701519+0000", 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033143400000000003 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.702692+0000", 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011726620000000001 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703599+0000", 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090731700000000004 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703756+0000", 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015696199999999999 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703873+0000", 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116752 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.935 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:906 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.127607544, 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031432679999999998, 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 906 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704736+0000", 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7400000000000001e-06 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704746+0000", 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4499999999999993e-06 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704770+0000", 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.402e-05 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704781+0000", 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1790000000000001e-05 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704909+0000", 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012782900000000001 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705162+0000", 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000253191 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705681+0000", 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051818999999999997 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707026+0000", 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013454840000000001 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707720+0000", 2024-09-21T09:11:20.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069363499999999995 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707803+0000", 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3603000000000006e-05 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707878+0000", 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4336000000000001e-05 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:919 6.5 6:a1987d85:::obj_delete_at_hint.0000000114:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.095267427, 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003079816, 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 919 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737077+0000", 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2699999999999999e-06 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737091+0000", 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3825999999999999e-05 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737121+0000", 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.046e-05 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737138+0000", 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6793999999999999e-05 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737252+0000", 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114552 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737522+0000", 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026934799999999998 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737855+0000", 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033290799999999998 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.739016+0000", 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011608949999999999 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740004+0000", 2024-09-21T09:11:20.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098829699999999996 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740090+0000", 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6645999999999997e-05 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740154+0000", 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3819999999999995e-05 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.038267953, 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003307838, 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 943 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:20.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794076+0000", 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.804e-06 2024-09-21T09:11:20.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794085+0000", 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5859999999999994e-06 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794113+0000", 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8056999999999999e-05 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794128+0000", 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4382999999999999e-05 2024-09-21T09:11:20.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794276+0000", 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000148286 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794649+0000", 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037297399999999998 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.795219+0000", 2024-09-21T09:11:20.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056944899999999998 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.796426+0000", 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012075390000000001 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797214+0000", 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078828100000000005 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797295+0000", 2024-09-21T09:11:20.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0289000000000003e-05 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797382+0000", 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7189999999999997e-05 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:20.953 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:20.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:11:20.955 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:20.956 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:20.956 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:20.957 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:20.957 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:20.949+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:20.972 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:20.972 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:20.993 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:20.993 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:21.014 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:21.014 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:21.035 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:21.035 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:21.055 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:21.049+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:21.089 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:21.090 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:21.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:11:21.188 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:21.185+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:21.257 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:21.256+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:21.267 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:21.267 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:21.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:11:21.369 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:21.365+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:21.446 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:21.446 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:21.458 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:21.456+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:21.461 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:11:21.559 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:21.553+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:21.633 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:21.633 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:21.647 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:11:21.689 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:21.689+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:21.761 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:21.760+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:21.813 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:21.813 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:21.828 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:11:21.876 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:21.873+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:21.950 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:21.951 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:21.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:11:21.964 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:21.960+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:22.063 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:22.057+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:22.115 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:22.115 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:22.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:11:22.173 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:22.173+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:22.265 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:22.265+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:22.296 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:22.297 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:22.311 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:11:22.366 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:22.364+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:22.467 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:22.464+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:22.479 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T09:11:22.482 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:22.482 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:22.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:11:22.568 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:22.565+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:22.632 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:22.632 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:22.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:11:22.689 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:22.688+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:22.770 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:22.768+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:22.773 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:22.773 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:22.787 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:11:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-09-21T09:11:22.871 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:22.869+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:22.959 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:22.960 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:22.972 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:22.969+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:22.974 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:11:23.056 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:11:23.100 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:23.100 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:23.101 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:23.101+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:23.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:11:23.174 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:23.173+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:23.213 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:23.214 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:23.231 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:23.231 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:23.236 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:23.236 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:23.249 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:23.249 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:23.250 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:11:23.265 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:23.286 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:23.287 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:23.297 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:23.296+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:23.306 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:23.325 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:23.325 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:23.346 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:23.346 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:23.375 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:23.372+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:23.385 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:23.385 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:23.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:23.385 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:23.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.385 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:105 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'67, mlcod=18'64)", 2024-09-21T09:11:23.385 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.077285+0000", 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.307209530999998, 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044933220000000001, 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077285+0000", 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077285+0000", 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077287+0000", 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-06 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077298+0000", 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1678999999999999e-05 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077320+0000", 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1846999999999999e-05 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077343+0000", 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3056000000000001e-05 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077475+0000", 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013190599999999999 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077533+0000", 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7763000000000002e-05 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081682+0000", 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041487779999999997 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081778+0000", 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6606000000000003e-05 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.389 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:106 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'68, mlcod=18'64)", 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.078473+0000", 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.306021473999998, 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054399260000000003, 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078473+0000", 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078473+0000", 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078475+0000", 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.917e-06 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078532+0000", 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7065999999999999e-05 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078562+0000", 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9960000000000001e-05 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078576+0000", 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4117000000000001e-05 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078706+0000", 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129825 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078757+0000", 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1409999999999997e-05 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083837+0000", 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050797009999999998 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083913+0000", 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.593e-05 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:107 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'69, mlcod=18'64)", 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.079055+0000", 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.305439964999998, 2024-09-21T09:11:23.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049846589999999998, 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079055+0000", 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079055+0000", 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079056+0000", 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079065+0000", 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7539999999999995e-06 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079083+0000", 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8675999999999999e-05 2024-09-21T09:11:23.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079095+0000", 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1192999999999999e-05 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080121+0000", 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010260919999999999 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080169+0000", 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8622999999999998e-05 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083920+0000", 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037501890000000001 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084039+0000", 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119672 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.398 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:108 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'70, mlcod=18'64)", 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.079893+0000", 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.304601411999997, 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060657009999999997, 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.399 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079893+0000", 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079893+0000", 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079895+0000", 2024-09-21T09:11:23.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7999999999999999e-06 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079907+0000", 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1804000000000001e-05 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079936+0000", 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8952999999999999e-05 2024-09-21T09:11:23.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079949+0000", 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3137e-05 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080782+0000", 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000833146 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080837+0000", 2024-09-21T09:11:23.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4676999999999998e-05 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085875+0000", 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050385079999999997 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085959+0000", 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3676000000000003e-05 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.403 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:109 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'71, mlcod=18'65)", 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.080883+0000", 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.303611564999997, 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051320599999999999, 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080883+0000", 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080883+0000", 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080885+0000", 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8300000000000001e-06 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080949+0000", 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4325000000000005e-05 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080971+0000", 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2044000000000001e-05 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080986+0000", 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5033e-05 2024-09-21T09:11:23.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081896+0000", 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090971300000000004 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081933+0000", 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7013e-05 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085964+0000", 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040313859999999997 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086015+0000", 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0716e-05 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:110 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'72, mlcod=18'65)", 2024-09-21T09:11:23.408 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.081561+0000", 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.302933594000002, 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068081039999999997, 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081561+0000", 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081561+0000", 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081563+0000", 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081574+0000", 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1783000000000001e-05 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081648+0000", 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3219999999999994e-05 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081662+0000", 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4476e-05 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083047+0000", 2024-09-21T09:11:23.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001385159 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083101+0000", 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3477000000000003e-05 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088271+0000", 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051698569999999999 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088369+0000", 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8371999999999999e-05 2024-09-21T09:11:23.412 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:111 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'73, mlcod=18'65)", 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.082289+0000", 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.302205592999996, 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061528659999999999, 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082289+0000", 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082289+0000", 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082291+0000", 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.243e-06 2024-09-21T09:11:23.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082303+0000", 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2217e-05 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082338+0000", 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4650000000000002e-05 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082357+0000", 2024-09-21T09:11:23.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8830000000000001e-05 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084154+0000", 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001796843 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084208+0000", 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3878999999999997e-05 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088378+0000", 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041704339999999998 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088442+0000", 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3769999999999994e-05 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:112 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'65)", 2024-09-21T09:11:23.417 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.082917+0000", 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.301577858000002, 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066998520000000001, 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082917+0000", 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082917+0000", 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082919+0000", 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.95e-06 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083051+0000", 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132509 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083073+0000", 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1763000000000002e-05 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083088+0000", 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4759999999999999e-05 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084918+0000", 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018304829999999999 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084951+0000", 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2772999999999999e-05 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089556+0000", 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046048310000000002 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089616+0000", 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0782999999999997e-05 2024-09-21T09:11:23.421 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:113 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'66)", 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.083741+0000", 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.300753606999997, 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005920687, 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.422 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083741+0000", 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083741+0000", 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083743+0000", 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7230000000000001e-06 2024-09-21T09:11:23.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083757+0000", 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.438e-05 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083785+0000", 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8073e-05 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083801+0000", 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6217000000000001e-05 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086120+0000", 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023185749999999998 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086175+0000", 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4666000000000001e-05 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089619+0000", 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034447100000000001 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089662+0000", 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2342999999999998e-05 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:114 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'66)", 2024-09-21T09:11:23.426 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.084454+0000", 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.300040142, 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052759850000000004, 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084454+0000", 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084454+0000", 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084456+0000", 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8700000000000001e-06 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084468+0000", 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2179e-05 2024-09-21T09:11:23.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084502+0000", 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3433000000000003e-05 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084523+0000", 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0930000000000001e-05 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086844+0000", 2024-09-21T09:11:23.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023216589999999998 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086884+0000", 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9526000000000001e-05 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089663+0000", 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027793819999999999 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089730+0000", 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7006000000000002e-05 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:115 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'66)", 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.085022+0000", 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.299472893999997, 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047624859999999998, 2024-09-21T09:11:23.431 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085022+0000", 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085022+0000", 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085027+0000", 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4129999999999997e-06 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085079+0000", 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1826999999999997e-05 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085103+0000", 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4029999999999999e-05 2024-09-21T09:11:23.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085115+0000", 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1695999999999999e-05 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.087411+0000", 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002296846 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.087453+0000", 2024-09-21T09:11:23.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1205999999999998e-05 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089739+0000", 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002286546 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089784+0000", 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4922000000000001e-05 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:116 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'68)", 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.086116+0000", 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.298378651999997, 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038724229999999998, 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086116+0000", 2024-09-21T09:11:23.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086116+0000", 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086117+0000", 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.313e-06 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086150+0000", 2024-09-21T09:11:23.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2639999999999999e-05 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086174+0000", 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3975999999999999e-05 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086195+0000", 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1157000000000001e-05 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088527+0000", 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023322120000000002 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088562+0000", 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5132999999999997e-05 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089854+0000", 2024-09-21T09:11:23.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012916469999999999 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089988+0000", 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013434499999999999 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:117 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'68)", 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.086625+0000", 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.297869986000002, 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039355589999999999, 2024-09-21T09:11:23.440 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086625+0000", 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086625+0000", 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086626+0000", 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086638+0000", 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2313000000000001e-05 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086671+0000", 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2626000000000002e-05 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086700+0000", 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9462999999999999e-05 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089210+0000", 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025098540000000002 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089249+0000", 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8452999999999999e-05 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.090456+0000", 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012076540000000001 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.090560+0000", 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103699 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:154 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'108, mlcod=18'105)", 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:46.380168+0000", 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 37.004326849000002, 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037211079999999999, 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380168+0000", 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380168+0000", 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380169+0000", 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5300000000000002e-07 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380181+0000", 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2357e-05 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380201+0000", 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9847000000000002e-05 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380213+0000", 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2556e-05 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380491+0000", 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000277512 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380541+0000", 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9778999999999999e-05 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383827+0000", 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032865479999999998 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383889+0000", 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1556000000000005e-05 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:156 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'110, mlcod=18'105)", 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:46.381673+0000", 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 37.002821539999999, 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044253549999999997, 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381673+0000", 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381673+0000", 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381674+0000", 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381690+0000", 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5339e-05 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381715+0000", 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5562999999999999e-05 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381727+0000", 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.185e-05 2024-09-21T09:11:23.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382518+0000", 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00079086399999999996 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382567+0000", 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9404000000000003e-05 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386033+0000", 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034651830000000002 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386098+0000", 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5691999999999994e-05 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:157 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'111, mlcod=18'105)", 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:46.382226+0000", 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 37.002268555000001, 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039245130000000001, 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.453 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382226+0000", 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382226+0000", 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382227+0000", 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.33e-06 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382245+0000", 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7620000000000001e-05 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382270+0000", 2024-09-21T09:11:23.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.548e-05 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382291+0000", 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0789999999999999e-05 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383190+0000", 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00089835000000000002 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383222+0000", 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2923000000000003e-05 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386101+0000", 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028787700000000001 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386150+0000", 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9249999999999998e-05 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:273 6.f 6:f1983ba0:::obj_delete_at_hint.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.013982+0000", 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.370512023, 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040761240000000004, 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 273 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.458 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013982+0000", 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013982+0000", 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013985+0000", 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4159999999999998e-06 2024-09-21T09:11:23.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013998+0000", 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2763e-05 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014030+0000", 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2756000000000003e-05 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014051+0000", 2024-09-21T09:11:23.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0947000000000001e-05 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014204+0000", 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000152709 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014557+0000", 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000353347 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:23.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015067+0000", 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00050914899999999997 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.017078+0000", 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020112250000000002 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.017896+0000", 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00081820700000000005 2024-09-21T09:11:23.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.017991+0000", 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4993000000000003e-05 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.018059+0000", 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7612000000000003e-05 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.383916+0000", 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.000578111999999, 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037879570000000002, 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 772 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383916+0000", 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383916+0000", 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383919+0000", 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2139999999999999e-06 2024-09-21T09:11:23.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383930+0000", 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1189000000000001e-05 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383961+0000", 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1612999999999997e-05 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383978+0000", 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.694e-05 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.384133+0000", 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154189 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.384535+0000", 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040250399999999998 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.385123+0000", 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00058813099999999998 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.386381+0000", 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001258194 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.387430+0000", 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010481550000000001 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.387587+0000", 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015717899999999999 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.387704+0000", 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000117649 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:23.469 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.514264+0000", 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.870230904, 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003553245, 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 826 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.470 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514264+0000", 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514264+0000", 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514266+0000", 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5399999999999998e-06 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514280+0000", 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3966e-05 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514313+0000", 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3003000000000002e-05 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514329+0000", 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5945999999999999e-05 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514492+0000", 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016315899999999999 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.514882+0000", 2024-09-21T09:11:23.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000389467 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.515469+0000", 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00058772900000000005 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.516749+0000", 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012796109999999999 2024-09-21T09:11:23.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.517537+0000", 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00078829699999999998 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.517694+0000", 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015676199999999999 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.517817+0000", 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012276499999999999 2024-09-21T09:11:23.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.571517+0000", 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.812977306000001, 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035514919999999998, 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:23.476 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 850 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571517+0000", 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571517+0000", 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571519+0000", 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1459999999999999e-06 2024-09-21T09:11:23.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571530+0000", 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0764000000000001e-05 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571562+0000", 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1925999999999999e-05 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571577+0000", 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4970000000000001e-05 2024-09-21T09:11:23.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.571728+0000", 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015116199999999999 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.572100+0000", 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000371877 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.572719+0000", 2024-09-21T09:11:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00061880599999999996 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.574053+0000", 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013340120000000001 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.574789+0000", 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073572500000000001 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.574947+0000", 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015836800000000001 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.575069+0000", 2024-09-21T09:11:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121736 2024-09-21T09:11:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:23.481 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:23.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:11:23.483 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:23.481+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:23.583 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:23.580+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:23.656 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:23.656 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:23.656 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:23.656 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:23.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:11:23.713 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:23.712+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:23.785 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:23.784+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:23.844 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:23.845 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:23.845 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:11:23.845 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:11:23.845 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:23.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:11:23.901 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:23.900+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:23.987 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:23.985+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:24.032 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:24.032 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:24.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:24.032 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:24.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.032 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-21T09:11:24.032 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:24.032 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.137440177999999, 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032488320000000001, 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892890+0000", 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9460000000000001e-06 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892903+0000", 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3191e-05 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892931+0000", 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8263e-05 2024-09-21T09:11:24.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892952+0000", 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.084e-05 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.893079+0000", 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126372 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.893129+0000", 2024-09-21T09:11:24.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0575000000000003e-05 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.896028+0000", 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028986569999999998 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.896137+0000", 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010898799999999999 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.036 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.123645436, 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004079816, 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 212 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906685+0000", 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906698+0000", 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.226e-05 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906738+0000", 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0790000000000001e-05 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906760+0000", 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1053e-05 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906890+0000", 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013003900000000001 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.907102+0000", 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021250899999999999 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.907740+0000", 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000638158 2024-09-21T09:11:24.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.909485+0000", 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017448299999999999 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910591+0000", 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011057549999999999 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910687+0000", 2024-09-21T09:11:24.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6642000000000001e-05 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910763+0000", 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5220000000000001e-05 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.059939314000001, 2024-09-21T09:11:24.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032988240000000001, 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 227 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970391+0000", 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2929999999999999e-06 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970403+0000", 2024-09-21T09:11:24.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1317e-05 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970434+0000", 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970449+0000", 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5270000000000001e-05 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970568+0000", 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119209 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970802+0000", 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233482 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.971219+0000", 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041719000000000001 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.972619+0000", 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400466 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973531+0000", 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00091115300000000005 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973619+0000", 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8451999999999999e-05 2024-09-21T09:11:24.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973688+0000", 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8685999999999999e-05 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.052784453000001, 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032094659999999998, 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.048 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 229 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977546+0000", 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0099999999999998e-06 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977556+0000", 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0567000000000001e-05 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977587+0000", 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1040000000000001e-05 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977602+0000", 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4905999999999999e-05 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977714+0000", 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111433 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977932+0000", 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021773800000000001 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.978379+0000", 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044706699999999999 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.979968+0000", 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015892879999999999 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980596+0000", 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00062846199999999999 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980686+0000", 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9555000000000006e-05 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980753+0000", 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7399999999999998e-05 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.045879941999999, 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00337558, 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 231 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.054 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984450+0000", 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.996e-06 2024-09-21T09:11:24.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984460+0000", 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0084e-05 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984489+0000", 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8306e-05 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984502+0000", 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3686000000000001e-05 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984650+0000", 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000147646 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984867+0000", 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217355 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.985296+0000", 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042830599999999999 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.986743+0000", 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001447786 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987670+0000", 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092669599999999997 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987757+0000", 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6889000000000001e-05 2024-09-21T09:11:24.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987824+0000", 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6829999999999995e-05 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.038943429, 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034045730000000001, 2024-09-21T09:11:24.059 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 233 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991387+0000", 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0229999999999999e-06 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991397+0000", 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.049e-05 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991429+0000", 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1619999999999999e-05 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991444+0000", 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4763000000000001e-05 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991615+0000", 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000170946 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991838+0000", 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022331099999999999 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.992265+0000", 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042681000000000001 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.993741+0000", 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001475762 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994623+0000", 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088250999999999998 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994721+0000", 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7836000000000003e-05 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994789+0000", 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8502000000000002e-05 2024-09-21T09:11:24.064 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:304 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.009170262000001, 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036139980000000002, 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 304 2024-09-21T09:11:24.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021161+0000", 2024-09-21T09:11:24.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5069999999999999e-06 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021173+0000", 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2583e-05 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021214+0000", 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1069000000000003e-05 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021241+0000", 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6906999999999998e-05 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021408+0000", 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000167152 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021731+0000", 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032271399999999999 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:24.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.022158+0000", 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042704700000000001 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023398+0000", 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012401230000000001 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024548+0000", 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011494140000000001 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024666+0000", 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118676 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024772+0000", 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105806 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.070 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.631096404000001, 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037127079999999999, 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 778 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:24.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399235+0000", 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8700000000000001e-06 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399248+0000", 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3366e-05 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399282+0000", 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3893999999999998e-05 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399298+0000", 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.592e-05 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399460+0000", 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016227200000000001 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399836+0000", 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037539000000000002 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.400430+0000", 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059482899999999995 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402013+0000", 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001582111 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402653+0000", 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00064022500000000002 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402822+0000", 2024-09-21T09:11:24.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016921500000000001 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402945+0000", 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012261600000000001 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.626055790000001, 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032620489999999999, 2024-09-21T09:11:24.076 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 780 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404274+0000", 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7770000000000001e-06 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404288+0000", 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3556e-05 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404322+0000", 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4097000000000002e-05 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404339+0000", 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7033000000000001e-05 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404488+0000", 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014927899999999999 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404726+0000", 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023736800000000001 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.405211+0000", 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048574000000000002 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.406409+0000", 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011978010000000001 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407327+0000", 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00091810600000000002 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407415+0000", 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8103000000000007e-05 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407535+0000", 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119189 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.081 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.622591653000001, 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00307639, 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 781 2024-09-21T09:11:24.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407739+0000", 2024-09-21T09:11:24.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9039999999999999e-06 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407749+0000", 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0285999999999999e-05 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407776+0000", 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7362999999999999e-05 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407794+0000", 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7343e-05 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407956+0000", 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000162872 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.408173+0000", 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021697599999999999 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.408519+0000", 2024-09-21T09:11:24.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034568000000000001 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.409685+0000", 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001166081 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410657+0000", 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000972276 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410748+0000", 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0883000000000004e-05 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410813+0000", 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4726000000000003e-05 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.587038983999999, 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003006463, 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 796 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443292+0000", 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3360000000000002e-06 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443303+0000", 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1216999999999999e-05 2024-09-21T09:11:24.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443334+0000", 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1007000000000003e-05 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443349+0000", 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5549999999999999e-05 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443498+0000", 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014889800000000001 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443708+0000", 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020971499999999999 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.444011+0000", 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030331100000000001 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.445066+0000", 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010543390000000001 2024-09-21T09:11:24.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446140+0000", 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001074342 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446230+0000", 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0082999999999998e-05 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446296+0000", 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5665000000000002e-05 2024-09-21T09:11:24.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.423240057999999, 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003056933, 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 865 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607091+0000", 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2859999999999998e-06 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607102+0000", 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1087000000000001e-05 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607134+0000", 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2422999999999998e-05 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607149+0000", 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.541e-05 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607277+0000", 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012709900000000001 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607492+0000", 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021501499999999999 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:24.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607801+0000", 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030958100000000002 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.609238+0000", 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014371620000000001 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.609990+0000", 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00075128100000000002 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.610079+0000", 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9769000000000001e-05 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.610145+0000", 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5820000000000003e-05 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:24.098 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.419052300000001, 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029754769999999998, 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 867 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611278+0000", 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611288+0000", 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0149999999999999e-05 2024-09-21T09:11:24.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611315+0000", 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7080000000000002e-05 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611328+0000", 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3137e-05 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611440+0000", 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111462 2024-09-21T09:11:24.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611564+0000", 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012396299999999999 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611831+0000", 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026706100000000002 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.612759+0000", 2024-09-21T09:11:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092851299999999995 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614096+0000", 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013366490000000001 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614187+0000", 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0519999999999994e-05 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614251+0000", 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4886000000000002e-05 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.408108649000001, 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029765310000000001, 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 871 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622222+0000", 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.21e-06 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622233+0000", 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0824e-05 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622264+0000", 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1449999999999999e-05 2024-09-21T09:11:24.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622279+0000", 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4600000000000001e-05 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622403+0000", 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012454499999999999 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622633+0000", 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023006200000000001 2024-09-21T09:11:24.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622953+0000", 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031925699999999998 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.623929+0000", 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00097615600000000005 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625044+0000", 2024-09-21T09:11:24.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011150450000000001 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625131+0000", 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7006e-05 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625196+0000", 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5376000000000006e-05 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.109 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.33579297, 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033591379999999998, 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 901 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694538+0000", 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2900000000000001e-06 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694549+0000", 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1727e-05 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694580+0000", 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1046000000000001e-05 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694595+0000", 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4630000000000001e-05 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694753+0000", 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158209 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.695123+0000", 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036946400000000001 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.695679+0000", 2024-09-21T09:11:24.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055595600000000003 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.696976+0000", 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012978569999999999 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697612+0000", 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00063595500000000001 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697772+0000", 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015977499999999999 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697894+0000", 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012222900000000001 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.331061596, 2024-09-21T09:11:24.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033021410000000002, 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 903 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:24.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699269+0000", 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-06 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699279+0000", 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0679999999999999e-05 2024-09-21T09:11:24.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699313+0000", 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3492999999999999e-05 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699328+0000", 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5146e-05 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699453+0000", 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012516299999999999 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699695+0000", 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024171800000000001 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.700179+0000", 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048459000000000002 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.701405+0000", 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012259300000000001 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702295+0000", 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088928599999999998 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702449+0000", 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154146 2024-09-21T09:11:24.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702569+0000", 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120149 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.25541125, 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031752249999999998, 2024-09-21T09:11:24.121 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 934 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774919+0000", 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774930+0000", 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0943e-05 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774962+0000", 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2332999999999997e-05 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774981+0000", 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.861e-05 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775151+0000", 2024-09-21T09:11:24.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016968500000000001 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775374+0000", 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223408 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775703+0000", 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032880099999999998 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.776995+0000", 2024-09-21T09:11:24.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001292477 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.777936+0000", 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094082599999999997 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.778023+0000", 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6630000000000002e-05 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.778092+0000", 2024-09-21T09:11:24.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9511999999999994e-05 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.243844099, 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031504950000000001, 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.127 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 939 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786486+0000", 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.243e-06 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786497+0000", 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0823e-05 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786529+0000", 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1843e-05 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786544+0000", 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4863e-05 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786714+0000", 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016992299999999999 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786857+0000", 2024-09-21T09:11:24.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143485 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.787126+0000", 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268285 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.788229+0000", 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001103234 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789472+0000", 2024-09-21T09:11:24.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012431110000000001 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789568+0000", 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5563000000000006e-05 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789635+0000", 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7121999999999999e-05 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.227055225999999, 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033136279999999999, 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 946 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803275+0000", 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.097e-06 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803286+0000", 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0823e-05 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803317+0000", 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.095e-05 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803332+0000", 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4816e-05 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803496+0000", 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000164442 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803870+0000", 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037405700000000001 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.804492+0000", 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00062171500000000001 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.805916+0000", 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001424533 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806305+0000", 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038826399999999998 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806462+0000", 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000156885 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806587+0000", 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125046 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.22258029, 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031808890000000001, 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.138 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 948 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807749+0000", 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.39e-06 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807757+0000", 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7430000000000002e-06 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807780+0000", 2024-09-21T09:11:24.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2480000000000002e-05 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807793+0000", 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807917+0000", 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000123573 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.808151+0000", 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000234625 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.808661+0000", 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00050934999999999999 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.809886+0000", 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012251230000000001 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810640+0000", 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00075449700000000002 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810803+0000", 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016247899999999999 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810929+0000", 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126153 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.144 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.144 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:24.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:11:24.146 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:24.145+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:24.246 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:24.245+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:24.275 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:24.275 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:24.275 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:24.275 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:24.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:11:24.347 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:24.345+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:24.408 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:24.408 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:24.408 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:11:24.408 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:11:24.408 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:24.422 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:11:24.469 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:24.468+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:24.546 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.538393948, 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003218832, 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.547 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 193 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:24.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006552+0000", 2024-09-21T09:11:24.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0430000000000002e-06 2024-09-21T09:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006564+0000", 2024-09-21T09:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1416999999999999e-05 2024-09-21T09:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006596+0000", 2024-09-21T09:11:24.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1899000000000001e-05 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006611+0000", 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5452999999999999e-05 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006757+0000", 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145816 2024-09-21T09:11:24.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.007003+0000", 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024615500000000002 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.007288+0000", 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000285304 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.008784+0000", 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001495449 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009620+0000", 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00083642999999999999 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009701+0000", 2024-09-21T09:11:24.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0653000000000002e-05 2024-09-21T09:11:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009769+0000", 2024-09-21T09:11:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8213000000000006e-05 2024-09-21T09:11:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.658626528999999, 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091541390000000004, 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 208 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.555 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886321+0000", 2024-09-21T09:11:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3500000000000001e-06 2024-09-21T09:11:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886355+0000", 2024-09-21T09:11:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3986000000000003e-05 2024-09-21T09:11:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886391+0000", 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5947e-05 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886412+0000", 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1022999999999998e-05 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886600+0000", 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018761200000000001 2024-09-21T09:11:24.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886611+0000", 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1759999999999999e-05 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.891318+0000", 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004706689 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.891698+0000", 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000380174 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.892508+0000", 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00080938400000000001 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.893820+0000", 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013127830000000001 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895296+0000", 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014755289999999999 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895394+0000", 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8226000000000004e-05 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895472+0000", 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7676000000000006e-05 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.615678754000001, 2024-09-21T09:11:24.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035744320000000002, 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 216 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929268+0000", 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8229999999999999e-06 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929279+0000", 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1194e-05 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929312+0000", 2024-09-21T09:11:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2991999999999999e-05 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929328+0000", 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5733999999999999e-05 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929487+0000", 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158579 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929719+0000", 2024-09-21T09:11:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000232351 2024-09-21T09:11:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.930129+0000", 2024-09-21T09:11:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000409687 2024-09-21T09:11:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.931616+0000", 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014871109999999999 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932688+0000", 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010723359999999999 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932774+0000", 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5688999999999999e-05 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932840+0000", 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5936e-05 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.607718394999999, 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035738390000000001, 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 218 2024-09-21T09:11:24.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937228+0000", 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1069999999999999e-06 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937238+0000", 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0349e-05 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937270+0000", 2024-09-21T09:11:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1690000000000003e-05 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937285+0000", 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5167000000000001e-05 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937408+0000", 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000122519 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937628+0000", 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022077800000000001 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.938055+0000", 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042683700000000001 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.939639+0000", 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015836540000000001 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940641+0000", 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001002246 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940735+0000", 2024-09-21T09:11:24.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3725000000000001e-05 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940800+0000", 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4766999999999998e-05 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.576 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.603765606, 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034600199999999998, 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 219 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941181+0000", 2024-09-21T09:11:24.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1399999999999998e-06 2024-09-21T09:11:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941191+0000", 2024-09-21T09:11:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0257e-05 2024-09-21T09:11:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941224+0000", 2024-09-21T09:11:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2786000000000001e-05 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941247+0000", 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.336e-05 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941345+0000", 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7769000000000005e-05 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941556+0000", 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021123499999999999 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.942003+0000", 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044704 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.943418+0000", 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014148019999999999 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944488+0000", 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001070192 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944576+0000", 2024-09-21T09:11:24.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7355999999999995e-05 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944639+0000", 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3083000000000006e-05 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.583 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.584944754999999, 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033829009999999998, 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 224 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960001+0000", 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0329999999999998e-06 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960012+0000", 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0437e-05 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.586 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960045+0000", 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2676999999999999e-05 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960068+0000", 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2935999999999999e-05 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960194+0000", 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012679600000000001 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960446+0000", 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025164099999999998 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960917+0000", 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047095600000000002 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.962230+0000", 2024-09-21T09:11:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013132669999999999 2024-09-21T09:11:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963231+0000", 2024-09-21T09:11:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010005599999999999 2024-09-21T09:11:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963321+0000", 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9825000000000001e-05 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963382+0000", 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1773000000000006e-05 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.546355951999999, 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033658070000000002, 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.591 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 235 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998590+0000", 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2299999999999998e-06 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998601+0000", 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0959e-05 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998635+0000", 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3420000000000002e-05 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998658+0000", 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3159999999999998e-05 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998781+0000", 2024-09-21T09:11:24.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012267199999999999 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.999025+0000", 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000243892 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.999452+0000", 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042783699999999998 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.000893+0000", 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001440275 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001739+0000", 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00084627300000000003 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001834+0000", 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4826000000000003e-05 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001954+0000", 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120263 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:263 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.532666621000001, 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034424360000000001, 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.598 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 263 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:24.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012280+0000", 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1799999999999999e-06 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012292+0000", 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1763000000000001e-05 2024-09-21T09:11:24.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012326+0000", 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4493000000000003e-05 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012343+0000", 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6813e-05 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012527+0000", 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018387899999999999 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012699+0000", 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017209500000000001 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013267+0000", 2024-09-21T09:11:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056834500000000005 2024-09-21T09:11:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014605+0000", 2024-09-21T09:11:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013380899999999999 2024-09-21T09:11:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015459+0000", 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00085365300000000001 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015612+0000", 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015307600000000001 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015720+0000", 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010804899999999999 2024-09-21T09:11:24.604 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:297 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.524793691999999, 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033597840000000002, 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.605 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 297 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020152+0000", 2024-09-21T09:11:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:24.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020162+0000", 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7829999999999993e-06 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020193+0000", 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1102999999999997e-05 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020214+0000", 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0486999999999999e-05 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020390+0000", 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176369 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020603+0000", 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021285100000000001 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020873+0000", 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026986799999999999 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.022546+0000", 2024-09-21T09:11:24.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016730440000000001 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023289+0000", 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074325699999999999 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023412+0000", 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012286900000000001 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023510+0000", 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8152999999999994e-05 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:373 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.501863013000001, 2024-09-21T09:11:24.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032496819999999998, 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 373 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043083+0000", 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3999999999999999e-06 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043110+0000", 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7370000000000001e-05 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043128+0000", 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8320000000000001e-05 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043139+0000", 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0763e-05 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043748+0000", 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060880199999999998 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043963+0000", 2024-09-21T09:11:24.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000215198 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.044316+0000", 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284100000000001 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045592+0000", 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001275921 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046080+0000", 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048865200000000001 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046216+0000", 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013579600000000001 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046331+0000", 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011461899999999999 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:446 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.475241763, 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033921149999999998, 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.619 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 446 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069704+0000", 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7090000000000001e-06 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069713+0000", 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1630000000000002e-06 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069742+0000", 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8739999999999999e-05 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069754+0000", 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2271e-05 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069885+0000", 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013067999999999999 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.070151+0000", 2024-09-21T09:11:24.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026643499999999998 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.070748+0000", 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059699500000000001 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.072288+0000", 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015399249999999999 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.072942+0000", 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00065338199999999999 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.073033+0000", 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0826000000000001e-05 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.073095+0000", 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1989000000000006e-05 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:452 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.470932780999998, 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031754840000000001, 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.626 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 452 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074013+0000", 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.331e-06 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074022+0000", 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1570000000000006e-06 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074046+0000", 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.374e-05 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074063+0000", 2024-09-21T09:11:24.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074172+0000", 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010967300000000001 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074309+0000", 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136489 2024-09-21T09:11:24.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074654+0000", 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034524499999999999 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.076228+0000", 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015737209999999999 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077038+0000", 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00081049799999999999 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077121+0000", 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2402000000000002e-05 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077187+0000", 2024-09-21T09:11:24.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6070999999999998e-05 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:493 6.13 6:cd178ae0:reshard::reshard.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.453766599000001, 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038520270000000001, 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.633 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 493 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091180+0000", 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.294e-06 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091202+0000", 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2039999999999999e-05 2024-09-21T09:11:24.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091231+0000", 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8756999999999999e-05 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091246+0000", 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.49e-05 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091382+0000", 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136193 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091606+0000", 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022468499999999999 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091931+0000", 2024-09-21T09:11:24.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000324171 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.093225+0000", 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012946329999999999 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.094882+0000", 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016571750000000001 2024-09-21T09:11:24.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.094957+0000", 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4991000000000001e-05 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.095030+0000", 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2187999999999994e-05 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.639 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:501 6.13 6:cd178ae0:reshard::reshard.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.448788084, 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003138456, 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 501 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:24.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096158+0000", 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096168+0000", 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0052e-05 2024-09-21T09:11:24.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096191+0000", 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2965000000000001e-05 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096211+0000", 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0040000000000001e-05 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096403+0000", 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019186299999999999 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096630+0000", 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022718200000000001 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096990+0000", 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035963 2024-09-21T09:11:24.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.098287+0000", 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012970600000000001 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099072+0000", 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00078496299999999996 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099197+0000", 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012550699999999999 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099295+0000", 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7194000000000005e-05 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:565 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.412660677000002, 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045932120000000002, 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 565 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132287+0000", 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2320000000000001e-06 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132300+0000", 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2782999999999999e-05 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132337+0000", 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7036000000000003e-05 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132373+0000", 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6000000000000001e-05 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132537+0000", 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016473700000000001 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132788+0000", 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025062400000000002 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.133316+0000", 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052850300000000005 2024-09-21T09:11:24.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134573+0000", 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012568449999999999 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136729+0000", 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021554590000000002 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136810+0000", 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1236000000000006e-05 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136877+0000", 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6756999999999998e-05 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.653 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:580 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.397403097000002, 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031517770000000001, 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 580 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:24.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:24.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147543+0000", 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6479999999999999e-06 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147552+0000", 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1400000000000006e-06 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147578+0000", 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5680000000000001e-05 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147591+0000", 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3077e-05 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147726+0000", 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013512600000000001 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.148022+0000", 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029581200000000001 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.148500+0000", 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047833400000000002 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.149801+0000", 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001301024 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150536+0000", 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073525399999999996 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150638+0000", 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010145300000000001 2024-09-21T09:11:24.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150693+0000", 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5229000000000003e-05 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.118687853000001, 2024-09-21T09:11:24.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030807830000000001, 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 789 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:24.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426258+0000", 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:24.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426269+0000", 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0366999999999999e-05 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426300+0000", 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1646000000000002e-05 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426316+0000", 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5330000000000001e-05 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426464+0000", 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148455 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426728+0000", 2024-09-21T09:11:24.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000263451 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.427238+0000", 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00051078300000000001 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.428446+0000", 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001207898 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429175+0000", 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072848399999999995 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429267+0000", 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2373000000000005e-05 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429337+0000", 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9936000000000003e-05 2024-09-21T09:11:24.666 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.066267734, 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003253124, 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.667 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 811 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478679+0000", 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1629999999999999e-06 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478689+0000", 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.046e-05 2024-09-21T09:11:24.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478721+0000", 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1535999999999998e-05 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478736+0000", 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5494000000000001e-05 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478888+0000", 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015226500000000001 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.479263+0000", 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037449100000000002 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.479864+0000", 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060063800000000002 2024-09-21T09:11:24.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481130+0000", 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012669000000000001 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481767+0000", 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00063663499999999998 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481856+0000", 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9376999999999995e-05 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481930+0000", 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3164999999999995e-05 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.673 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.879390223, 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032567009999999999, 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 889 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665557+0000", 2024-09-21T09:11:24.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6359999999999998e-06 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665569+0000", 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2296999999999999e-05 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665602+0000", 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3433000000000003e-05 2024-09-21T09:11:24.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665620+0000", 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7176e-05 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665779+0000", 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015932899999999999 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.666162+0000", 2024-09-21T09:11:24.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038277999999999999 2024-09-21T09:11:24.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:24.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.666737+0000", 2024-09-21T09:11:24.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057502599999999997 2024-09-21T09:11:24.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668002+0000", 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001265024 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668648+0000", 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00064676200000000005 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668739+0000", 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0805999999999998e-05 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668811+0000", 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1432000000000003e-05 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.864794275, 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031261549999999998, 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 895 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.681 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680152+0000", 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680163+0000", 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0627e-05 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:24.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680195+0000", 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2521999999999998e-05 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680211+0000", 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5633000000000001e-05 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680393+0000", 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018196600000000001 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680627+0000", 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023373099999999999 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680971+0000", 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034410099999999998 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:24.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.682191+0000", 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012203940000000001 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683114+0000", 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092252999999999996 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683209+0000", 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5651999999999998e-05 2024-09-21T09:11:24.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:24.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:24.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:24.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683276+0000", 2024-09-21T09:11:24.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6855999999999998e-05 2024-09-21T09:11:24.687 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.687 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.687 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.687 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:24.687 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:24.687 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:24.689 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:24.684+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:24.689 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:11:24.790 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:24.789+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:24.823 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:24.823 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:24.823 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:24.823 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:24.838 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:11:24.877 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T09:11:24.925 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:24.925+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:24.990 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:24.989+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:25.008 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:25.008 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:25.008 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:25.008 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:25.008 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:25.024 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:11:25.117 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:25.117+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:25.192 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:25.189+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:25.198 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.313359287000001, 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.005197709, 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.199 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 46 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:25.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883306+0000", 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8680000000000001e-06 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883320+0000", 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3777e-05 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883355+0000", 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5457000000000003e-05 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883381+0000", 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5548e-05 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883631+0000", 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025032199999999998 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883924+0000", 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029322899999999999 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.884247+0000", 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032292300000000003 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.885849+0000", 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016019459999999999 2024-09-21T09:11:25.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888259+0000", 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024100409999999999 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888397+0000", 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013753600000000001 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888500+0000", 2024-09-21T09:11:25.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103062 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113020240896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.307687134999998, 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058707430000000003, 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.205 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 47 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888977+0000", 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888990+0000", 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.33e-05 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889036+0000", 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6328000000000001e-05 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889059+0000", 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3048e-05 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889882+0000", 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082253800000000005 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890147+0000", 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026500299999999998 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890549+0000", 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000402323 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.893575+0000", 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030257690000000002 2024-09-21T09:11:25.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894522+0000", 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094709000000000004 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894675+0000", 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015305599999999999 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894845+0000", 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016973100000000001 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.196861784999999, 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035327039999999998, 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 191 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999801+0000", 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999812+0000", 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0183000000000001e-05 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999843+0000", 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1553000000000001e-05 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999858+0000", 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4907e-05 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000009+0000", 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000150786 2024-09-21T09:11:25.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000333+0000", 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032434100000000002 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000821+0000", 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048796000000000001 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.002625+0000", 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001803802 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003193+0000", 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056811000000000003 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003267+0000", 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3980000000000007e-05 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003332+0000", 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5022000000000002e-05 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.331377002, 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039222459999999999, 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 205 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865287+0000", 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3000000000000002e-06 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865304+0000", 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6269999999999998e-05 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865349+0000", 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5652999999999998e-05 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865370+0000", 2024-09-21T09:11:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1117000000000001e-05 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865572+0000", 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020120199999999999 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865819+0000", 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024759800000000002 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.866195+0000", 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000375557 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.867603+0000", 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001407967 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.868927+0000", 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013238410000000001 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869095+0000", 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016838899999999999 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869206+0000", 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111352 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.302944234000002, 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031054379999999999, 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 209 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893719+0000", 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3599999999999999e-06 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893731+0000", 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.222e-05 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893765+0000", 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3782999999999998e-05 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893781+0000", 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893906+0000", 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012485299999999999 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894129+0000", 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022317800000000001 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894535+0000", 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040575399999999998 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.895977+0000", 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014418199999999999 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896619+0000", 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064255900000000001 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896704+0000", 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4653000000000004e-05 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896822+0000", 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118285 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.287602119999999, 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037831409999999998, 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 213 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909062+0000", 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0400000000000001e-06 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909075+0000", 2024-09-21T09:11:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3094e-05 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909106+0000", 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0426e-05 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909121+0000", 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5903e-05 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909280+0000", 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000158772 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909665+0000", 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038435800000000001 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.910380+0000", 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071585799999999999 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912186+0000", 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018052649999999999 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912661+0000", 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047496399999999997 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912752+0000", 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1445000000000003e-05 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912842+0000", 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0016e-05 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.273359058, 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576779, 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 215 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923305+0000", 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5639999999999999e-06 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923317+0000", 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1956e-05 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923349+0000", 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2706999999999997e-05 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923366+0000", 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6552999999999999e-05 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923539+0000", 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017352200000000001 2024-09-21T09:11:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923939+0000", 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000399334 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.924459+0000", 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052057299999999998 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.925959+0000", 2024-09-21T09:11:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001499703 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926718+0000", 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075869800000000003 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926799+0000", 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0950000000000003e-05 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926879+0000", 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0218999999999999e-05 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.250126238, 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031911079999999998, 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 221 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946537+0000", 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946549+0000", 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1527e-05 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946580+0000", 2024-09-21T09:11:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1356999999999998e-05 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946597+0000", 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7093000000000001e-05 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946714+0000", 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116872 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946936+0000", 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022225500000000001 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.947359+0000", 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042271099999999999 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.948825+0000", 2024-09-21T09:11:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014661159999999999 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949560+0000", 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073491500000000005 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949644+0000", 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4147000000000006e-05 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949726+0000", 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1854999999999995e-05 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.231645821000001, 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030775389999999998, 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 226 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965018+0000", 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2199999999999999e-06 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965029+0000", 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1436e-05 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965061+0000", 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2055999999999999e-05 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965077+0000", 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.558e-05 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965200+0000", 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012353599999999999 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965442+0000", 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024218199999999999 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965830+0000", 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038740699999999999 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967527+0000", 2024-09-21T09:11:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001696999 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967943+0000", 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041585999999999999 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968028+0000", 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.53e-05 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968093+0000", 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4962999999999994e-05 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.856202189000001, 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029016699999999999, 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 754 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340461+0000", 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340471+0000", 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8199999999999992e-06 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340502+0000", 2024-09-21T09:11:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1047000000000003e-05 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340527+0000", 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4739000000000001e-05 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340685+0000", 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015804600000000001 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340891+0000", 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020627199999999999 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.341212+0000", 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032101500000000002 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.342549+0000", 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013375469999999999 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343214+0000", 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066447900000000005 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343299+0000", 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5154999999999994e-05 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343361+0000", 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1569999999999995e-05 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:757 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.849331116999998, 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029276440000000001, 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 757 2024-09-21T09:11:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347332+0000", 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0200000000000001e-06 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347343+0000", 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347374+0000", 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1600000000000002e-05 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347389+0000", 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.486e-05 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347509+0000", 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119815 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347727+0000", 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217956 2024-09-21T09:11:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.348046+0000", 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031872699999999999 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.349129+0000", 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010836559999999999 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350046+0000", 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091629999999999999 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350135+0000", 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9666999999999994e-05 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350258+0000", 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012226899999999999 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:759 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.845498935999998, 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002979752, 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 759 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351164+0000", 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.703e-06 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351174+0000", 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0013000000000001e-05 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351205+0000", 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1189999999999998e-05 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351223+0000", 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8003e-05 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351341+0000", 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118306 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351470+0000", 2024-09-21T09:11:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000129076 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351737+0000", 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026687199999999998 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353037+0000", 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012995509999999999 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353989+0000", 2024-09-21T09:11:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095197900000000004 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354076+0000", 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6730000000000005e-05 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354142+0000", 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6328999999999995e-05 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.817952983000001, 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002900807, 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 771 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378710+0000", 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.42e-06 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378717+0000", 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4739999999999999e-06 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378740+0000", 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.268e-05 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378751+0000", 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1143e-05 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378925+0000", 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017384900000000001 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379066+0000", 2024-09-21T09:11:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141712 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379328+0000", 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026180499999999999 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.380651+0000", 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322611 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381467+0000", 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081640100000000002 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381547+0000", 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9705999999999999e-05 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381609+0000", 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2006000000000002e-05 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.612518927, 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029926800000000002, 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 856 2024-09-21T09:11:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584144+0000", 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2469999999999998e-06 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584158+0000", 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3519999999999999e-05 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584191+0000", 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2617000000000003e-05 2024-09-21T09:11:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584206+0000", 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5276000000000001e-05 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584325+0000", 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118929 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584567+0000", 2024-09-21T09:11:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242525 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584885+0000", 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031785100000000002 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.585978+0000", 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001093246 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.586991+0000", 2024-09-21T09:11:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00101264 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587071+0000", 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9765999999999995e-05 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587135+0000", 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4063e-05 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:861 6.3 6:c0550c60:::obj_delete_at_hint.0000000094:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.602091861000002, 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00331716, 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 861 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594571+0000", 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.686e-06 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594581+0000", 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8870000000000004e-06 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594612+0000", 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1433000000000002e-05 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594630+0000", 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7589999999999999e-05 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594779+0000", 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014932199999999999 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595030+0000", 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025084100000000002 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595533+0000", 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050262699999999996 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.596870+0000", 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013373580000000001 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597612+0000", 2024-09-21T09:11:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074164800000000003 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597770+0000", 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015815499999999999 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597886+0000", 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116613 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.525513179000001, 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030306669999999999, 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 892 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671150+0000", 2024-09-21T09:11:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.097e-06 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671161+0000", 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0499999999999999e-05 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671191+0000", 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0383e-05 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671206+0000", 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5437000000000001e-05 2024-09-21T09:11:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671359+0000", 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152189 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671584+0000", 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022531499999999999 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671899+0000", 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031528399999999999 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673019+0000", 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011199560000000001 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673900+0000", 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088067799999999997 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674066+0000", 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016586500000000001 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674179+0000", 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112963 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:904 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.495867452999999, 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003078852, 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 904 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700796+0000", 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1840000000000002e-06 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700807+0000", 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1049999999999999e-05 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700836+0000", 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8833e-05 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700851+0000", 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4813e-05 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700970+0000", 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119456 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701187+0000", 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021738899999999999 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701519+0000", 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033143400000000003 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.702692+0000", 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011726620000000001 2024-09-21T09:11:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703599+0000", 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090731700000000004 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703756+0000", 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015696199999999999 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703873+0000", 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116752 2024-09-21T09:11:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:906 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.491926762999999, 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031432679999999998, 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 906 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704736+0000", 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7400000000000001e-06 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704746+0000", 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4499999999999993e-06 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704770+0000", 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.402e-05 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704781+0000", 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1790000000000001e-05 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704909+0000", 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012782900000000001 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705162+0000", 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000253191 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705681+0000", 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051818999999999997 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707026+0000", 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013454840000000001 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707720+0000", 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069363499999999995 2024-09-21T09:11:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707803+0000", 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3603000000000006e-05 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707878+0000", 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4336000000000001e-05 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:919 6.5 6:a1987d85:::obj_delete_at_hint.0000000114:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.459586645999998, 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003079816, 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 919 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737077+0000", 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2699999999999999e-06 2024-09-21T09:11:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737091+0000", 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3825999999999999e-05 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737121+0000", 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.046e-05 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737138+0000", 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6793999999999999e-05 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737252+0000", 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114552 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737522+0000", 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026934799999999998 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737855+0000", 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033290799999999998 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.739016+0000", 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011608949999999999 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740004+0000", 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098829699999999996 2024-09-21T09:11:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740090+0000", 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6645999999999997e-05 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740154+0000", 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3819999999999995e-05 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.402587172, 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003307838, 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 943 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794076+0000", 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.804e-06 2024-09-21T09:11:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794085+0000", 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5859999999999994e-06 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794113+0000", 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8056999999999999e-05 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794128+0000", 2024-09-21T09:11:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4382999999999999e-05 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794276+0000", 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000148286 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794649+0000", 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037297399999999998 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.795219+0000", 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056944899999999998 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.796426+0000", 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012075390000000001 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797214+0000", 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078828100000000005 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797295+0000", 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0289000000000003e-05 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797382+0000", 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7189999999999997e-05 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:25.317 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:25.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:11:25.319 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:25.320+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:25.365 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:11:25.453 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:25.453+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:25.491 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:25.491 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:25.491 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:25.491 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:25.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:11:25.548 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:25.548 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:25.549 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:25.545+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:25.565 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:25.565 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:25.582 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:25.582 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:25.599 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:25.599 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:25.620 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:25.620 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:25.621 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:25.616+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:25.641 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:25.641 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:25.662 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:25.664 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:25.665 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:25.679 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:11:25.683 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:25.749 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:25.749+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:25.797 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:25.797 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:25.812 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:11:25.823 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:25.820+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:25.924 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:25.921+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:25.984 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:25.984 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:25.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:11:26.009 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-09-21T09:11:26.025 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:26.020+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:26.126 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:26.124+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:26.136 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:26.137 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:26.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:11:26.226 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:26.224+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:26.274 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:26.275 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:26.288 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:11:26.333 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:26.333+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:26.413 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:26.413 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:26.428 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:11:26.428 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:26.425+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:26.528 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:26.529+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:26.588 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:26.588 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:26.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:11:26.630 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:26.628+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:26.730 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:26.729+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:26.772 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:26.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:11:26.834 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:26.832+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:26.923 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:26.924 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:26.932 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:26.928+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:26.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:11:27.033 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:27.028+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:27.116 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:27.117 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:27.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:11:27.174 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:27.172+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:27.236 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:27.232+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:27.300 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:27.300 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:27.314 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:11:27.362 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:27.360+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:27.437 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:27.436+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:27.491 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:27.491 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:27.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:11:27.539 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:27.537+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:27.640 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:27.636+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:27.675 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:27.675 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:27.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:11:27.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:11:27.782 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:27.784+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:27.842 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:27.840+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:27.860 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:27.863 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:27.863 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:27.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:11:27.878 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:27.878 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:27.895 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:27.895 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:27.912 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:27.912 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:27.932 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:27.933 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:27.952 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:27.952 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:27.966 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:27.968+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:27.970 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:27.970 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:27.989 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:27.989 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:28.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T09:11:28.052 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:28.053 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:28.053 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:28.053 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:28.067 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:11:28.081 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:28.081+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:28.158 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:28.160+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:28.243 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:11:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:11:28.243 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:28.244 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:28.241+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:28.258 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:11:28.346 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:28.348+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:28.435 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:28.435 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:28.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:28.435 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:28.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.435 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-21T09:11:28.435 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.540252423999998, 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032488320000000001, 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892890+0000", 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9460000000000001e-06 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892903+0000", 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3191e-05 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892931+0000", 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8263e-05 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892952+0000", 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.084e-05 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.893079+0000", 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126372 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.893129+0000", 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0575000000000003e-05 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.896028+0000", 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028986569999999998 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.896137+0000", 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010898799999999999 2024-09-21T09:11:28.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.526457682, 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004079816, 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.440 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 212 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906685+0000", 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906698+0000", 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.226e-05 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906738+0000", 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0790000000000001e-05 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906760+0000", 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1053e-05 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906890+0000", 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013003900000000001 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.907102+0000", 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021250899999999999 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.907740+0000", 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000638158 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.909485+0000", 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017448299999999999 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910591+0000", 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011057549999999999 2024-09-21T09:11:28.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910687+0000", 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6642000000000001e-05 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910763+0000", 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5220000000000001e-05 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.445 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.462751560000001, 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032988240000000001, 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 227 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970391+0000", 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2929999999999999e-06 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970403+0000", 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1317e-05 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970434+0000", 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970449+0000", 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5270000000000001e-05 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970568+0000", 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119209 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970802+0000", 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233482 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.971219+0000", 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041719000000000001 2024-09-21T09:11:28.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.972619+0000", 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400466 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973531+0000", 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00091115300000000005 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973619+0000", 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8451999999999999e-05 2024-09-21T09:11:28.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973688+0000", 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8685999999999999e-05 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.455596699000001, 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032094659999999998, 2024-09-21T09:11:28.451 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 229 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977546+0000", 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0099999999999998e-06 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977556+0000", 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0567000000000001e-05 2024-09-21T09:11:28.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977587+0000", 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1040000000000001e-05 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977602+0000", 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4905999999999999e-05 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977714+0000", 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111433 2024-09-21T09:11:28.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977932+0000", 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021773800000000001 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.978379+0000", 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044706699999999999 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.979968+0000", 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015892879999999999 2024-09-21T09:11:28.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980596+0000", 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00062846199999999999 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980686+0000", 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9555000000000006e-05 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980753+0000", 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7399999999999998e-05 2024-09-21T09:11:28.456 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.448692187999999, 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00337558, 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.457 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 231 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984450+0000", 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.996e-06 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984460+0000", 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0084e-05 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984489+0000", 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8306e-05 2024-09-21T09:11:28.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984502+0000", 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3686000000000001e-05 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984650+0000", 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000147646 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984867+0000", 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217355 2024-09-21T09:11:28.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.985296+0000", 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042830599999999999 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.986743+0000", 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001447786 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987670+0000", 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092669599999999997 2024-09-21T09:11:28.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987757+0000", 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6889000000000001e-05 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987824+0000", 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6829999999999995e-05 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.441755675, 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034045730000000001, 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 233 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991387+0000", 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0229999999999999e-06 2024-09-21T09:11:28.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991397+0000", 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.049e-05 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991429+0000", 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1619999999999999e-05 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991444+0000", 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4763000000000001e-05 2024-09-21T09:11:28.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991615+0000", 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000170946 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991838+0000", 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022331099999999999 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:28.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.992265+0000", 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042681000000000001 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.993741+0000", 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001475762 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994623+0000", 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088250999999999998 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994721+0000", 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7836000000000003e-05 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994789+0000", 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8502000000000002e-05 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.468 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:304 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.411982508000001, 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036139980000000002, 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 304 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021161+0000", 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5069999999999999e-06 2024-09-21T09:11:28.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021173+0000", 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2583e-05 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021214+0000", 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1069000000000003e-05 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021241+0000", 2024-09-21T09:11:28.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6906999999999998e-05 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021408+0000", 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000167152 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021731+0000", 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032271399999999999 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.022158+0000", 2024-09-21T09:11:28.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042704700000000001 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023398+0000", 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012401230000000001 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024548+0000", 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011494140000000001 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024666+0000", 2024-09-21T09:11:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118676 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024772+0000", 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105806 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.033908650000001, 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037127079999999999, 2024-09-21T09:11:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 778 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399235+0000", 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8700000000000001e-06 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399248+0000", 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3366e-05 2024-09-21T09:11:28.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399282+0000", 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3893999999999998e-05 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399298+0000", 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.592e-05 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399460+0000", 2024-09-21T09:11:28.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016227200000000001 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399836+0000", 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037539000000000002 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.400430+0000", 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059482899999999995 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402013+0000", 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001582111 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402653+0000", 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00064022500000000002 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402822+0000", 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016921500000000001 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402945+0000", 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012261600000000001 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.028868035999999, 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032620489999999999, 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.480 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 780 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:28.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404274+0000", 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7770000000000001e-06 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404288+0000", 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3556e-05 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404322+0000", 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4097000000000002e-05 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404339+0000", 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7033000000000001e-05 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404488+0000", 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014927899999999999 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404726+0000", 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023736800000000001 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.405211+0000", 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048574000000000002 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.406409+0000", 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011978010000000001 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407327+0000", 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00091810600000000002 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407415+0000", 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8103000000000007e-05 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407535+0000", 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119189 2024-09-21T09:11:28.485 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.025403899000001, 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00307639, 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.486 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 781 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407739+0000", 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9039999999999999e-06 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407749+0000", 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0285999999999999e-05 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407776+0000", 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7362999999999999e-05 2024-09-21T09:11:28.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407794+0000", 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7343e-05 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407956+0000", 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000162872 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.408173+0000", 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021697599999999999 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.408519+0000", 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034568000000000001 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.409685+0000", 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001166081 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410657+0000", 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000972276 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410748+0000", 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0883000000000004e-05 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410813+0000", 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4726000000000003e-05 2024-09-21T09:11:28.491 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.989851229999999, 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003006463, 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.492 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 796 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443292+0000", 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3360000000000002e-06 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443303+0000", 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1216999999999999e-05 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443334+0000", 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1007000000000003e-05 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443349+0000", 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5549999999999999e-05 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443498+0000", 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014889800000000001 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443708+0000", 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020971499999999999 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:28.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.444011+0000", 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030331100000000001 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.445066+0000", 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010543390000000001 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446140+0000", 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001074342 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446230+0000", 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0082999999999998e-05 2024-09-21T09:11:28.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446296+0000", 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5665000000000002e-05 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.826052304000001, 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003056933, 2024-09-21T09:11:28.497 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 865 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607091+0000", 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2859999999999998e-06 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607102+0000", 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1087000000000001e-05 2024-09-21T09:11:28.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607134+0000", 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2422999999999998e-05 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607149+0000", 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.541e-05 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607277+0000", 2024-09-21T09:11:28.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012709900000000001 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607492+0000", 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021501499999999999 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607801+0000", 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030958100000000002 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.609238+0000", 2024-09-21T09:11:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014371620000000001 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.609990+0000", 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00075128100000000002 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.610079+0000", 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9769000000000001e-05 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.610145+0000", 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5820000000000003e-05 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.821864546, 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029754769999999998, 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.503 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 867 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:28.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611278+0000", 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611288+0000", 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0149999999999999e-05 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611315+0000", 2024-09-21T09:11:28.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7080000000000002e-05 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611328+0000", 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3137e-05 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611440+0000", 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111462 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611564+0000", 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012396299999999999 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611831+0000", 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026706100000000002 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.612759+0000", 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092851299999999995 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614096+0000", 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013366490000000001 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614187+0000", 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0519999999999994e-05 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614251+0000", 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4886000000000002e-05 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.508 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.810920894999999, 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029765310000000001, 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 871 2024-09-21T09:11:28.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622222+0000", 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.21e-06 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622233+0000", 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0824e-05 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622264+0000", 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1449999999999999e-05 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622279+0000", 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4600000000000001e-05 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622403+0000", 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012454499999999999 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622633+0000", 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023006200000000001 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622953+0000", 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031925699999999998 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.623929+0000", 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00097615600000000005 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625044+0000", 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011150450000000001 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625131+0000", 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7006e-05 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625196+0000", 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5376000000000006e-05 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.514 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.738605216, 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033591379999999998, 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 901 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694538+0000", 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2900000000000001e-06 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694549+0000", 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1727e-05 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694580+0000", 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1046000000000001e-05 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694595+0000", 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4630000000000001e-05 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694753+0000", 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158209 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.695123+0000", 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036946400000000001 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.695679+0000", 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055595600000000003 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.696976+0000", 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012978569999999999 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697612+0000", 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00063595500000000001 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697772+0000", 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015977499999999999 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697894+0000", 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012222900000000001 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.733873842000001, 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033021410000000002, 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 903 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699269+0000", 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-06 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699279+0000", 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0679999999999999e-05 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699313+0000", 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3492999999999999e-05 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699328+0000", 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5146e-05 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699453+0000", 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012516299999999999 2024-09-21T09:11:28.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699695+0000", 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024171800000000001 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.700179+0000", 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048459000000000002 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.701405+0000", 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012259300000000001 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702295+0000", 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088928599999999998 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702449+0000", 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154146 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702569+0000", 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120149 2024-09-21T09:11:28.525 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.658223496000002, 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031752249999999998, 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 934 2024-09-21T09:11:28.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774919+0000", 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774930+0000", 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0943e-05 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774962+0000", 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2332999999999997e-05 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774981+0000", 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.861e-05 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775151+0000", 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016968500000000001 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775374+0000", 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223408 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775703+0000", 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032880099999999998 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.776995+0000", 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001292477 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.777936+0000", 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094082599999999997 2024-09-21T09:11:28.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.778023+0000", 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6630000000000002e-05 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.778092+0000", 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9511999999999994e-05 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.531 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.646656345, 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031504950000000001, 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 939 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786486+0000", 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.243e-06 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786497+0000", 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0823e-05 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786529+0000", 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1843e-05 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786544+0000", 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4863e-05 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786714+0000", 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016992299999999999 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786857+0000", 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143485 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.787126+0000", 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268285 2024-09-21T09:11:28.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.788229+0000", 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001103234 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789472+0000", 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012431110000000001 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789568+0000", 2024-09-21T09:11:28.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5563000000000006e-05 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789635+0000", 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7121999999999999e-05 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.629867472000001, 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033136279999999999, 2024-09-21T09:11:28.537 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 946 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803275+0000", 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.097e-06 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803286+0000", 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0823e-05 2024-09-21T09:11:28.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803317+0000", 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.095e-05 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803332+0000", 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4816e-05 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803496+0000", 2024-09-21T09:11:28.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000164442 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803870+0000", 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037405700000000001 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.804492+0000", 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00062171500000000001 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.805916+0000", 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001424533 2024-09-21T09:11:28.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806305+0000", 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038826399999999998 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806462+0000", 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000156885 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806587+0000", 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125046 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.625392536, 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031808890000000001, 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:28.543 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 948 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807749+0000", 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.39e-06 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807757+0000", 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7430000000000002e-06 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807780+0000", 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2480000000000002e-05 2024-09-21T09:11:28.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807793+0000", 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807917+0000", 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000123573 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.808151+0000", 2024-09-21T09:11:28.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000234625 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.808661+0000", 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00050934999999999999 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.809886+0000", 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012251230000000001 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810640+0000", 2024-09-21T09:11:28.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00075449700000000002 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810803+0000", 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016247899999999999 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810929+0000", 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126153 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:28.549 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:28.549 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:28.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:11:28.550 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:28.552+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:28.651 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:28.649+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:28.722 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:28.723 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:28.723 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:28.723 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:28.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:11:28.751 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:28.749+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:28.852 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:28.849+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:28.857 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:11:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:11:28.858 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:28.873 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:11:28.954 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:28.956+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:29.004 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:29.004 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.995801782000001, 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003218832, 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 193 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006552+0000", 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0430000000000002e-06 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006564+0000", 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1416999999999999e-05 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006596+0000", 2024-09-21T09:11:29.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1899000000000001e-05 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006611+0000", 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5452999999999999e-05 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006757+0000", 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145816 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.007003+0000", 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024615500000000002 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.007288+0000", 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000285304 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.008784+0000", 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001495449 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009620+0000", 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00083642999999999999 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009701+0000", 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0653000000000002e-05 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009769+0000", 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8213000000000006e-05 2024-09-21T09:11:29.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.116034363000001, 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091541390000000004, 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 208 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886321+0000", 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3500000000000001e-06 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886355+0000", 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3986000000000003e-05 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886391+0000", 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5947e-05 2024-09-21T09:11:29.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886412+0000", 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1022999999999998e-05 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886600+0000", 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018761200000000001 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886611+0000", 2024-09-21T09:11:29.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1759999999999999e-05 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.891318+0000", 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004706689 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.891698+0000", 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000380174 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:29.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.892508+0000", 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00080938400000000001 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.893820+0000", 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013127830000000001 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895296+0000", 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014755289999999999 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895394+0000", 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8226000000000004e-05 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895472+0000", 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7676000000000006e-05 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:29.017 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.073086587999999, 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035744320000000002, 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 216 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:29.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929268+0000", 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8229999999999999e-06 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929279+0000", 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1194e-05 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929312+0000", 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2991999999999999e-05 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929328+0000", 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5733999999999999e-05 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929487+0000", 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158579 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929719+0000", 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000232351 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.930129+0000", 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000409687 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.931616+0000", 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014871109999999999 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932688+0000", 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010723359999999999 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932774+0000", 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5688999999999999e-05 2024-09-21T09:11:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932840+0000", 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5936e-05 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.065126229000001, 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035738390000000001, 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.023 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 218 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937228+0000", 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1069999999999999e-06 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937238+0000", 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0349e-05 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937270+0000", 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1690000000000003e-05 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937285+0000", 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5167000000000001e-05 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937408+0000", 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000122519 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937628+0000", 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022077800000000001 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.938055+0000", 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042683700000000001 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.939639+0000", 2024-09-21T09:11:29.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015836540000000001 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940641+0000", 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001002246 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940735+0000", 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3725000000000001e-05 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940800+0000", 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4766999999999998e-05 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.061173440000001, 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034600199999999998, 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.029 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 219 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941181+0000", 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1399999999999998e-06 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941191+0000", 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0257e-05 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941224+0000", 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2786000000000001e-05 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941247+0000", 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.336e-05 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941345+0000", 2024-09-21T09:11:29.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7769000000000005e-05 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941556+0000", 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021123499999999999 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.942003+0000", 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044704 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.943418+0000", 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014148019999999999 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944488+0000", 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001070192 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944576+0000", 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7355999999999995e-05 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944639+0000", 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3083000000000006e-05 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.042352589, 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033829009999999998, 2024-09-21T09:11:29.035 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 224 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960001+0000", 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0329999999999998e-06 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960012+0000", 2024-09-21T09:11:29.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0437e-05 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960045+0000", 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2676999999999999e-05 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960068+0000", 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2935999999999999e-05 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960194+0000", 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012679600000000001 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960446+0000", 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025164099999999998 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960917+0000", 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047095600000000002 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.962230+0000", 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013132669999999999 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963231+0000", 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010005599999999999 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963321+0000", 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9825000000000001e-05 2024-09-21T09:11:29.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963382+0000", 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1773000000000006e-05 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.003763786, 2024-09-21T09:11:29.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033658070000000002, 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 235 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998590+0000", 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2299999999999998e-06 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998601+0000", 2024-09-21T09:11:29.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0959e-05 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998635+0000", 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3420000000000002e-05 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998658+0000", 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3159999999999998e-05 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998781+0000", 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012267199999999999 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.999025+0000", 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000243892 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.999452+0000", 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042783699999999998 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.000893+0000", 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001440275 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001739+0000", 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00084627300000000003 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001834+0000", 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4826000000000003e-05 2024-09-21T09:11:29.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001954+0000", 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120263 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:263 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.990074454999998, 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034424360000000001, 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 263 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012280+0000", 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1799999999999999e-06 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012292+0000", 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1763000000000001e-05 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012326+0000", 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4493000000000003e-05 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012343+0000", 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6813e-05 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012527+0000", 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018387899999999999 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012699+0000", 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017209500000000001 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013267+0000", 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056834500000000005 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014605+0000", 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013380899999999999 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015459+0000", 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00085365300000000001 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015612+0000", 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015307600000000001 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015720+0000", 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010804899999999999 2024-09-21T09:11:29.052 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:297 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.982201526000001, 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033597840000000002, 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.053 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 297 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020152+0000", 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020162+0000", 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7829999999999993e-06 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020193+0000", 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1102999999999997e-05 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020214+0000", 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0486999999999999e-05 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020390+0000", 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176369 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020603+0000", 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021285100000000001 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020873+0000", 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026986799999999999 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.022546+0000", 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016730440000000001 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023289+0000", 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074325699999999999 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023412+0000", 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012286900000000001 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023510+0000", 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8152999999999994e-05 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:373 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.058 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.959270846999999, 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032496819999999998, 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 373 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043083+0000", 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3999999999999999e-06 2024-09-21T09:11:29.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043110+0000", 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7370000000000001e-05 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043128+0000", 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8320000000000001e-05 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043139+0000", 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0763e-05 2024-09-21T09:11:29.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043748+0000", 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060880199999999998 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043963+0000", 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000215198 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.044316+0000", 2024-09-21T09:11:29.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284100000000001 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045592+0000", 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001275921 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046080+0000", 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048865200000000001 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046216+0000", 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013579600000000001 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046331+0000", 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011461899999999999 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:446 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.932649597000001, 2024-09-21T09:11:29.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033921149999999998, 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 446 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069704+0000", 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7090000000000001e-06 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069713+0000", 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1630000000000002e-06 2024-09-21T09:11:29.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069742+0000", 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8739999999999999e-05 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069754+0000", 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2271e-05 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069885+0000", 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013067999999999999 2024-09-21T09:11:29.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.070151+0000", 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026643499999999998 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.070748+0000", 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059699500000000001 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.072288+0000", 2024-09-21T09:11:29.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015399249999999999 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.072942+0000", 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00065338199999999999 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.073033+0000", 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0826000000000001e-05 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.073095+0000", 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1989000000000006e-05 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:452 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.928340615, 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031754840000000001, 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.070 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 452 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:29.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074013+0000", 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.331e-06 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074022+0000", 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1570000000000006e-06 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074046+0000", 2024-09-21T09:11:29.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.374e-05 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074063+0000", 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074172+0000", 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010967300000000001 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074309+0000", 2024-09-21T09:11:29.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136489 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074654+0000", 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034524499999999999 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.076228+0000", 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015737209999999999 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077038+0000", 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00081049799999999999 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077121+0000", 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2402000000000002e-05 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077187+0000", 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6070999999999998e-05 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:493 6.13 6:cd178ae0:reshard::reshard.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.911174432999999, 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038520270000000001, 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 493 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091180+0000", 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.294e-06 2024-09-21T09:11:29.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091202+0000", 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2039999999999999e-05 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091231+0000", 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8756999999999999e-05 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091246+0000", 2024-09-21T09:11:29.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.49e-05 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091382+0000", 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136193 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091606+0000", 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022468499999999999 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:29.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091931+0000", 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000324171 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.093225+0000", 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012946329999999999 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.094882+0000", 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016571750000000001 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.094957+0000", 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4991000000000001e-05 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.095030+0000", 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2187999999999994e-05 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:501 6.13 6:cd178ae0:reshard::reshard.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.081 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.906195918000002, 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003138456, 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 501 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096158+0000", 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096168+0000", 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0052e-05 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096191+0000", 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2965000000000001e-05 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096211+0000", 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0040000000000001e-05 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096403+0000", 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019186299999999999 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096630+0000", 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022718200000000001 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096990+0000", 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035963 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.098287+0000", 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012970600000000001 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099072+0000", 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00078496299999999996 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099197+0000", 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012550699999999999 2024-09-21T09:11:29.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099295+0000", 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7194000000000005e-05 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:565 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.870068510999999, 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045932120000000002, 2024-09-21T09:11:29.087 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 565 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132287+0000", 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2320000000000001e-06 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132300+0000", 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2782999999999999e-05 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132337+0000", 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7036000000000003e-05 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132373+0000", 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6000000000000001e-05 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132537+0000", 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016473700000000001 2024-09-21T09:11:29.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132788+0000", 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025062400000000002 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.133316+0000", 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052850300000000005 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134573+0000", 2024-09-21T09:11:29.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012568449999999999 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136729+0000", 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021554590000000002 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136810+0000", 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1236000000000006e-05 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136877+0000", 2024-09-21T09:11:29.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6756999999999998e-05 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:580 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.854810930999999, 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031517770000000001, 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.093 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 580 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147543+0000", 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6479999999999999e-06 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147552+0000", 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1400000000000006e-06 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147578+0000", 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5680000000000001e-05 2024-09-21T09:11:29.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147591+0000", 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3077e-05 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147726+0000", 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013512600000000001 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.148022+0000", 2024-09-21T09:11:29.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029581200000000001 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.148500+0000", 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047833400000000002 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.149801+0000", 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001301024 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150536+0000", 2024-09-21T09:11:29.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073525399999999996 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150638+0000", 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010145300000000001 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150693+0000", 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5229000000000003e-05 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.576095686999999, 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030807830000000001, 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.099 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 789 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426258+0000", 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426269+0000", 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0366999999999999e-05 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426300+0000", 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1646000000000002e-05 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426316+0000", 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5330000000000001e-05 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426464+0000", 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148455 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426728+0000", 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000263451 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.427238+0000", 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00051078300000000001 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.428446+0000", 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001207898 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429175+0000", 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072848399999999995 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429267+0000", 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2373000000000005e-05 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429337+0000", 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9936000000000003e-05 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:29.104 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.523675568000002, 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003253124, 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 811 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478679+0000", 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1629999999999999e-06 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478689+0000", 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.046e-05 2024-09-21T09:11:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478721+0000", 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1535999999999998e-05 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478736+0000", 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5494000000000001e-05 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478888+0000", 2024-09-21T09:11:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015226500000000001 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.479263+0000", 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037449100000000002 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.479864+0000", 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060063800000000002 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481130+0000", 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012669000000000001 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481767+0000", 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00063663499999999998 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481856+0000", 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9376999999999995e-05 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481930+0000", 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3164999999999995e-05 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.336798056999999, 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032567009999999999, 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.111 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.111 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.111 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 889 2024-09-21T09:11:29.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.111 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:29.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:29.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665557+0000", 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6359999999999998e-06 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665569+0000", 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2296999999999999e-05 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665602+0000", 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3433000000000003e-05 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665620+0000", 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7176e-05 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665779+0000", 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015932899999999999 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.666162+0000", 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038277999999999999 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.666737+0000", 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057502599999999997 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668002+0000", 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001265024 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668648+0000", 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00064676200000000005 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668739+0000", 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0805999999999998e-05 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668811+0000", 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1432000000000003e-05 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.117 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.322202108999999, 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031261549999999998, 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.118 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 895 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:29.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680152+0000", 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680163+0000", 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0627e-05 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680195+0000", 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2521999999999998e-05 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680211+0000", 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5633000000000001e-05 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680393+0000", 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018196600000000001 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680627+0000", 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023373099999999999 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:29.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680971+0000", 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034410099999999998 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.682191+0000", 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012203940000000001 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683114+0000", 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092252999999999996 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:29.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683209+0000", 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5651999999999998e-05 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683276+0000", 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6855999999999998e-05 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:29.123 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:29.125 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-09-21T09:11:29.126 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:29.125+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:29.126 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:11:29.225 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:29.224+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:29.302 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:29.302 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:29.302 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:29.302 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:29.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:11:29.361 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:29.361+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:29.427 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:29.428+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:29.437 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:29.438 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:29.438 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:29.438 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:29.438 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:29.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:11:29.528 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:29.528+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:29.629 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:29.629 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:29.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:29.629 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.742198782999999, 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.005197709, 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.630 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 46 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883306+0000", 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8680000000000001e-06 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883320+0000", 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3777e-05 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883355+0000", 2024-09-21T09:11:29.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5457000000000003e-05 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883381+0000", 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5548e-05 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883631+0000", 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025032199999999998 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883924+0000", 2024-09-21T09:11:29.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029322899999999999 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.884247+0000", 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032292300000000003 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.885849+0000", 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016019459999999999 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888259+0000", 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024100409999999999 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888397+0000", 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013753600000000001 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888500+0000", 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103062 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.635 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113020240896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.736526631, 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058707430000000003, 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.636 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 47 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888977+0000", 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888990+0000", 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.33e-05 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889036+0000", 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6328000000000001e-05 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889059+0000", 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3048e-05 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889882+0000", 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082253800000000005 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890147+0000", 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026500299999999998 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890549+0000", 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000402323 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.893575+0000", 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030257690000000002 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894522+0000", 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094709000000000004 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894675+0000", 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015305599999999999 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894845+0000", 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016973100000000001 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.641 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.625701281000001, 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035327039999999998, 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 191 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.642 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999801+0000", 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:29.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999812+0000", 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0183000000000001e-05 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999843+0000", 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1553000000000001e-05 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999858+0000", 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4907e-05 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000009+0000", 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000150786 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000333+0000", 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032434100000000002 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000821+0000", 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048796000000000001 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.002625+0000", 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001803802 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003193+0000", 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056811000000000003 2024-09-21T09:11:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003267+0000", 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3980000000000007e-05 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003332+0000", 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5022000000000002e-05 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T09:11:29.647 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.760216497999998, 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039222459999999999, 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 205 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865287+0000", 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3000000000000002e-06 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865304+0000", 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6269999999999998e-05 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865349+0000", 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5652999999999998e-05 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865370+0000", 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1117000000000001e-05 2024-09-21T09:11:29.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865572+0000", 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020120199999999999 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865819+0000", 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024759800000000002 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.866195+0000", 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000375557 2024-09-21T09:11:29.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.867603+0000", 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001407967 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.868927+0000", 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013238410000000001 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869095+0000", 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016838899999999999 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869206+0000", 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111352 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.73178373, 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031054379999999999, 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 209 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893719+0000", 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3599999999999999e-06 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893731+0000", 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.222e-05 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893765+0000", 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3782999999999998e-05 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893781+0000", 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893906+0000", 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012485299999999999 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894129+0000", 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022317800000000001 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894535+0000", 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040575399999999998 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.895977+0000", 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014418199999999999 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896619+0000", 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064255900000000001 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896704+0000", 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4653000000000004e-05 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896822+0000", 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118285 2024-09-21T09:11:29.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.716441616000001, 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037831409999999998, 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.659 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 213 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909062+0000", 2024-09-21T09:11:29.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0400000000000001e-06 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909075+0000", 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3094e-05 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909106+0000", 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0426e-05 2024-09-21T09:11:29.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909121+0000", 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5903e-05 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909280+0000", 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000158772 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909665+0000", 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038435800000000001 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.910380+0000", 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071585799999999999 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912186+0000", 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018052649999999999 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912661+0000", 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047496399999999997 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912752+0000", 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1445000000000003e-05 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912842+0000", 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0016e-05 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.664 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.702198553999999, 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576779, 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 215 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.665 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923305+0000", 2024-09-21T09:11:29.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5639999999999999e-06 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923317+0000", 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1956e-05 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923349+0000", 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2706999999999997e-05 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923366+0000", 2024-09-21T09:11:29.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6552999999999999e-05 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923539+0000", 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017352200000000001 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923939+0000", 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000399334 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.924459+0000", 2024-09-21T09:11:29.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052057299999999998 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.925959+0000", 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001499703 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926718+0000", 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075869800000000003 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926799+0000", 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0950000000000003e-05 2024-09-21T09:11:29.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926879+0000", 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0218999999999999e-05 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.678965733999998, 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031911079999999998, 2024-09-21T09:11:29.670 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 221 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946537+0000", 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946549+0000", 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1527e-05 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946580+0000", 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1356999999999998e-05 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946597+0000", 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7093000000000001e-05 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946714+0000", 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116872 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946936+0000", 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022225500000000001 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.947359+0000", 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042271099999999999 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.948825+0000", 2024-09-21T09:11:29.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014661159999999999 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949560+0000", 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073491500000000005 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949644+0000", 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4147000000000006e-05 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949726+0000", 2024-09-21T09:11:29.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1854999999999995e-05 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.660485316999999, 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030775389999999998, 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.676 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 226 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965018+0000", 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2199999999999999e-06 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965029+0000", 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1436e-05 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965061+0000", 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2055999999999999e-05 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965077+0000", 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.558e-05 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965200+0000", 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012353599999999999 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965442+0000", 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024218199999999999 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:29.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965830+0000", 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038740699999999999 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967527+0000", 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001696999 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967943+0000", 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041585999999999999 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968028+0000", 2024-09-21T09:11:29.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.53e-05 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968093+0000", 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4962999999999994e-05 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.285041684999999, 2024-09-21T09:11:29.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029016699999999999, 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 754 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340461+0000", 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340471+0000", 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8199999999999992e-06 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340502+0000", 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1047000000000003e-05 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340527+0000", 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4739000000000001e-05 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340685+0000", 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015804600000000001 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340891+0000", 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020627199999999999 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.341212+0000", 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032101500000000002 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.342549+0000", 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013375469999999999 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343214+0000", 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066447900000000005 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343299+0000", 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5154999999999994e-05 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343361+0000", 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1569999999999995e-05 2024-09-21T09:11:29.686 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:757 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.278170613, 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029276440000000001, 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.687 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 757 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347332+0000", 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0200000000000001e-06 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347343+0000", 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347374+0000", 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1600000000000002e-05 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347389+0000", 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.486e-05 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347509+0000", 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119815 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347727+0000", 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217956 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.348046+0000", 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031872699999999999 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.349129+0000", 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010836559999999999 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350046+0000", 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091629999999999999 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350135+0000", 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9666999999999994e-05 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350258+0000", 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012226899999999999 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.692 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:759 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.274338432, 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002979752, 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 759 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351164+0000", 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.703e-06 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351174+0000", 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0013000000000001e-05 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351205+0000", 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1189999999999998e-05 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351223+0000", 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8003e-05 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351341+0000", 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118306 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351470+0000", 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000129076 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351737+0000", 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026687199999999998 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353037+0000", 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012995509999999999 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353989+0000", 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095197900000000004 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354076+0000", 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6730000000000005e-05 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354142+0000", 2024-09-21T09:11:29.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6328999999999995e-05 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.246792479, 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002900807, 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 771 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378710+0000", 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.42e-06 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378717+0000", 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4739999999999999e-06 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378740+0000", 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.268e-05 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378751+0000", 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1143e-05 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378925+0000", 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017384900000000001 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379066+0000", 2024-09-21T09:11:29.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141712 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379328+0000", 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026180499999999999 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.380651+0000", 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322611 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381467+0000", 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081640100000000002 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381547+0000", 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9705999999999999e-05 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381609+0000", 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2006000000000002e-05 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.041358422999998, 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029926800000000002, 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 856 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.704 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584144+0000", 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2469999999999998e-06 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584158+0000", 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3519999999999999e-05 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584191+0000", 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2617000000000003e-05 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584206+0000", 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5276000000000001e-05 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584325+0000", 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118929 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584567+0000", 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242525 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584885+0000", 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031785100000000002 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.585978+0000", 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001093246 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.586991+0000", 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00101264 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587071+0000", 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9765999999999995e-05 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587135+0000", 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4063e-05 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:861 6.3 6:c0550c60:::obj_delete_at_hint.0000000094:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.030931357, 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00331716, 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.709 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 861 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:29.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594571+0000", 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.686e-06 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594581+0000", 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8870000000000004e-06 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594612+0000", 2024-09-21T09:11:29.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1433000000000002e-05 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594630+0000", 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7589999999999999e-05 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594779+0000", 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014932199999999999 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595030+0000", 2024-09-21T09:11:29.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025084100000000002 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595533+0000", 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050262699999999996 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.596870+0000", 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013373580000000001 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597612+0000", 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074164800000000003 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597770+0000", 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015815499999999999 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597886+0000", 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116613 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.954352674999999, 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030306669999999999, 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 892 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671150+0000", 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.097e-06 2024-09-21T09:11:29.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671161+0000", 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0499999999999999e-05 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671191+0000", 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0383e-05 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671206+0000", 2024-09-21T09:11:29.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5437000000000001e-05 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671359+0000", 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152189 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671584+0000", 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022531499999999999 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:29.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671899+0000", 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031528399999999999 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673019+0000", 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011199560000000001 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673900+0000", 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088067799999999997 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674066+0000", 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016586500000000001 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674179+0000", 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112963 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:904 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.924706949000001, 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003078852, 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 904 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700796+0000", 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1840000000000002e-06 2024-09-21T09:11:29.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700807+0000", 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1049999999999999e-05 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700836+0000", 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8833e-05 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700851+0000", 2024-09-21T09:11:29.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4813e-05 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700970+0000", 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119456 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701187+0000", 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021738899999999999 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701519+0000", 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033143400000000003 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.702692+0000", 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011726620000000001 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703599+0000", 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090731700000000004 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703756+0000", 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015696199999999999 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703873+0000", 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116752 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:906 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:29.726 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.920766259000001, 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031432679999999998, 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 906 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704736+0000", 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7400000000000001e-06 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704746+0000", 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4499999999999993e-06 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704770+0000", 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.402e-05 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704781+0000", 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1790000000000001e-05 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704909+0000", 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012782900000000001 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705162+0000", 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000253191 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705681+0000", 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051818999999999997 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707026+0000", 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013454840000000001 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707720+0000", 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069363499999999995 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707803+0000", 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3603000000000006e-05 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707878+0000", 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4336000000000001e-05 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:919 6.5 6:a1987d85:::obj_delete_at_hint.0000000114:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.888426142, 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003079816, 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.732 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.733 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.733 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.733 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.733 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 919 2024-09-21T09:11:29.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.733 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:29.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737077+0000", 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2699999999999999e-06 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737091+0000", 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3825999999999999e-05 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737121+0000", 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.046e-05 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737138+0000", 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6793999999999999e-05 2024-09-21T09:11:29.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737252+0000", 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114552 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737522+0000", 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026934799999999998 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:29.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737855+0000", 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033290799999999998 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.739016+0000", 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011608949999999999 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740004+0000", 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098829699999999996 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740090+0000", 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6645999999999997e-05 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740154+0000", 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3819999999999995e-05 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:29.738 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.831426667999999, 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003307838, 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 943 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:29.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794076+0000", 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.804e-06 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:29.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794085+0000", 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5859999999999994e-06 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794113+0000", 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8056999999999999e-05 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794128+0000", 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4382999999999999e-05 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:29.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794276+0000", 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000148286 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794649+0000", 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037297399999999998 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.795219+0000", 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056944899999999998 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:29.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.796426+0000", 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012075390000000001 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797214+0000", 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078828100000000005 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797295+0000", 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0289000000000003e-05 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:29.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797382+0000", 2024-09-21T09:11:29.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7189999999999997e-05 2024-09-21T09:11:29.744 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.744 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.744 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.744 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:29.744 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:29.744 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:29.745 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:29.628+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:29.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:11:29.746 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:29.744+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:29.846 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:29.848+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:29.878 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:29.878 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:29.878 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:29.878 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:29.893 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:11:29.946 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:29.948+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:30.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:11:30.023 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:30.023 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:30.023 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:30.023 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:30.023 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:30.040 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:11:30.047 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:30.048+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:30.148 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:30.148+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:30.159 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:30.160 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:30.177 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:30.177 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:30.194 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:30.194 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:30.203 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:30.203 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:30.212 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:30.212 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:30.218 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:11:30.233 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:30.233 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:30.249 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:30.248+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:30.254 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:30.275 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:30.298 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:30.298 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:30.335 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:30.336 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:30.350 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:30.349+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:30.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:11:30.451 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:30.452+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:30.512 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:30.512 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:30.526 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:11:30.573 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:30.573+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:30.653 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:30.653+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:30.659 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:30.659 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:30.673 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:11:30.761 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:30.761+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:30.848 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:30.848 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:30.855 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:30.853+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:30.863 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:11:30.956 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:30.956+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:31.033 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:31.034 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:31.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:11:31.097 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:31.096+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:31.126 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T09:11:31.157 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:31.156+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:31.179 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:31.179 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:31.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:11:31.258 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:31.259+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:31.331 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:31.332 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:31.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:11:31.359 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:31.356+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:31.460 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:31.459+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:31.522 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:31.522 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:31.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:11:31.582 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:31.583+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:31.662 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:31.660+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:31.706 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:31.706 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:31.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:11:31.770 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:31.771+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:31.847 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:31.848 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:31.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:11:31.906 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:31.907+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:31.964 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:31.960+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:32.036 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:32.036 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:32.052 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:11:32.053 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-09-21T09:11:32.064 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:32.064+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:32.166 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:32.164+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:32.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:11:32.267 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:32.264+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:32.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:11:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:32.337 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:11:32.382 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:32.383+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:32.457 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:32.458 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:32.469 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:32.467+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:32.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:11:32.477 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:32.477 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:32.496 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:32.513 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:32.513 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:32.531 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:32.549 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:32.567 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:32.567 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:32.569 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:32.567+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:32.585 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:32.585 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:32.605 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:32.605 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:32.645 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:32.645 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.750412424, 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032488320000000001, 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892888+0000", 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892890+0000", 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9460000000000001e-06 2024-09-21T09:11:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892903+0000", 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3191e-05 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892931+0000", 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8263e-05 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.892952+0000", 2024-09-21T09:11:32.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.084e-05 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.893079+0000", 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126372 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.893129+0000", 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0575000000000003e-05 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.896028+0000", 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028986569999999998 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:04.896137+0000", 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010898799999999999 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:32.650 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.736617681999999, 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004079816, 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 212 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:32.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906683+0000", 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906685+0000", 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906698+0000", 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.226e-05 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906738+0000", 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0790000000000001e-05 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906760+0000", 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1053e-05 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.906890+0000", 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013003900000000001 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.907102+0000", 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021250899999999999 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.907740+0000", 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000638158 2024-09-21T09:11:32.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.909485+0000", 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017448299999999999 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910591+0000", 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011057549999999999 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910687+0000", 2024-09-21T09:11:32.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6642000000000001e-05 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.910763+0000", 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5220000000000001e-05 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.672911559999999, 2024-09-21T09:11:32.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032988240000000001, 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 227 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970389+0000", 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970391+0000", 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2929999999999999e-06 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970403+0000", 2024-09-21T09:11:32.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1317e-05 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970434+0000", 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970449+0000", 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5270000000000001e-05 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970568+0000", 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119209 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.970802+0000", 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233482 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.971219+0000", 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041719000000000001 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.972619+0000", 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400466 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973531+0000", 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00091115300000000005 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973619+0000", 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8451999999999999e-05 2024-09-21T09:11:32.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.973688+0000", 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8685999999999999e-05 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:32.662 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.665756698999999, 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032094659999999998, 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 229 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977544+0000", 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977546+0000", 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0099999999999998e-06 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977556+0000", 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0567000000000001e-05 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977587+0000", 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1040000000000001e-05 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977602+0000", 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4905999999999999e-05 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977714+0000", 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111433 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.977932+0000", 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021773800000000001 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.978379+0000", 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044706699999999999 2024-09-21T09:11:32.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.979968+0000", 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015892879999999999 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980596+0000", 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00062846199999999999 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980686+0000", 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9555000000000006e-05 2024-09-21T09:11:32.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.980753+0000", 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7399999999999998e-05 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.658852188000001, 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00337558, 2024-09-21T09:11:32.668 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 231 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984448+0000", 2024-09-21T09:11:32.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984450+0000", 2024-09-21T09:11:32.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.996e-06 2024-09-21T09:11:32.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984460+0000", 2024-09-21T09:11:32.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0084e-05 2024-09-21T09:11:32.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984489+0000", 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8306e-05 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984502+0000", 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3686000000000001e-05 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984650+0000", 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000147646 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984867+0000", 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217355 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.985296+0000", 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042830599999999999 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.986743+0000", 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001447786 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987670+0000", 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092669599999999997 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987757+0000", 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6889000000000001e-05 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.987824+0000", 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6829999999999995e-05 2024-09-21T09:11:32.674 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.651915675000001, 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034045730000000001, 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.675 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 233 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991385+0000", 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991387+0000", 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0229999999999999e-06 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991397+0000", 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.049e-05 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991429+0000", 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1619999999999999e-05 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991444+0000", 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4763000000000001e-05 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991615+0000", 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000170946 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.991838+0000", 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022331099999999999 2024-09-21T09:11:32.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.992265+0000", 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042681000000000001 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.993741+0000", 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001475762 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994623+0000", 2024-09-21T09:11:32.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088250999999999998 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994721+0000", 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7836000000000003e-05 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.994789+0000", 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8502000000000002e-05 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:304 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.622142508, 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036139980000000002, 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 304 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021158+0000", 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021161+0000", 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5069999999999999e-06 2024-09-21T09:11:32.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021173+0000", 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2583e-05 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021214+0000", 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1069000000000003e-05 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021241+0000", 2024-09-21T09:11:32.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6906999999999998e-05 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021408+0000", 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000167152 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.021731+0000", 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032271399999999999 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.022158+0000", 2024-09-21T09:11:32.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042704700000000001 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023398+0000", 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012401230000000001 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024548+0000", 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011494140000000001 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024666+0000", 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118676 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.024772+0000", 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105806 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.686 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.244068649999999, 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037127079999999999, 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 778 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399232+0000", 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399235+0000", 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8700000000000001e-06 2024-09-21T09:11:32.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399248+0000", 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3366e-05 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399282+0000", 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3893999999999998e-05 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399298+0000", 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.592e-05 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399460+0000", 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016227200000000001 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.399836+0000", 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037539000000000002 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.400430+0000", 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059482899999999995 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402013+0000", 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001582111 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402653+0000", 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00064022500000000002 2024-09-21T09:11:32.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402822+0000", 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016921500000000001 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.402945+0000", 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012261600000000001 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.239028036000001, 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032620489999999999, 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 780 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404272+0000", 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404274+0000", 2024-09-21T09:11:32.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7770000000000001e-06 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404288+0000", 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3556e-05 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404322+0000", 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4097000000000002e-05 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404339+0000", 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7033000000000001e-05 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404488+0000", 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014927899999999999 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.404726+0000", 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023736800000000001 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:32.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.405211+0000", 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048574000000000002 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.406409+0000", 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011978010000000001 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407327+0000", 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00091810600000000002 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407415+0000", 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8103000000000007e-05 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407535+0000", 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119189 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.698 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.235563898999999, 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00307639, 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 781 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407737+0000", 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407739+0000", 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9039999999999999e-06 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407749+0000", 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0285999999999999e-05 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407776+0000", 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7362999999999999e-05 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407794+0000", 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7343e-05 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.407956+0000", 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000162872 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.408173+0000", 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021697599999999999 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.408519+0000", 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034568000000000001 2024-09-21T09:11:32.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.409685+0000", 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001166081 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410657+0000", 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000972276 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410748+0000", 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0883000000000004e-05 2024-09-21T09:11:32.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.410813+0000", 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4726000000000003e-05 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.200011230000001, 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003006463, 2024-09-21T09:11:32.704 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 796 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443289+0000", 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443292+0000", 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3360000000000002e-06 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443303+0000", 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1216999999999999e-05 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443334+0000", 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1007000000000003e-05 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443349+0000", 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5549999999999999e-05 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443498+0000", 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014889800000000001 2024-09-21T09:11:32.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.443708+0000", 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020971499999999999 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.444011+0000", 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030331100000000001 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.445066+0000", 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010543390000000001 2024-09-21T09:11:32.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446140+0000", 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001074342 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446230+0000", 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0082999999999998e-05 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.446296+0000", 2024-09-21T09:11:32.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5665000000000002e-05 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.036212303999999, 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003056933, 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.710 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 865 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607088+0000", 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607091+0000", 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2859999999999998e-06 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607102+0000", 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1087000000000001e-05 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607134+0000", 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2422999999999998e-05 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607149+0000", 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.541e-05 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607277+0000", 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012709900000000001 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607492+0000", 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021501499999999999 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:32.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.607801+0000", 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030958100000000002 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.609238+0000", 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014371620000000001 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.609990+0000", 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00075128100000000002 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.610079+0000", 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9769000000000001e-05 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.610145+0000", 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5820000000000003e-05 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.715 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.032024545999999, 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029754769999999998, 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 867 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611276+0000", 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611278+0000", 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611288+0000", 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0149999999999999e-05 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611315+0000", 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7080000000000002e-05 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611328+0000", 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3137e-05 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611440+0000", 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111462 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611564+0000", 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012396299999999999 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.611831+0000", 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026706100000000002 2024-09-21T09:11:32.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.612759+0000", 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092851299999999995 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614096+0000", 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013366490000000001 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614187+0000", 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0519999999999994e-05 2024-09-21T09:11:32.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.614251+0000", 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4886000000000002e-05 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.021080895000001, 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029765310000000001, 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 871 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622220+0000", 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622222+0000", 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.21e-06 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622233+0000", 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0824e-05 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622264+0000", 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1449999999999999e-05 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622279+0000", 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4600000000000001e-05 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622403+0000", 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012454499999999999 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622633+0000", 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023006200000000001 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.622953+0000", 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031925699999999998 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.623929+0000", 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00097615600000000005 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625044+0000", 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011150450000000001 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625131+0000", 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7006e-05 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.625196+0000", 2024-09-21T09:11:32.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5376000000000006e-05 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.948765215999998, 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033591379999999998, 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.727 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 901 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694535+0000", 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694538+0000", 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2900000000000001e-06 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694549+0000", 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1727e-05 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694580+0000", 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1046000000000001e-05 2024-09-21T09:11:32.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694595+0000", 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4630000000000001e-05 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.694753+0000", 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158209 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.695123+0000", 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036946400000000001 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.695679+0000", 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055595600000000003 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.696976+0000", 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012978569999999999 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697612+0000", 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00063595500000000001 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697772+0000", 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015977499999999999 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.697894+0000", 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012222900000000001 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.944033842, 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033021410000000002, 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 903 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.733 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699267+0000", 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699269+0000", 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-06 2024-09-21T09:11:32.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699279+0000", 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0679999999999999e-05 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699313+0000", 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3492999999999999e-05 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699328+0000", 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5146e-05 2024-09-21T09:11:32.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699453+0000", 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012516299999999999 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.699695+0000", 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024171800000000001 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.700179+0000", 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048459000000000002 2024-09-21T09:11:32.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.701405+0000", 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012259300000000001 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702295+0000", 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088928599999999998 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702449+0000", 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154146 2024-09-21T09:11:32.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.702569+0000", 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120149 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.868383496, 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031752249999999998, 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.738 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 934 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774917+0000", 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774919+0000", 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774930+0000", 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0943e-05 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774962+0000", 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2332999999999997e-05 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.774981+0000", 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.861e-05 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775151+0000", 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016968500000000001 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775374+0000", 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223408 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.775703+0000", 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032880099999999998 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.776995+0000", 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001292477 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.777936+0000", 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094082599999999997 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.778023+0000", 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6630000000000002e-05 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.778092+0000", 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9511999999999994e-05 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.856816344999999, 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031504950000000001, 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.744 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 939 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786484+0000", 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786486+0000", 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.243e-06 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786497+0000", 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0823e-05 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786529+0000", 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1843e-05 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786544+0000", 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4863e-05 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786714+0000", 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016992299999999999 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.786857+0000", 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143485 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.787126+0000", 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268285 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.788229+0000", 2024-09-21T09:11:32.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001103234 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789472+0000", 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012431110000000001 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789568+0000", 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5563000000000006e-05 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.789635+0000", 2024-09-21T09:11:32.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7121999999999999e-05 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.840027471999999, 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033136279999999999, 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.750 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 946 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803273+0000", 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803275+0000", 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.097e-06 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803286+0000", 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0823e-05 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803317+0000", 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.095e-05 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803332+0000", 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4816e-05 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803496+0000", 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000164442 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.803870+0000", 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037405700000000001 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.804492+0000", 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00062171500000000001 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.805916+0000", 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001424533 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806305+0000", 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038826399999999998 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806462+0000", 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000156885 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.806587+0000", 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125046 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.755 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.835552536000002, 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031808890000000001, 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:32.756 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 948 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807748+0000", 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807749+0000", 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.39e-06 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807757+0000", 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7430000000000002e-06 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807780+0000", 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2480000000000002e-05 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807793+0000", 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.807917+0000", 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000123573 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.808151+0000", 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000234625 2024-09-21T09:11:32.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.808661+0000", 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00050934999999999999 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.809886+0000", 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012251230000000001 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810640+0000", 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00075449700000000002 2024-09-21T09:11:32.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810803+0000", 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016247899999999999 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.810929+0000", 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126153 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:32.761 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:32.763 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:11:32.763 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:32.760+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:32.863 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:32.860+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:32.937 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:32.938 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:32.938 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:32.938 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:32.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:11:32.998 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:32.999+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:33.066 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:33.063+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:33.095 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:33.095 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:33.095 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:11:33.095 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:11:33.095 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:33.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:11:33.166 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:33.164+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:33.266 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:33.267+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.266073643999999, 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003218832, 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.275 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 193 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006552+0000", 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0430000000000002e-06 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006564+0000", 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1416999999999999e-05 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006596+0000", 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1899000000000001e-05 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006611+0000", 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5452999999999999e-05 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006757+0000", 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145816 2024-09-21T09:11:33.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.007003+0000", 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024615500000000002 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.007288+0000", 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000285304 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.008784+0000", 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001495449 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009620+0000", 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00083642999999999999 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009701+0000", 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0653000000000002e-05 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009769+0000", 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8213000000000006e-05 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.386306224999998, 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091541390000000004, 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.281 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 208 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:33.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886321+0000", 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3500000000000001e-06 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886355+0000", 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3986000000000003e-05 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886391+0000", 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5947e-05 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886412+0000", 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1022999999999998e-05 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886600+0000", 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018761200000000001 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886611+0000", 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1759999999999999e-05 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.891318+0000", 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004706689 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.891698+0000", 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000380174 2024-09-21T09:11:33.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.892508+0000", 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00080938400000000001 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.893820+0000", 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013127830000000001 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895296+0000", 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014755289999999999 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895394+0000", 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8226000000000004e-05 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895472+0000", 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7676000000000006e-05 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.287 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.34335845, 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035744320000000002, 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.288 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 216 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929268+0000", 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8229999999999999e-06 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929279+0000", 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1194e-05 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929312+0000", 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2991999999999999e-05 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929328+0000", 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5733999999999999e-05 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929487+0000", 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158579 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929719+0000", 2024-09-21T09:11:33.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000232351 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.930129+0000", 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000409687 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.931616+0000", 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014871109999999999 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932688+0000", 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010723359999999999 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932774+0000", 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5688999999999999e-05 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932840+0000", 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5936e-05 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.293 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.335398090999998, 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035738390000000001, 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 218 2024-09-21T09:11:33.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937228+0000", 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1069999999999999e-06 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937238+0000", 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0349e-05 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937270+0000", 2024-09-21T09:11:33.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1690000000000003e-05 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937285+0000", 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5167000000000001e-05 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937408+0000", 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000122519 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937628+0000", 2024-09-21T09:11:33.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022077800000000001 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.938055+0000", 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042683700000000001 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.939639+0000", 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015836540000000001 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940641+0000", 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001002246 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940735+0000", 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3725000000000001e-05 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940800+0000", 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4766999999999998e-05 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.299 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.331445301999999, 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034600199999999998, 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.300 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 219 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941181+0000", 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1399999999999998e-06 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941191+0000", 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0257e-05 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941224+0000", 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2786000000000001e-05 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941247+0000", 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.336e-05 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941345+0000", 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7769000000000005e-05 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941556+0000", 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021123499999999999 2024-09-21T09:11:33.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.942003+0000", 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044704 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.943418+0000", 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014148019999999999 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944488+0000", 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001070192 2024-09-21T09:11:33.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944576+0000", 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7355999999999995e-05 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944639+0000", 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3083000000000006e-05 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.312624451000001, 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033829009999999998, 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 224 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.306 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960001+0000", 2024-09-21T09:11:33.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0329999999999998e-06 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960012+0000", 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0437e-05 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960045+0000", 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2676999999999999e-05 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960068+0000", 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2935999999999999e-05 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960194+0000", 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012679600000000001 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960446+0000", 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025164099999999998 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960917+0000", 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047095600000000002 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.962230+0000", 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013132669999999999 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963231+0000", 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010005599999999999 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963321+0000", 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9825000000000001e-05 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963382+0000", 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1773000000000006e-05 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.274035648000002, 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033658070000000002, 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 235 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.312 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998590+0000", 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2299999999999998e-06 2024-09-21T09:11:33.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998601+0000", 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0959e-05 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998635+0000", 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3420000000000002e-05 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998658+0000", 2024-09-21T09:11:33.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3159999999999998e-05 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998781+0000", 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012267199999999999 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.999025+0000", 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000243892 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.999452+0000", 2024-09-21T09:11:33.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042783699999999998 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.000893+0000", 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001440275 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001739+0000", 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00084627300000000003 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001834+0000", 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4826000000000003e-05 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001954+0000", 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120263 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.317 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:263 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.260346317, 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034424360000000001, 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 263 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012280+0000", 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1799999999999999e-06 2024-09-21T09:11:33.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012292+0000", 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1763000000000001e-05 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012326+0000", 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4493000000000003e-05 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012343+0000", 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6813e-05 2024-09-21T09:11:33.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012527+0000", 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018387899999999999 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012699+0000", 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017209500000000001 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013267+0000", 2024-09-21T09:11:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056834500000000005 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014605+0000", 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013380899999999999 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015459+0000", 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00085365300000000001 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015612+0000", 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015307600000000001 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015720+0000", 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010804899999999999 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:297 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.323 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.252473387999999, 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033597840000000002, 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 297 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020152+0000", 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020162+0000", 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7829999999999993e-06 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020193+0000", 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1102999999999997e-05 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020214+0000", 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0486999999999999e-05 2024-09-21T09:11:33.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020390+0000", 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176369 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020603+0000", 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021285100000000001 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020873+0000", 2024-09-21T09:11:33.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026986799999999999 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.022546+0000", 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016730440000000001 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023289+0000", 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074325699999999999 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023412+0000", 2024-09-21T09:11:33.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012286900000000001 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023510+0000", 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8152999999999994e-05 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.329 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:373 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.229542709, 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032496819999999998, 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 373 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043083+0000", 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3999999999999999e-06 2024-09-21T09:11:33.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043110+0000", 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7370000000000001e-05 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043128+0000", 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8320000000000001e-05 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043139+0000", 2024-09-21T09:11:33.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0763e-05 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043748+0000", 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060880199999999998 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043963+0000", 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000215198 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:33.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.044316+0000", 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284100000000001 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045592+0000", 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001275921 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046080+0000", 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048865200000000001 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046216+0000", 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013579600000000001 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046331+0000", 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011461899999999999 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:446 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.335 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.202921458999999, 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033921149999999998, 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 446 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069704+0000", 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7090000000000001e-06 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069713+0000", 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1630000000000002e-06 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069742+0000", 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8739999999999999e-05 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069754+0000", 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2271e-05 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069885+0000", 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013067999999999999 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.070151+0000", 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026643499999999998 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.070748+0000", 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059699500000000001 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.072288+0000", 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015399249999999999 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.072942+0000", 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00065338199999999999 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.073033+0000", 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0826000000000001e-05 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.073095+0000", 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1989000000000006e-05 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:452 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.198612477000001, 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031754840000000001, 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 452 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074013+0000", 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.331e-06 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074022+0000", 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1570000000000006e-06 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074046+0000", 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.374e-05 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074063+0000", 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074172+0000", 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010967300000000001 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074309+0000", 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136489 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074654+0000", 2024-09-21T09:11:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034524499999999999 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.076228+0000", 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015737209999999999 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077038+0000", 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00081049799999999999 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077121+0000", 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2402000000000002e-05 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077187+0000", 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6070999999999998e-05 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:493 6.13 6:cd178ae0:reshard::reshard.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.347 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.181446295000001, 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038520270000000001, 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 493 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:33.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091180+0000", 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.294e-06 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091202+0000", 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2039999999999999e-05 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091231+0000", 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8756999999999999e-05 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091246+0000", 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.49e-05 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091382+0000", 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136193 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091606+0000", 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022468499999999999 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091931+0000", 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000324171 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.093225+0000", 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012946329999999999 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.094882+0000", 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016571750000000001 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.094957+0000", 2024-09-21T09:11:33.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4991000000000001e-05 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.095030+0000", 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2187999999999994e-05 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:501 6.13 6:cd178ae0:reshard::reshard.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.176467779999999, 2024-09-21T09:11:33.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003138456, 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 501 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:33.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096158+0000", 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096168+0000", 2024-09-21T09:11:33.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0052e-05 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096191+0000", 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2965000000000001e-05 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096211+0000", 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0040000000000001e-05 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096403+0000", 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019186299999999999 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096630+0000", 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022718200000000001 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096990+0000", 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035963 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.098287+0000", 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012970600000000001 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099072+0000", 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00078496299999999996 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099197+0000", 2024-09-21T09:11:33.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012550699999999999 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099295+0000", 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7194000000000005e-05 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:565 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.140340373000001, 2024-09-21T09:11:33.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045932120000000002, 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 565 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132287+0000", 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2320000000000001e-06 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132300+0000", 2024-09-21T09:11:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2782999999999999e-05 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132337+0000", 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7036000000000003e-05 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132373+0000", 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6000000000000001e-05 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132537+0000", 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016473700000000001 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132788+0000", 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025062400000000002 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.133316+0000", 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052850300000000005 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134573+0000", 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012568449999999999 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136729+0000", 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021554590000000002 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136810+0000", 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1236000000000006e-05 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136877+0000", 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6756999999999998e-05 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:580 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.125082793000001, 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031517770000000001, 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 580 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147543+0000", 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6479999999999999e-06 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147552+0000", 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1400000000000006e-06 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147578+0000", 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5680000000000001e-05 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147591+0000", 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3077e-05 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147726+0000", 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013512600000000001 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.148022+0000", 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029581200000000001 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.148500+0000", 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047833400000000002 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.149801+0000", 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001301024 2024-09-21T09:11:33.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150536+0000", 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073525399999999996 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150638+0000", 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010145300000000001 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150693+0000", 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5229000000000003e-05 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.846367549, 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030807830000000001, 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 789 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426258+0000", 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426269+0000", 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0366999999999999e-05 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426300+0000", 2024-09-21T09:11:33.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1646000000000002e-05 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426316+0000", 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5330000000000001e-05 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426464+0000", 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148455 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426728+0000", 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000263451 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.427238+0000", 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00051078300000000001 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.428446+0000", 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001207898 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429175+0000", 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072848399999999995 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429267+0000", 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2373000000000005e-05 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429337+0000", 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9936000000000003e-05 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.793947429999999, 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003253124, 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 811 2024-09-21T09:11:33.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478679+0000", 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1629999999999999e-06 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478689+0000", 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.046e-05 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478721+0000", 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1535999999999998e-05 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478736+0000", 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5494000000000001e-05 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478888+0000", 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015226500000000001 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.479263+0000", 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037449100000000002 2024-09-21T09:11:33.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.479864+0000", 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060063800000000002 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481130+0000", 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012669000000000001 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481767+0000", 2024-09-21T09:11:33.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00063663499999999998 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481856+0000", 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9376999999999995e-05 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481930+0000", 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3164999999999995e-05 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.607069919000001, 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032567009999999999, 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 889 2024-09-21T09:11:33.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665557+0000", 2024-09-21T09:11:33.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6359999999999998e-06 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665569+0000", 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2296999999999999e-05 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665602+0000", 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3433000000000003e-05 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665620+0000", 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7176e-05 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665779+0000", 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015932899999999999 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.666162+0000", 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038277999999999999 2024-09-21T09:11:33.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.666737+0000", 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057502599999999997 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668002+0000", 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001265024 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668648+0000", 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00064676200000000005 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668739+0000", 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0805999999999998e-05 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668811+0000", 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1432000000000003e-05 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.592473971, 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031261549999999998, 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 895 2024-09-21T09:11:33.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680152+0000", 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680163+0000", 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0627e-05 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680195+0000", 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2521999999999998e-05 2024-09-21T09:11:33.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680211+0000", 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5633000000000001e-05 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680393+0000", 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018196600000000001 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680627+0000", 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023373099999999999 2024-09-21T09:11:33.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680971+0000", 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034410099999999998 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.682191+0000", 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012203940000000001 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683114+0000", 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092252999999999996 2024-09-21T09:11:33.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683209+0000", 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5651999999999998e-05 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683276+0000", 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6855999999999998e-05 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:33.395 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:33.395 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:33.396 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:11:33.396 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:33.392+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:33.497 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:33.496+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:33.518 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:33.518 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:33.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:11:33.598 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:33.595+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:33.699 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:33.696+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:33.699 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:33.699 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:33.712 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:11:33.801 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:33.800+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:33.887 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.002570877, 2024-09-21T09:11:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.005197709, 2024-09-21T09:11:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 46 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883306+0000", 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8680000000000001e-06 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883320+0000", 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3777e-05 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883355+0000", 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5457000000000003e-05 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883381+0000", 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5548e-05 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883631+0000", 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025032199999999998 2024-09-21T09:11:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883924+0000", 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029322899999999999 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.884247+0000", 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032292300000000003 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.885849+0000", 2024-09-21T09:11:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016019459999999999 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888259+0000", 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024100409999999999 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888397+0000", 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013753600000000001 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888500+0000", 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103062 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113020240896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.996898725000001, 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058707430000000003, 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 47 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888977+0000", 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888990+0000", 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.33e-05 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889036+0000", 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6328000000000001e-05 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889059+0000", 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3048e-05 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889882+0000", 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082253800000000005 2024-09-21T09:11:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890147+0000", 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026500299999999998 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890549+0000", 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000402323 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.893575+0000", 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030257690000000002 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894522+0000", 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094709000000000004 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894675+0000", 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015305599999999999 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894845+0000", 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016973100000000001 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.886073374999999, 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035327039999999998, 2024-09-21T09:11:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 191 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999801+0000", 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999812+0000", 2024-09-21T09:11:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0183000000000001e-05 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999843+0000", 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1553000000000001e-05 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999858+0000", 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4907e-05 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000009+0000", 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000150786 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000333+0000", 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032434100000000002 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000821+0000", 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048796000000000001 2024-09-21T09:11:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.002625+0000", 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001803802 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003193+0000", 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056811000000000003 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003267+0000", 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3980000000000007e-05 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003332+0000", 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5022000000000002e-05 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T09:11:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.020588591999999, 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039222459999999999, 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 205 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865287+0000", 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3000000000000002e-06 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865304+0000", 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6269999999999998e-05 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865349+0000", 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5652999999999998e-05 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865370+0000", 2024-09-21T09:11:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1117000000000001e-05 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865572+0000", 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020120199999999999 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865819+0000", 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024759800000000002 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.866195+0000", 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000375557 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.867603+0000", 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001407967 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.868927+0000", 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013238410000000001 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869095+0000", 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016838899999999999 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869206+0000", 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111352 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.992155824000001, 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031054379999999999, 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 209 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893719+0000", 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3599999999999999e-06 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893731+0000", 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.222e-05 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893765+0000", 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3782999999999998e-05 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893781+0000", 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:11:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893906+0000", 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012485299999999999 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894129+0000", 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022317800000000001 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894535+0000", 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040575399999999998 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.895977+0000", 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014418199999999999 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896619+0000", 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064255900000000001 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896704+0000", 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4653000000000004e-05 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896822+0000", 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118285 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.976813709999998, 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037831409999999998, 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 213 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909062+0000", 2024-09-21T09:11:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0400000000000001e-06 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909075+0000", 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3094e-05 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909106+0000", 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0426e-05 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909121+0000", 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5903e-05 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909280+0000", 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000158772 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909665+0000", 2024-09-21T09:11:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038435800000000001 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.910380+0000", 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071585799999999999 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912186+0000", 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018052649999999999 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912661+0000", 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047496399999999997 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912752+0000", 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1445000000000003e-05 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912842+0000", 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0016e-05 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.962570648, 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576779, 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 215 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923305+0000", 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5639999999999999e-06 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923317+0000", 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1956e-05 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923349+0000", 2024-09-21T09:11:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2706999999999997e-05 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923366+0000", 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6552999999999999e-05 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923539+0000", 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017352200000000001 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923939+0000", 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000399334 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.924459+0000", 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052057299999999998 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.925959+0000", 2024-09-21T09:11:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001499703 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926718+0000", 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075869800000000003 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926799+0000", 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0950000000000003e-05 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926879+0000", 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0218999999999999e-05 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.939337827999999, 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031911079999999998, 2024-09-21T09:11:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 221 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946537+0000", 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946549+0000", 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1527e-05 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946580+0000", 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1356999999999998e-05 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946597+0000", 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7093000000000001e-05 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946714+0000", 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116872 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946936+0000", 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022225500000000001 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.947359+0000", 2024-09-21T09:11:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042271099999999999 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.948825+0000", 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014661159999999999 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949560+0000", 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073491500000000005 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949644+0000", 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4147000000000006e-05 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949726+0000", 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1854999999999995e-05 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.920857411, 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030775389999999998, 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 226 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965018+0000", 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2199999999999999e-06 2024-09-21T09:11:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965029+0000", 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1436e-05 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965061+0000", 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2055999999999999e-05 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965077+0000", 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.558e-05 2024-09-21T09:11:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965200+0000", 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012353599999999999 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965442+0000", 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024218199999999999 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965830+0000", 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038740699999999999 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967527+0000", 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001696999 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967943+0000", 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041585999999999999 2024-09-21T09:11:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968028+0000", 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.53e-05 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968093+0000", 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4962999999999994e-05 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.545413779, 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029016699999999999, 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 754 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340461+0000", 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340471+0000", 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8199999999999992e-06 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340502+0000", 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1047000000000003e-05 2024-09-21T09:11:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340527+0000", 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4739000000000001e-05 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340685+0000", 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015804600000000001 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340891+0000", 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020627199999999999 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.341212+0000", 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032101500000000002 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.342549+0000", 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013375469999999999 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343214+0000", 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066447900000000005 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343299+0000", 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5154999999999994e-05 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343361+0000", 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1569999999999995e-05 2024-09-21T09:11:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:757 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.538542707000001, 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029276440000000001, 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 757 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347332+0000", 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0200000000000001e-06 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347343+0000", 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347374+0000", 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1600000000000002e-05 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347389+0000", 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.486e-05 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347509+0000", 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119815 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347727+0000", 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217956 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.348046+0000", 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031872699999999999 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.349129+0000", 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010836559999999999 2024-09-21T09:11:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350046+0000", 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091629999999999999 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350135+0000", 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9666999999999994e-05 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350258+0000", 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012226899999999999 2024-09-21T09:11:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:759 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.534710526000001, 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002979752, 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 759 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351164+0000", 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.703e-06 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351174+0000", 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0013000000000001e-05 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351205+0000", 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1189999999999998e-05 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351223+0000", 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8003e-05 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351341+0000", 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118306 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351470+0000", 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000129076 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351737+0000", 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026687199999999998 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353037+0000", 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012995509999999999 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353989+0000", 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095197900000000004 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354076+0000", 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6730000000000005e-05 2024-09-21T09:11:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354142+0000", 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6328999999999995e-05 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.507164573000001, 2024-09-21T09:11:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002900807, 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 771 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378710+0000", 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.42e-06 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378717+0000", 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4739999999999999e-06 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378740+0000", 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.268e-05 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378751+0000", 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1143e-05 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378925+0000", 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017384900000000001 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379066+0000", 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141712 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379328+0000", 2024-09-21T09:11:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026180499999999999 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.380651+0000", 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322611 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381467+0000", 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081640100000000002 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381547+0000", 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9705999999999999e-05 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381609+0000", 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2006000000000002e-05 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.301730516999999, 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029926800000000002, 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 856 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584144+0000", 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2469999999999998e-06 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584158+0000", 2024-09-21T09:11:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3519999999999999e-05 2024-09-21T09:11:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584191+0000", 2024-09-21T09:11:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2617000000000003e-05 2024-09-21T09:11:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584206+0000", 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5276000000000001e-05 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584325+0000", 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118929 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584567+0000", 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242525 2024-09-21T09:11:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584885+0000", 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031785100000000002 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.585978+0000", 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001093246 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.586991+0000", 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00101264 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587071+0000", 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9765999999999995e-05 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587135+0000", 2024-09-21T09:11:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4063e-05 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:861 6.3 6:c0550c60:::obj_delete_at_hint.0000000094:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.291303451000001, 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00331716, 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 861 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594571+0000", 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.686e-06 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594581+0000", 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8870000000000004e-06 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594612+0000", 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1433000000000002e-05 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594630+0000", 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7589999999999999e-05 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594779+0000", 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014932199999999999 2024-09-21T09:11:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595030+0000", 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025084100000000002 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595533+0000", 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050262699999999996 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.596870+0000", 2024-09-21T09:11:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013373580000000001 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597612+0000", 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074164800000000003 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597770+0000", 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015815499999999999 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597886+0000", 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116613 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.214724769, 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030306669999999999, 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 892 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671150+0000", 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.097e-06 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671161+0000", 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0499999999999999e-05 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671191+0000", 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0383e-05 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671206+0000", 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5437000000000001e-05 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671359+0000", 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152189 2024-09-21T09:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671584+0000", 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022531499999999999 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671899+0000", 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031528399999999999 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673019+0000", 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011199560000000001 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673900+0000", 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088067799999999997 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674066+0000", 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016586500000000001 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674179+0000", 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112963 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:904 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.185079043000002, 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003078852, 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 904 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700796+0000", 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1840000000000002e-06 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700807+0000", 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1049999999999999e-05 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700836+0000", 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8833e-05 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700851+0000", 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4813e-05 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700970+0000", 2024-09-21T09:11:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119456 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701187+0000", 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021738899999999999 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701519+0000", 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033143400000000003 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.702692+0000", 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011726620000000001 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703599+0000", 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090731700000000004 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703756+0000", 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015696199999999999 2024-09-21T09:11:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703873+0000", 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116752 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:906 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.181138353000001, 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031432679999999998, 2024-09-21T09:11:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 906 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704736+0000", 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7400000000000001e-06 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704746+0000", 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4499999999999993e-06 2024-09-21T09:11:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704770+0000", 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.402e-05 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704781+0000", 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1790000000000001e-05 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704909+0000", 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012782900000000001 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705162+0000", 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000253191 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705681+0000", 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051818999999999997 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707026+0000", 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013454840000000001 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707720+0000", 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069363499999999995 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707803+0000", 2024-09-21T09:11:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3603000000000006e-05 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707878+0000", 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4336000000000001e-05 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:919 6.5 6:a1987d85:::obj_delete_at_hint.0000000114:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.148798236000001, 2024-09-21T09:11:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003079816, 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 919 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737077+0000", 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2699999999999999e-06 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737091+0000", 2024-09-21T09:11:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3825999999999999e-05 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737121+0000", 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.046e-05 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737138+0000", 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6793999999999999e-05 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737252+0000", 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114552 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737522+0000", 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026934799999999998 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737855+0000", 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033290799999999998 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.739016+0000", 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011608949999999999 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740004+0000", 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098829699999999996 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740090+0000", 2024-09-21T09:11:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6645999999999997e-05 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740154+0000", 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3819999999999995e-05 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.091798762, 2024-09-21T09:11:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003307838, 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 943 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794076+0000", 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.804e-06 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794085+0000", 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5859999999999994e-06 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794113+0000", 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8056999999999999e-05 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794128+0000", 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4382999999999999e-05 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794276+0000", 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000148286 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794649+0000", 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037297399999999998 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.795219+0000", 2024-09-21T09:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056944899999999998 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.796426+0000", 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012075390000000001 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797214+0000", 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078828100000000005 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797295+0000", 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0289000000000003e-05 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797382+0000", 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7189999999999997e-05 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.053 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:34.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:11:34.055 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:34.052+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:34.080 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T09:11:34.156 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:34.155+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:34.220 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:34.220 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:34.233 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:11:34.282 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:34.280+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:34.345 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:34.346 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:34.346 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:34.346 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:34.346 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:34.358 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:34.356+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:34.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:11:34.459 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:34.459+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:34.517 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:34.517 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:34.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:34.517 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:34.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.517 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.517 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:34.517 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.615515811000002, 2024-09-21T09:11:34.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011873984000000001, 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 87 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898151+0000", 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9599999999999999e-07 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898264+0000", 2024-09-21T09:11:34.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112509 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898277+0000", 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.38e-05 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898286+0000", 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7299999999999994e-06 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906279+0000", 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079924090000000007 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906410+0000", 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013102900000000001 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906618+0000", 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020801500000000001 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909645+0000", 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030275329999999998 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909823+0000", 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017825499999999999 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909906+0000", 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2688999999999994e-05 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910024+0000", 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118319 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.615363768999998, 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01257903, 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.523 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 88 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.569999999999999e-07 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898310+0000", 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0360000000000003e-06 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898320+0000", 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0373999999999999e-05 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898327+0000", 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1960000000000002e-06 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908138+0000", 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.009810849 2024-09-21T09:11:34.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908334+0000", 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000196059 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908540+0000", 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000205775 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910074+0000", 2024-09-21T09:11:34.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001534363 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910609+0000", 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053462599999999996 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910764+0000", 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015484599999999999 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910882+0000", 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011794900000000001 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.439046564999998, 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012244817999999999, 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.529 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 110 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:34.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7100000000000002e-07 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074625+0000", 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3939999999999998e-06 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074676+0000", 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1369999999999998e-05 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074681+0000", 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7690000000000004e-06 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079388+0000", 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047075550000000004 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079454+0000", 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5639e-05 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079548+0000", 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4299e-05 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081984+0000", 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024359239999999999 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086803+0000", 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048185880000000004 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086835+0000", 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2487999999999998e-05 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086865+0000", 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9320999999999999e-05 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.534 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.438975210000002, 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012339861000000001, 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.535 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 111 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5900000000000003e-07 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074695+0000", 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4410000000000002e-06 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074707+0000", 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2376e-05 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074711+0000", 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9879999999999998e-06 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079878+0000", 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051667869999999999 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080012+0000", 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013358700000000001 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080288+0000", 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027684299999999998 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081987+0000", 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016981450000000001 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086920+0000", 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049329780000000002 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086966+0000", 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6718999999999998e-05 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.087031+0000", 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4638e-05 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:34.540 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.438944159999998, 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013449694999999999, 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 112 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:34.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5699999999999998e-07 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074789+0000", 2024-09-21T09:11:34.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6396000000000006e-05 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074796+0000", 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0190000000000001e-06 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074802+0000", 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9290000000000003e-06 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080677+0000", 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058755839999999997 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080739+0000", 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1866999999999996e-05 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080833+0000", 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3572000000000005e-05 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083415+0000", 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025824870000000001 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088053+0000", 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004637426 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088105+0000", 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1993000000000002e-05 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088172+0000", 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7064999999999996e-05 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.438856061999999, 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013475117999999999, 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.546 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 113 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074811+0000", 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6800000000000001e-07 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074814+0000", 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9919999999999999e-06 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074820+0000", 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5060000000000001e-06 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074823+0000", 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3289999999999998e-06 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081613+0000", 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006789331 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081666+0000", 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3482000000000001e-05 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081745+0000", 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8454999999999993e-05 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083786+0000", 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020410850000000002 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088227+0000", 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044407819999999999 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088260+0000", 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3321000000000002e-05 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088285+0000", 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5466999999999999e-05 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.551 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.438745462, 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013454595, 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 114 2024-09-21T09:11:34.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074922+0000", 2024-09-21T09:11:34.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7100000000000001e-07 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074925+0000", 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8060000000000001e-06 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074933+0000", 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7929999999999998e-06 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074937+0000", 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.749e-06 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082054+0000", 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071175259999999999 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082199+0000", 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014503199999999999 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082445+0000", 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245331 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083789+0000", 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001343943 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088319+0000", 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045298530000000004 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088350+0000", 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1408000000000002e-05 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088375+0000", 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5483e-05 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.557 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.438468104000002, 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013331543, 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 115 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075199+0000", 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1699999999999998e-07 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075281+0000", 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2151999999999995e-05 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075291+0000", 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0495e-05 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075298+0000", 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8920000000000003e-06 2024-09-21T09:11:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082855+0000", 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075570790000000004 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082909+0000", 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3106000000000003e-05 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082988+0000", 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9515e-05 2024-09-21T09:11:34.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085228+0000", 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002239736 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088425+0000", 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003197044 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088470+0000", 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5281000000000002e-05 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088530+0000", 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9626000000000001e-05 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.438356605999999, 2024-09-21T09:11:34.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013307090000000001, 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 116 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.27e-07 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075314+0000", 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4249999999999998e-06 2024-09-21T09:11:34.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075318+0000", 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7829999999999998e-06 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075321+0000", 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1370000000000002e-06 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083883+0000", 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0085611369999999999 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083976+0000", 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3492000000000005e-05 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084091+0000", 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114993 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085233+0000", 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011417409999999999 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088565+0000", 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003332532 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088595+0000", 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9675e-05 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088617+0000", 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1747999999999999e-05 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.438339394000003, 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013638091, 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.569 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 117 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.53e-07 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075330+0000", 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.281e-06 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075336+0000", 2024-09-21T09:11:34.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7339999999999996e-06 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075340+0000", 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4010000000000001e-06 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084504+0000", 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091640230000000003 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084560+0000", 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6595000000000003e-05 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084644+0000", 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3326999999999997e-05 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085387+0000", 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074348199999999995 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088913+0000", 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003525855 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088944+0000", 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1621000000000001e-05 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088965+0000", 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0519000000000001e-05 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.574 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:132 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.929455544, 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013217052999999999, 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.575 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 132 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584212+0000", 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7700000000000003e-07 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584218+0000", 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584229+0000", 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1046000000000001e-05 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584237+0000", 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0800000000000006e-06 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590506+0000", 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062689440000000003 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590742+0000", 2024-09-21T09:11:34.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023612500000000001 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.591121+0000", 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037905099999999999 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593798+0000", 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026770079999999998 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597134+0000", 2024-09-21T09:11:34.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033363009999999999 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597279+0000", 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144945 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597428+0000", 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014840599999999999 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.929284438000003, 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013710092, 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 133 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584383+0000", 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1960000000000001e-06 2024-09-21T09:11:34.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584391+0000", 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7239999999999992e-06 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584407+0000", 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6138999999999999e-05 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584416+0000", 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5540000000000003e-06 2024-09-21T09:11:34.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592608+0000", 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081912370000000005 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592746+0000", 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138512 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592970+0000", 2024-09-21T09:11:34.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022379600000000001 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597628+0000", 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046579669999999998 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597829+0000", 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020085599999999999 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597967+0000", 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013828899999999999 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598092+0000", 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012482199999999999 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:34.586 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.929232522, 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013969944, 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 134 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:34.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1699999999999997e-07 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584594+0000", 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015906899999999999 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584608+0000", 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.417e-05 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584617+0000", 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2960000000000004e-06 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593907+0000", 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0092901630000000006 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594043+0000", 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013558600000000001 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594285+0000", 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024269499999999999 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597788+0000", 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035024119999999999 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598121+0000", 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033284100000000001 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598256+0000", 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000134816 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598404+0000", 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014817899999999999 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.929031369999997, 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015773928, 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 135 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584636+0000", 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8700000000000004e-07 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584642+0000", 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2099999999999998e-06 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584653+0000", 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536e-05 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584660+0000", 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.627e-06 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595480+0000", 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010820214999999999 2024-09-21T09:11:34.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595726+0000", 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245682 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.596110+0000", 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038419799999999998 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600117+0000", 2024-09-21T09:11:34.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004006618 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600255+0000", 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013840599999999999 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600346+0000", 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0666000000000002e-05 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600409+0000", 2024-09-21T09:11:34.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2883000000000001e-05 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.928993607000002, 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020097924999999999, 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.598 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 136 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000004e-07 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584679+0000", 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6069999999999998e-06 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584694+0000", 2024-09-21T09:11:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4579999999999999e-05 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584702+0000", 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0730000000000005e-06 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598512+0000", 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013810578 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598748+0000", 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000236176 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.599125+0000", 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037634399999999997 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604492+0000", 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053673560000000002 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604613+0000", 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121039 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604703+0000", 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0399e-05 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604771+0000", 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7119999999999994e-05 2024-09-21T09:11:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.928952131000003, 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020579828000000001, 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 137 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584715+0000", 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000005e-07 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584888+0000", 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000173456 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584903+0000", 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.487e-05 2024-09-21T09:11:34.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584913+0000", 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9899999999999992e-06 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600531+0000", 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015617987999999999 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600765+0000", 2024-09-21T09:11:34.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023383900000000001 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.601148+0000", 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038257100000000001 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604980+0000", 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003832326 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605028+0000", 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8059999999999997e-05 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605166+0000", 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000137959 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605294+0000", 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012808200000000001 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.609 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.928730389000002, 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024357648999999999, 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 138 2024-09-21T09:11:34.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584937+0000", 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.54e-07 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584943+0000", 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6229999999999999e-06 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584959+0000", 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5489999999999999e-05 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584968+0000", 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.516e-06 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.602849+0000", 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017880314000000001 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603120+0000", 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027100799999999999 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603521+0000", 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040112399999999999 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.608899+0000", 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053779300000000004 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609024+0000", 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125699 2024-09-21T09:11:34.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609140+0000", 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115982 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609294+0000", 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015310899999999999 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.928682649000002, 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024897698999999999, 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 139 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.616 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7999999999999995e-07 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584997+0000", 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2556e-05 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585013+0000", 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5800000000000001e-05 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585021+0000", 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3340000000000002e-06 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605435+0000", 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020414299 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605604+0000", 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000168615 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605803+0000", 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199256 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609392+0000", 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035888719999999999 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609598+0000", 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020643500000000001 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609747+0000", 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014889600000000001 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609881+0000", 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013395599999999999 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.621 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.928629712999999, 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025121831000000001, 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 140 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5400000000000001e-07 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585185+0000", 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014761900000000001 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585199+0000", 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4450000000000001e-05 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585209+0000", 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2099999999999999e-06 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606615+0000", 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021406261999999999 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606858+0000", 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024295499999999999 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.607232+0000", 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037427700000000001 2024-09-21T09:11:34.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609554+0000", 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023222210000000002 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609917+0000", 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036226800000000001 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610051+0000", 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013447599999999999 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610158+0000", 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107439 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.928441261000003, 2024-09-21T09:11:34.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.027901532, 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 141 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585226+0000", 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5999999999999991e-07 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585238+0000", 2024-09-21T09:11:34.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1717e-05 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585248+0000", 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0776e-05 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585256+0000", 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8140000000000001e-06 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:34.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610278+0000", 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025021297000000001 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610421+0000", 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014358900000000001 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610631+0000", 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021016900000000001 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:34.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612016+0000", 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001385037 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612841+0000", 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082419399999999999 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612997+0000", 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000156186 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:34.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:34.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.613127+0000", 2024-09-21T09:11:34.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012979300000000001 2024-09-21T09:11:34.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.633 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:34.633 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:34.633 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:34.633 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:11:34.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:11:34.635 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:34.632+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:34.735 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:34.735+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:34.794 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:34.794 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:34.794 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:34.794 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:34.808 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:11:34.814 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:34.814 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:34.833 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:34.833 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:34.836 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:34.835+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:34.850 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:34.850 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:34.869 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:34.900 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:34.900 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:34.923 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:34.923 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:34.926 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:34.926 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:34.937 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:34.936+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:34.940 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:11:34.943 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:34.943 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:34.965 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:35.038 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:35.039+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:35.060 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:35.060 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:35.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:11:35.094 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-09-21T09:11:35.138 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:35.139+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:35.192 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:35.192 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:35.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:11:35.240 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:35.239+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:35.323 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:35.323 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:35.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:11:35.340 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:35.336+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:35.441 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:35.440+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:35.455 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:35.455 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:35.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:11:35.542 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:35.540+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:35.603 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:35.603 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:35.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:11:35.663 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:35.663+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:35.742 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:35.742 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:35.744 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:35.743+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:35.756 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:11:35.845 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:35.843+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:35.917 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:35.917 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:35.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:11:35.946 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:35.944+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:36.047 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:36.044+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:36.104 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:36.104 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:36.118 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:11:36.166 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:36.167+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:36.246 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:36.246 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:36.249 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:36.248+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:36.261 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:11:36.349 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:36.347+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:36.430 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:36.430 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:36.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:11:36.449 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:36.448+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:36.550 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:36.551+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:36.611 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:36.611 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:36.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:11:36.651 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:36.648+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:36.752 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:36.748+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:36.795 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:36.795 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:36.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:11:36.853 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:36.852+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:36.935 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:36.935 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:36.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:11:36.954 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:36.952+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:36.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:11:37.054 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:37.055+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:37.073 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:37.074 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:37.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:11:37.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T09:11:37.128 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:37.128 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:37.146 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:37.155 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:37.152+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:37.163 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:37.163 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:37.180 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:37.215 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:37.215 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:37.235 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:37.235 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:37.256 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:37.255+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:37.260 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:37.261 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:37.261 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:37.261 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:37.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:11:37.281 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:37.357 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:37.356+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:37.450 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.440807886999998, 2024-09-21T09:11:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003218832, 2024-09-21T09:11:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 193 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006550+0000", 2024-09-21T09:11:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006552+0000", 2024-09-21T09:11:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0430000000000002e-06 2024-09-21T09:11:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006564+0000", 2024-09-21T09:11:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1416999999999999e-05 2024-09-21T09:11:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006596+0000", 2024-09-21T09:11:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1899000000000001e-05 2024-09-21T09:11:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006611+0000", 2024-09-21T09:11:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5452999999999999e-05 2024-09-21T09:11:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.006757+0000", 2024-09-21T09:11:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145816 2024-09-21T09:11:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.007003+0000", 2024-09-21T09:11:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024615500000000002 2024-09-21T09:11:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.007288+0000", 2024-09-21T09:11:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000285304 2024-09-21T09:11:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.008784+0000", 2024-09-21T09:11:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001495449 2024-09-21T09:11:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009620+0000", 2024-09-21T09:11:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00083642999999999999 2024-09-21T09:11:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009701+0000", 2024-09-21T09:11:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0653000000000002e-05 2024-09-21T09:11:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:05.009769+0000", 2024-09-21T09:11:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8213000000000006e-05 2024-09-21T09:11:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.561040468000002, 2024-09-21T09:11:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091541390000000004, 2024-09-21T09:11:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 208 2024-09-21T09:11:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886318+0000", 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886321+0000", 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3500000000000001e-06 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886355+0000", 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3986000000000003e-05 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886391+0000", 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5947e-05 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886412+0000", 2024-09-21T09:11:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1022999999999998e-05 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886600+0000", 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018761200000000001 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.886611+0000", 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1759999999999999e-05 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.891318+0000", 2024-09-21T09:11:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004706689 2024-09-21T09:11:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.891698+0000", 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000380174 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.892508+0000", 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00080938400000000001 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.893820+0000", 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013127830000000001 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895296+0000", 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014755289999999999 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895394+0000", 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8226000000000004e-05 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.895472+0000", 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7676000000000006e-05 2024-09-21T09:11:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.518092693, 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035744320000000002, 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 216 2024-09-21T09:11:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929265+0000", 2024-09-21T09:11:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929268+0000", 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8229999999999999e-06 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929279+0000", 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1194e-05 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929312+0000", 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2991999999999999e-05 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929328+0000", 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5733999999999999e-05 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929487+0000", 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158579 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.929719+0000", 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000232351 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.930129+0000", 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000409687 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.931616+0000", 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014871109999999999 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932688+0000", 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010723359999999999 2024-09-21T09:11:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932774+0000", 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5688999999999999e-05 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.932840+0000", 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5936e-05 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.510132334000001, 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035738390000000001, 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 218 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937226+0000", 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937228+0000", 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1069999999999999e-06 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937238+0000", 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0349e-05 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937270+0000", 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1690000000000003e-05 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937285+0000", 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5167000000000001e-05 2024-09-21T09:11:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937408+0000", 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000122519 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.937628+0000", 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022077800000000001 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.938055+0000", 2024-09-21T09:11:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042683700000000001 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.939639+0000", 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015836540000000001 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940641+0000", 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001002246 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940735+0000", 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3725000000000001e-05 2024-09-21T09:11:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.940800+0000", 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4766999999999998e-05 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.506179544999998, 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034600199999999998, 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 219 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941179+0000", 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941181+0000", 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1399999999999998e-06 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941191+0000", 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0257e-05 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941224+0000", 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2786000000000001e-05 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941247+0000", 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.336e-05 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941345+0000", 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7769000000000005e-05 2024-09-21T09:11:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.941556+0000", 2024-09-21T09:11:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021123499999999999 2024-09-21T09:11:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.942003+0000", 2024-09-21T09:11:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044704 2024-09-21T09:11:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.943418+0000", 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014148019999999999 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944488+0000", 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001070192 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944576+0000", 2024-09-21T09:11:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7355999999999995e-05 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.944639+0000", 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3083000000000006e-05 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.487358694000001, 2024-09-21T09:11:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033829009999999998, 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 224 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.959999+0000", 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960001+0000", 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0329999999999998e-06 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960012+0000", 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0437e-05 2024-09-21T09:11:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960045+0000", 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2676999999999999e-05 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960068+0000", 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2935999999999999e-05 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960194+0000", 2024-09-21T09:11:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012679600000000001 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960446+0000", 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025164099999999998 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.960917+0000", 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047095600000000002 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.962230+0000", 2024-09-21T09:11:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013132669999999999 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963231+0000", 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010005599999999999 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963321+0000", 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9825000000000001e-05 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.963382+0000", 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1773000000000006e-05 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.448769891000001, 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033658070000000002, 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 235 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998588+0000", 2024-09-21T09:11:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998590+0000", 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2299999999999998e-06 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998601+0000", 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0959e-05 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998635+0000", 2024-09-21T09:11:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3420000000000002e-05 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998658+0000", 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3159999999999998e-05 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.998781+0000", 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012267199999999999 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.999025+0000", 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000243892 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.999452+0000", 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042783699999999998 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.000893+0000", 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001440275 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001739+0000", 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00084627300000000003 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001834+0000", 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4826000000000003e-05 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.001954+0000", 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120263 2024-09-21T09:11:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:263 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.435080559999999, 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034424360000000001, 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 263 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012278+0000", 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012280+0000", 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1799999999999999e-06 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012292+0000", 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1763000000000001e-05 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012326+0000", 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4493000000000003e-05 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012343+0000", 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6813e-05 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012527+0000", 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018387899999999999 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012699+0000", 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017209500000000001 2024-09-21T09:11:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013267+0000", 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056834500000000005 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014605+0000", 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013380899999999999 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015459+0000", 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00085365300000000001 2024-09-21T09:11:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015612+0000", 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015307600000000001 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015720+0000", 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010804899999999999 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:297 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.427207631000002, 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033597840000000002, 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 297 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020150+0000", 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020152+0000", 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020162+0000", 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7829999999999993e-06 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020193+0000", 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1102999999999997e-05 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020214+0000", 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0486999999999999e-05 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020390+0000", 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176369 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020603+0000", 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021285100000000001 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.020873+0000", 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026986799999999999 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.022546+0000", 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016730440000000001 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023289+0000", 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074325699999999999 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023412+0000", 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012286900000000001 2024-09-21T09:11:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.023510+0000", 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8152999999999994e-05 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:373 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.404276952, 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032496819999999998, 2024-09-21T09:11:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 373 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043081+0000", 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043083+0000", 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3999999999999999e-06 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043110+0000", 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7370000000000001e-05 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043128+0000", 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8320000000000001e-05 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043139+0000", 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0763e-05 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043748+0000", 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060880199999999998 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.043963+0000", 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000215198 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.044316+0000", 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284100000000001 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045592+0000", 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001275921 2024-09-21T09:11:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046080+0000", 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048865200000000001 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046216+0000", 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013579600000000001 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.046331+0000", 2024-09-21T09:11:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011461899999999999 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:446 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.377655701999998, 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033921149999999998, 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 446 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069702+0000", 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069704+0000", 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7090000000000001e-06 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069713+0000", 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1630000000000002e-06 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069742+0000", 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8739999999999999e-05 2024-09-21T09:11:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069754+0000", 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2271e-05 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.069885+0000", 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013067999999999999 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.070151+0000", 2024-09-21T09:11:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026643499999999998 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.070748+0000", 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059699500000000001 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.072288+0000", 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015399249999999999 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.072942+0000", 2024-09-21T09:11:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00065338199999999999 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.073033+0000", 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0826000000000001e-05 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.073095+0000", 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1989000000000006e-05 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:452 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.373346720000001, 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031754840000000001, 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 452 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074011+0000", 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074013+0000", 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.331e-06 2024-09-21T09:11:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074022+0000", 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1570000000000006e-06 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074046+0000", 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.374e-05 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074063+0000", 2024-09-21T09:11:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074172+0000", 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010967300000000001 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074309+0000", 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136489 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.074654+0000", 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034524499999999999 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.076228+0000", 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015737209999999999 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077038+0000", 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00081049799999999999 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077121+0000", 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2402000000000002e-05 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.077187+0000", 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6070999999999998e-05 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:493 6.13 6:cd178ae0:reshard::reshard.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.356180538, 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038520270000000001, 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 493 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091178+0000", 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091180+0000", 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.294e-06 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091202+0000", 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2039999999999999e-05 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091231+0000", 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8756999999999999e-05 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091246+0000", 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.49e-05 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091382+0000", 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136193 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091606+0000", 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022468499999999999 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.091931+0000", 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000324171 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.093225+0000", 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012946329999999999 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.094882+0000", 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016571750000000001 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.094957+0000", 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4991000000000001e-05 2024-09-21T09:11:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.095030+0000", 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2187999999999994e-05 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:501 6.13 6:cd178ae0:reshard::reshard.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.351202022999999, 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003138456, 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 501 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096156+0000", 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096158+0000", 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9999999999999999e-06 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096168+0000", 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0052e-05 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096191+0000", 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2965000000000001e-05 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096211+0000", 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0040000000000001e-05 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096403+0000", 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019186299999999999 2024-09-21T09:11:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096630+0000", 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022718200000000001 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.096990+0000", 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035963 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.098287+0000", 2024-09-21T09:11:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012970600000000001 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099072+0000", 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00078496299999999996 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099197+0000", 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012550699999999999 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.099295+0000", 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7194000000000005e-05 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:565 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.315074616, 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045932120000000002, 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 565 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132284+0000", 2024-09-21T09:11:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132287+0000", 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2320000000000001e-06 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132300+0000", 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2782999999999999e-05 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132337+0000", 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7036000000000003e-05 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132373+0000", 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6000000000000001e-05 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132537+0000", 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016473700000000001 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.132788+0000", 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025062400000000002 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.133316+0000", 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052850300000000005 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134573+0000", 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012568449999999999 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136729+0000", 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021554590000000002 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136810+0000", 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1236000000000006e-05 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.136877+0000", 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6756999999999998e-05 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:580 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.299817036, 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031517770000000001, 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 580 2024-09-21T09:11:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147541+0000", 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147543+0000", 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6479999999999999e-06 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147552+0000", 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1400000000000006e-06 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147578+0000", 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5680000000000001e-05 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147591+0000", 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3077e-05 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.147726+0000", 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013512600000000001 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.148022+0000", 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029581200000000001 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.148500+0000", 2024-09-21T09:11:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047833400000000002 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.149801+0000", 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001301024 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150536+0000", 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073525399999999996 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150638+0000", 2024-09-21T09:11:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010145300000000001 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.150693+0000", 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5229000000000003e-05 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.021101792, 2024-09-21T09:11:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030807830000000001, 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 789 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426256+0000", 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426258+0000", 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426269+0000", 2024-09-21T09:11:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0366999999999999e-05 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426300+0000", 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1646000000000002e-05 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426316+0000", 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5330000000000001e-05 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426464+0000", 2024-09-21T09:11:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148455 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.426728+0000", 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000263451 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.427238+0000", 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00051078300000000001 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.428446+0000", 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001207898 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429175+0000", 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072848399999999995 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429267+0000", 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2373000000000005e-05 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.429337+0000", 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9936000000000003e-05 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.968681672999999, 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003253124, 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 811 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478676+0000", 2024-09-21T09:11:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478679+0000", 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1629999999999999e-06 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478689+0000", 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.046e-05 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478721+0000", 2024-09-21T09:11:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1535999999999998e-05 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478736+0000", 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5494000000000001e-05 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.478888+0000", 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015226500000000001 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.479263+0000", 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037449100000000002 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.479864+0000", 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060063800000000002 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481130+0000", 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012669000000000001 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481767+0000", 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00063663499999999998 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481856+0000", 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9376999999999995e-05 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.481930+0000", 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3164999999999995e-05 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.781804162, 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032567009999999999, 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 889 2024-09-21T09:11:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665554+0000", 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665557+0000", 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6359999999999998e-06 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665569+0000", 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2296999999999999e-05 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665602+0000", 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3433000000000003e-05 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665620+0000", 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7176e-05 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.665779+0000", 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015932899999999999 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.666162+0000", 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038277999999999999 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.666737+0000", 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057502599999999997 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668002+0000", 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001265024 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668648+0000", 2024-09-21T09:11:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00064676200000000005 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668739+0000", 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0805999999999998e-05 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.668811+0000", 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1432000000000003e-05 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.767208214, 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031261549999999998, 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 895 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680150+0000", 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680152+0000", 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:11:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680163+0000", 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0627e-05 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680195+0000", 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2521999999999998e-05 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680211+0000", 2024-09-21T09:11:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5633000000000001e-05 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680393+0000", 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018196600000000001 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680627+0000", 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023373099999999999 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.680971+0000", 2024-09-21T09:11:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034410099999999998 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.682191+0000", 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012203940000000001 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683114+0000", 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092252999999999996 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683209+0000", 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5651999999999998e-05 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.683276+0000", 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6855999999999998e-05 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:37.573 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:37.575 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:11:37.575 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:37.572+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:37.675 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:37.672+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:37.697 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:37.697 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:37.697 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:37.697 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:37.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:11:37.797 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:37.796+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:37.867 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:37.867 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:37.867 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:37.867 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:37.867 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:37.876 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:37.872+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:37.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:11:37.977 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:37.975+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:38.056 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:38.056 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:38.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:38.056 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:38.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.056 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:38.056 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:38.056 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.169586596999999, 2024-09-21T09:11:38.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.005197709, 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 46 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:38.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883306+0000", 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8680000000000001e-06 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883320+0000", 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3777e-05 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883355+0000", 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5457000000000003e-05 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883381+0000", 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5548e-05 2024-09-21T09:11:38.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883631+0000", 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025032199999999998 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883924+0000", 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029322899999999999 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.884247+0000", 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032292300000000003 2024-09-21T09:11:38.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.885849+0000", 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016019459999999999 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888259+0000", 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024100409999999999 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888397+0000", 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013753600000000001 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888500+0000", 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103062 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113020240896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:38.062 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.163914445000003, 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058707430000000003, 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 47 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:38.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888977+0000", 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888990+0000", 2024-09-21T09:11:38.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.33e-05 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889036+0000", 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6328000000000001e-05 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889059+0000", 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3048e-05 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889882+0000", 2024-09-21T09:11:38.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082253800000000005 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890147+0000", 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026500299999999998 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890549+0000", 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000402323 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.893575+0000", 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030257690000000002 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894522+0000", 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094709000000000004 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894675+0000", 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015305599999999999 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894845+0000", 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016973100000000001 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.053089094999997, 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035327039999999998, 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 191 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999801+0000", 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999812+0000", 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0183000000000001e-05 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999843+0000", 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1553000000000001e-05 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999858+0000", 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4907e-05 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000009+0000", 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000150786 2024-09-21T09:11:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000333+0000", 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032434100000000002 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000821+0000", 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048796000000000001 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.002625+0000", 2024-09-21T09:11:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001803802 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003193+0000", 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056811000000000003 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003267+0000", 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3980000000000007e-05 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003332+0000", 2024-09-21T09:11:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5022000000000002e-05 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.187604312000001, 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039222459999999999, 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 205 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865287+0000", 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3000000000000002e-06 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865304+0000", 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6269999999999998e-05 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865349+0000", 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5652999999999998e-05 2024-09-21T09:11:38.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865370+0000", 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1117000000000001e-05 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865572+0000", 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020120199999999999 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865819+0000", 2024-09-21T09:11:38.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024759800000000002 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.866195+0000", 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000375557 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.867603+0000", 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001407967 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.868927+0000", 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013238410000000001 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869095+0000", 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016838899999999999 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869206+0000", 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111352 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.159171543999999, 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031054379999999999, 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 209 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893719+0000", 2024-09-21T09:11:38.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3599999999999999e-06 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893731+0000", 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.222e-05 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893765+0000", 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3782999999999998e-05 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893781+0000", 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893906+0000", 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012485299999999999 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894129+0000", 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022317800000000001 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894535+0000", 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040575399999999998 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.895977+0000", 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014418199999999999 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896619+0000", 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064255900000000001 2024-09-21T09:11:38.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896704+0000", 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4653000000000004e-05 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896822+0000", 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118285 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.085 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.14382943, 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037831409999999998, 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 213 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909062+0000", 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0400000000000001e-06 2024-09-21T09:11:38.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909075+0000", 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3094e-05 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909106+0000", 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0426e-05 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909121+0000", 2024-09-21T09:11:38.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5903e-05 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909280+0000", 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000158772 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909665+0000", 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038435800000000001 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.910380+0000", 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071585799999999999 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912186+0000", 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018052649999999999 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912661+0000", 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047496399999999997 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912752+0000", 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1445000000000003e-05 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912842+0000", 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0016e-05 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.091 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.129586367999998, 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576779, 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 215 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923305+0000", 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5639999999999999e-06 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923317+0000", 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1956e-05 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923349+0000", 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2706999999999997e-05 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923366+0000", 2024-09-21T09:11:38.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6552999999999999e-05 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923539+0000", 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017352200000000001 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923939+0000", 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000399334 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.924459+0000", 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052057299999999998 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.925959+0000", 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001499703 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926718+0000", 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075869800000000003 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926799+0000", 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0950000000000003e-05 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926879+0000", 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0218999999999999e-05 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.097 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.106353548000001, 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031911079999999998, 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 221 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946537+0000", 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946549+0000", 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1527e-05 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946580+0000", 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1356999999999998e-05 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946597+0000", 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7093000000000001e-05 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946714+0000", 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116872 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946936+0000", 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022225500000000001 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.947359+0000", 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042271099999999999 2024-09-21T09:11:38.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.948825+0000", 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014661159999999999 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949560+0000", 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073491500000000005 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949644+0000", 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4147000000000006e-05 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949726+0000", 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1854999999999995e-05 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:38.103 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.087873130999998, 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030775389999999998, 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 226 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:38.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965018+0000", 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2199999999999999e-06 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965029+0000", 2024-09-21T09:11:38.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1436e-05 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965061+0000", 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2055999999999999e-05 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965077+0000", 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.558e-05 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965200+0000", 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012353599999999999 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965442+0000", 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024218199999999999 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965830+0000", 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038740699999999999 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967527+0000", 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001696999 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967943+0000", 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041585999999999999 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968028+0000", 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.53e-05 2024-09-21T09:11:38.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968093+0000", 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4962999999999994e-05 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.712429498999999, 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029016699999999999, 2024-09-21T09:11:38.109 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 754 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340461+0000", 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340471+0000", 2024-09-21T09:11:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8199999999999992e-06 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340502+0000", 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1047000000000003e-05 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340527+0000", 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4739000000000001e-05 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340685+0000", 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015804600000000001 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340891+0000", 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020627199999999999 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.341212+0000", 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032101500000000002 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.342549+0000", 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013375469999999999 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343214+0000", 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066447900000000005 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343299+0000", 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5154999999999994e-05 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343361+0000", 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1569999999999995e-05 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:757 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.705558427, 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029276440000000001, 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 757 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347332+0000", 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0200000000000001e-06 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347343+0000", 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2024-09-21T09:11:38.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347374+0000", 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1600000000000002e-05 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347389+0000", 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.486e-05 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347509+0000", 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119815 2024-09-21T09:11:38.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347727+0000", 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217956 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.348046+0000", 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031872699999999999 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.349129+0000", 2024-09-21T09:11:38.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010836559999999999 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350046+0000", 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091629999999999999 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350135+0000", 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9666999999999994e-05 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350258+0000", 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012226899999999999 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:759 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.701726246, 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002979752, 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.121 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 759 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351164+0000", 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.703e-06 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351174+0000", 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0013000000000001e-05 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351205+0000", 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1189999999999998e-05 2024-09-21T09:11:38.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351223+0000", 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8003e-05 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351341+0000", 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118306 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351470+0000", 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000129076 2024-09-21T09:11:38.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351737+0000", 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026687199999999998 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353037+0000", 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012995509999999999 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353989+0000", 2024-09-21T09:11:38.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095197900000000004 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354076+0000", 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6730000000000005e-05 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354142+0000", 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6328999999999995e-05 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.674180292999999, 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002900807, 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 771 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.127 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378710+0000", 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.42e-06 2024-09-21T09:11:38.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378717+0000", 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4739999999999999e-06 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378740+0000", 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.268e-05 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378751+0000", 2024-09-21T09:11:38.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1143e-05 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378925+0000", 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017384900000000001 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379066+0000", 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141712 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:38.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379328+0000", 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026180499999999999 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.380651+0000", 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322611 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381467+0000", 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081640100000000002 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381547+0000", 2024-09-21T09:11:38.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9705999999999999e-05 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381609+0000", 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2006000000000002e-05 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.468746237000001, 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029926800000000002, 2024-09-21T09:11:38.132 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 856 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584144+0000", 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2469999999999998e-06 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584158+0000", 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3519999999999999e-05 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584191+0000", 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2617000000000003e-05 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584206+0000", 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5276000000000001e-05 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584325+0000", 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118929 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584567+0000", 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242525 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584885+0000", 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031785100000000002 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.585978+0000", 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001093246 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.586991+0000", 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00101264 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587071+0000", 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9765999999999995e-05 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587135+0000", 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4063e-05 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.137 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:861 6.3 6:c0550c60:::obj_delete_at_hint.0000000094:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.458319170999999, 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00331716, 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 861 2024-09-21T09:11:38.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594571+0000", 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.686e-06 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594581+0000", 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8870000000000004e-06 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594612+0000", 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1433000000000002e-05 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594630+0000", 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7589999999999999e-05 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594779+0000", 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014932199999999999 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595030+0000", 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025084100000000002 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595533+0000", 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050262699999999996 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.596870+0000", 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013373580000000001 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597612+0000", 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074164800000000003 2024-09-21T09:11:38.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597770+0000", 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015815499999999999 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597886+0000", 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116613 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.143 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.381740488999998, 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030306669999999999, 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 892 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671150+0000", 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.097e-06 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671161+0000", 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0499999999999999e-05 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671191+0000", 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0383e-05 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671206+0000", 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5437000000000001e-05 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671359+0000", 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152189 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671584+0000", 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022531499999999999 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671899+0000", 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031528399999999999 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673019+0000", 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011199560000000001 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673900+0000", 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088067799999999997 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674066+0000", 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016586500000000001 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674179+0000", 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112963 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:904 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.352094763, 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003078852, 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.149 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 904 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700796+0000", 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1840000000000002e-06 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700807+0000", 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1049999999999999e-05 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700836+0000", 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8833e-05 2024-09-21T09:11:38.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700851+0000", 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4813e-05 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700970+0000", 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119456 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701187+0000", 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021738899999999999 2024-09-21T09:11:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701519+0000", 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033143400000000003 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.702692+0000", 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011726620000000001 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703599+0000", 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090731700000000004 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703756+0000", 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015696199999999999 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703873+0000", 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116752 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:906 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.348154073, 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031432679999999998, 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 906 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704736+0000", 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7400000000000001e-06 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704746+0000", 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4499999999999993e-06 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704770+0000", 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.402e-05 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704781+0000", 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1790000000000001e-05 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704909+0000", 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012782900000000001 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705162+0000", 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000253191 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705681+0000", 2024-09-21T09:11:38.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051818999999999997 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707026+0000", 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013454840000000001 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707720+0000", 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069363499999999995 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707803+0000", 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3603000000000006e-05 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707878+0000", 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4336000000000001e-05 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:919 6.5 6:a1987d85:::obj_delete_at_hint.0000000114:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:38.160 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.315813956, 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003079816, 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 919 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737077+0000", 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2699999999999999e-06 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737091+0000", 2024-09-21T09:11:38.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3825999999999999e-05 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737121+0000", 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.046e-05 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737138+0000", 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6793999999999999e-05 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737252+0000", 2024-09-21T09:11:38.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114552 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737522+0000", 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026934799999999998 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737855+0000", 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033290799999999998 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.739016+0000", 2024-09-21T09:11:38.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011608949999999999 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740004+0000", 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098829699999999996 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740090+0000", 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6645999999999997e-05 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740154+0000", 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3819999999999995e-05 2024-09-21T09:11:38.165 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.258814481999998, 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003307838, 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:38.166 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 943 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794076+0000", 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.804e-06 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794085+0000", 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5859999999999994e-06 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794113+0000", 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8056999999999999e-05 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794128+0000", 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4382999999999999e-05 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794276+0000", 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000148286 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794649+0000", 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037297399999999998 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.795219+0000", 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056944899999999998 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.796426+0000", 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012075390000000001 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797214+0000", 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078828100000000005 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797295+0000", 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0289000000000003e-05 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797382+0000", 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7189999999999997e-05 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.171 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:38.173 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:11:38.174 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-09-21T09:11:38.174 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:38.171+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:38.273 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:38.272+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:38.346 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:38.346 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:38.346 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:38.346 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:38.365 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:11:38.374 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:38.371+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:38.474 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:38.471+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:38.529 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:38.529 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:38.529 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:38.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:11:38.589 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:38.588+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:38.676 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:38.672+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:38.678 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:38.678 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:38.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:38.679 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:38.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.679 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.679 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:38.679 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.775961686999999, 2024-09-21T09:11:38.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011873984000000001, 2024-09-21T09:11:38.680 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.680 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.680 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.680 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.680 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.681 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 87 2024-09-21T09:11:38.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.681 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:38.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:38.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898151+0000", 2024-09-21T09:11:38.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9599999999999999e-07 2024-09-21T09:11:38.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898264+0000", 2024-09-21T09:11:38.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112509 2024-09-21T09:11:38.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898277+0000", 2024-09-21T09:11:38.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.38e-05 2024-09-21T09:11:38.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898286+0000", 2024-09-21T09:11:38.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7299999999999994e-06 2024-09-21T09:11:38.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906279+0000", 2024-09-21T09:11:38.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079924090000000007 2024-09-21T09:11:38.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906410+0000", 2024-09-21T09:11:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013102900000000001 2024-09-21T09:11:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906618+0000", 2024-09-21T09:11:38.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020801500000000001 2024-09-21T09:11:38.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909645+0000", 2024-09-21T09:11:38.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030275329999999998 2024-09-21T09:11:38.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909823+0000", 2024-09-21T09:11:38.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017825499999999999 2024-09-21T09:11:38.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909906+0000", 2024-09-21T09:11:38.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2688999999999994e-05 2024-09-21T09:11:38.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910024+0000", 2024-09-21T09:11:38.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118319 2024-09-21T09:11:38.691 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.691 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.691 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.692 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.692 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:38.692 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.775809645000002, 2024-09-21T09:11:38.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01257903, 2024-09-21T09:11:38.693 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 88 2024-09-21T09:11:38.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.694 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:38.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:38.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:38.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.569999999999999e-07 2024-09-21T09:11:38.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898310+0000", 2024-09-21T09:11:38.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0360000000000003e-06 2024-09-21T09:11:38.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898320+0000", 2024-09-21T09:11:38.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0373999999999999e-05 2024-09-21T09:11:38.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898327+0000", 2024-09-21T09:11:38.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1960000000000002e-06 2024-09-21T09:11:38.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908138+0000", 2024-09-21T09:11:38.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.009810849 2024-09-21T09:11:38.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908334+0000", 2024-09-21T09:11:38.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000196059 2024-09-21T09:11:38.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908540+0000", 2024-09-21T09:11:38.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000205775 2024-09-21T09:11:38.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910074+0000", 2024-09-21T09:11:38.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001534363 2024-09-21T09:11:38.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910609+0000", 2024-09-21T09:11:38.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053462599999999996 2024-09-21T09:11:38.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910764+0000", 2024-09-21T09:11:38.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015484599999999999 2024-09-21T09:11:38.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910882+0000", 2024-09-21T09:11:38.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011794900000000001 2024-09-21T09:11:38.705 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.705 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.705 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.706 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.706 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:38.706 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.599492441000002, 2024-09-21T09:11:38.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012244817999999999, 2024-09-21T09:11:38.706 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.707 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.707 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.707 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.707 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.707 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.708 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 110 2024-09-21T09:11:38.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.708 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:38.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:38.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:38.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7100000000000002e-07 2024-09-21T09:11:38.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074625+0000", 2024-09-21T09:11:38.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3939999999999998e-06 2024-09-21T09:11:38.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074676+0000", 2024-09-21T09:11:38.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1369999999999998e-05 2024-09-21T09:11:38.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074681+0000", 2024-09-21T09:11:38.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7690000000000004e-06 2024-09-21T09:11:38.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079388+0000", 2024-09-21T09:11:38.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047075550000000004 2024-09-21T09:11:38.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079454+0000", 2024-09-21T09:11:38.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5639e-05 2024-09-21T09:11:38.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079548+0000", 2024-09-21T09:11:38.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4299e-05 2024-09-21T09:11:38.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081984+0000", 2024-09-21T09:11:38.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024359239999999999 2024-09-21T09:11:38.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086803+0000", 2024-09-21T09:11:38.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048185880000000004 2024-09-21T09:11:38.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086835+0000", 2024-09-21T09:11:38.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2487999999999998e-05 2024-09-21T09:11:38.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086865+0000", 2024-09-21T09:11:38.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9320999999999999e-05 2024-09-21T09:11:38.721 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.721 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.721 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.722 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.722 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:38.722 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.599421086, 2024-09-21T09:11:38.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012339861000000001, 2024-09-21T09:11:38.722 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.723 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.723 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.723 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.723 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 111 2024-09-21T09:11:38.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.724 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:38.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:38.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:38.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5900000000000003e-07 2024-09-21T09:11:38.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074695+0000", 2024-09-21T09:11:38.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4410000000000002e-06 2024-09-21T09:11:38.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074707+0000", 2024-09-21T09:11:38.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2376e-05 2024-09-21T09:11:38.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074711+0000", 2024-09-21T09:11:38.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9879999999999998e-06 2024-09-21T09:11:38.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079878+0000", 2024-09-21T09:11:38.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051667869999999999 2024-09-21T09:11:38.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080012+0000", 2024-09-21T09:11:38.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013358700000000001 2024-09-21T09:11:38.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080288+0000", 2024-09-21T09:11:38.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027684299999999998 2024-09-21T09:11:38.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081987+0000", 2024-09-21T09:11:38.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016981450000000001 2024-09-21T09:11:38.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086920+0000", 2024-09-21T09:11:38.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049329780000000002 2024-09-21T09:11:38.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086966+0000", 2024-09-21T09:11:38.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6718999999999998e-05 2024-09-21T09:11:38.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.087031+0000", 2024-09-21T09:11:38.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4638e-05 2024-09-21T09:11:38.733 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.733 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.734 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.734 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.734 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:38.734 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.599390036000003, 2024-09-21T09:11:38.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013449694999999999, 2024-09-21T09:11:38.735 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.736 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 112 2024-09-21T09:11:38.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.736 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:38.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5699999999999998e-07 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074789+0000", 2024-09-21T09:11:38.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6396000000000006e-05 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074796+0000", 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0190000000000001e-06 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074802+0000", 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9290000000000003e-06 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080677+0000", 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058755839999999997 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080739+0000", 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1866999999999996e-05 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080833+0000", 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3572000000000005e-05 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083415+0000", 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025824870000000001 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088053+0000", 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004637426 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088105+0000", 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1993000000000002e-05 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088172+0000", 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7064999999999996e-05 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.599301937999996, 2024-09-21T09:11:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013475117999999999, 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 113 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074811+0000", 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6800000000000001e-07 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074814+0000", 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9919999999999999e-06 2024-09-21T09:11:38.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074820+0000", 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5060000000000001e-06 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074823+0000", 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3289999999999998e-06 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081613+0000", 2024-09-21T09:11:38.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006789331 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081666+0000", 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3482000000000001e-05 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081745+0000", 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8454999999999993e-05 2024-09-21T09:11:38.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083786+0000", 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020410850000000002 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088227+0000", 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044407819999999999 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088260+0000", 2024-09-21T09:11:38.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3321000000000002e-05 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088285+0000", 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5466999999999999e-05 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.599191337999997, 2024-09-21T09:11:38.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013454595, 2024-09-21T09:11:38.748 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.748 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.748 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.748 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.748 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.748 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.748 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 114 2024-09-21T09:11:38.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.748 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074922+0000", 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7100000000000001e-07 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074925+0000", 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8060000000000001e-06 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074933+0000", 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7929999999999998e-06 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074937+0000", 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.749e-06 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082054+0000", 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071175259999999999 2024-09-21T09:11:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082199+0000", 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014503199999999999 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082445+0000", 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245331 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083789+0000", 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001343943 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088319+0000", 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045298530000000004 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088350+0000", 2024-09-21T09:11:38.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1408000000000002e-05 2024-09-21T09:11:38.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088375+0000", 2024-09-21T09:11:38.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5483e-05 2024-09-21T09:11:38.754 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.754 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.754 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.598913979999999, 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013331543, 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.755 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 115 2024-09-21T09:11:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:38.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075199+0000", 2024-09-21T09:11:38.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1699999999999998e-07 2024-09-21T09:11:38.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075281+0000", 2024-09-21T09:11:38.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2151999999999995e-05 2024-09-21T09:11:38.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075291+0000", 2024-09-21T09:11:38.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0495e-05 2024-09-21T09:11:38.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075298+0000", 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8920000000000003e-06 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082855+0000", 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075570790000000004 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082909+0000", 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3106000000000003e-05 2024-09-21T09:11:38.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082988+0000", 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9515e-05 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085228+0000", 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002239736 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088425+0000", 2024-09-21T09:11:38.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003197044 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088470+0000", 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5281000000000002e-05 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088530+0000", 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9626000000000001e-05 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.761 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.762 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.762 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:38.762 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.598802481999996, 2024-09-21T09:11:38.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013307090000000001, 2024-09-21T09:11:38.762 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.762 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 116 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.27e-07 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075314+0000", 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4249999999999998e-06 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075318+0000", 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7829999999999998e-06 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075321+0000", 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1370000000000002e-06 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083883+0000", 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0085611369999999999 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083976+0000", 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3492000000000005e-05 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084091+0000", 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114993 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085233+0000", 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011417409999999999 2024-09-21T09:11:38.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088565+0000", 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003332532 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088595+0000", 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9675e-05 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088617+0000", 2024-09-21T09:11:38.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1747999999999999e-05 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.59878527, 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013638091, 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.768 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 117 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.53e-07 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075330+0000", 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.281e-06 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075336+0000", 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7339999999999996e-06 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075340+0000", 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4010000000000001e-06 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084504+0000", 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091640230000000003 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084560+0000", 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6595000000000003e-05 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084644+0000", 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3326999999999997e-05 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085387+0000", 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074348199999999995 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088913+0000", 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003525855 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088944+0000", 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1621000000000001e-05 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088965+0000", 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0519000000000001e-05 2024-09-21T09:11:38.773 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:132 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.089901419999997, 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013217052999999999, 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.774 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 132 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584212+0000", 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7700000000000003e-07 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584218+0000", 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584229+0000", 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1046000000000001e-05 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584237+0000", 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0800000000000006e-06 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590506+0000", 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062689440000000003 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590742+0000", 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023612500000000001 2024-09-21T09:11:38.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.591121+0000", 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037905099999999999 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593798+0000", 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026770079999999998 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597134+0000", 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033363009999999999 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597279+0000", 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144945 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597428+0000", 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014840599999999999 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.089730314000001, 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013710092, 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 133 2024-09-21T09:11:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584383+0000", 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1960000000000001e-06 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584391+0000", 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7239999999999992e-06 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584407+0000", 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6138999999999999e-05 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584416+0000", 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5540000000000003e-06 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592608+0000", 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081912370000000005 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592746+0000", 2024-09-21T09:11:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138512 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592970+0000", 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022379600000000001 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597628+0000", 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046579669999999998 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597829+0000", 2024-09-21T09:11:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020085599999999999 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597967+0000", 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013828899999999999 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598092+0000", 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012482199999999999 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.089678397999997, 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013969944, 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 134 2024-09-21T09:11:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1699999999999997e-07 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584594+0000", 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015906899999999999 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584608+0000", 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.417e-05 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584617+0000", 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2960000000000004e-06 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593907+0000", 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0092901630000000006 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594043+0000", 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013558600000000001 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594285+0000", 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024269499999999999 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597788+0000", 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035024119999999999 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598121+0000", 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033284100000000001 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598256+0000", 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000134816 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598404+0000", 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014817899999999999 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.089477246000001, 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015773928, 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 135 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584636+0000", 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8700000000000004e-07 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584642+0000", 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2099999999999998e-06 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584653+0000", 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536e-05 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584660+0000", 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.627e-06 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595480+0000", 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010820214999999999 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595726+0000", 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245682 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.596110+0000", 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038419799999999998 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600117+0000", 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004006618 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600255+0000", 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013840599999999999 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600346+0000", 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0666000000000002e-05 2024-09-21T09:11:38.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600409+0000", 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2883000000000001e-05 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.089439483, 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020097924999999999, 2024-09-21T09:11:38.797 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 136 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000004e-07 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584679+0000", 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6069999999999998e-06 2024-09-21T09:11:38.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584694+0000", 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4579999999999999e-05 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584702+0000", 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0730000000000005e-06 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598512+0000", 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013810578 2024-09-21T09:11:38.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598748+0000", 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000236176 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.599125+0000", 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037634399999999997 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604492+0000", 2024-09-21T09:11:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053673560000000002 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604613+0000", 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121039 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604703+0000", 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0399e-05 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604771+0000", 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7119999999999994e-05 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.089398007, 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020579828000000001, 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 137 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584715+0000", 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000005e-07 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584888+0000", 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000173456 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584903+0000", 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.487e-05 2024-09-21T09:11:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584913+0000", 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9899999999999992e-06 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600531+0000", 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015617987999999999 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600765+0000", 2024-09-21T09:11:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023383900000000001 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.601148+0000", 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038257100000000001 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604980+0000", 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003832326 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605028+0000", 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8059999999999997e-05 2024-09-21T09:11:38.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605166+0000", 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000137959 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605294+0000", 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012808200000000001 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.089176264999999, 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024357648999999999, 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 138 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.809 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584937+0000", 2024-09-21T09:11:38.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.54e-07 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584943+0000", 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6229999999999999e-06 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584959+0000", 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5489999999999999e-05 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584968+0000", 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.516e-06 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.602849+0000", 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017880314000000001 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603120+0000", 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027100799999999999 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603521+0000", 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040112399999999999 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.608899+0000", 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053779300000000004 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609024+0000", 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125699 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609140+0000", 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115982 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609294+0000", 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015310899999999999 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.089128525, 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024897698999999999, 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 139 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7999999999999995e-07 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584997+0000", 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2556e-05 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585013+0000", 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5800000000000001e-05 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585021+0000", 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3340000000000002e-06 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605435+0000", 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020414299 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605604+0000", 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000168615 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605803+0000", 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199256 2024-09-21T09:11:38.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609392+0000", 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035888719999999999 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609598+0000", 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020643500000000001 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609747+0000", 2024-09-21T09:11:38.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014889600000000001 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609881+0000", 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013395599999999999 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.089075588999997, 2024-09-21T09:11:38.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025121831000000001, 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 140 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5400000000000001e-07 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585185+0000", 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014761900000000001 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585199+0000", 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4450000000000001e-05 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585209+0000", 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2099999999999999e-06 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606615+0000", 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021406261999999999 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606858+0000", 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024295499999999999 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.607232+0000", 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037427700000000001 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609554+0000", 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023222210000000002 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609917+0000", 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036226800000000001 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610051+0000", 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013447599999999999 2024-09-21T09:11:38.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610158+0000", 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107439 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.088887137, 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.027901532, 2024-09-21T09:11:38.826 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 141 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585226+0000", 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5999999999999991e-07 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585238+0000", 2024-09-21T09:11:38.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1717e-05 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585248+0000", 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0776e-05 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585256+0000", 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8140000000000001e-06 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610278+0000", 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025021297000000001 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610421+0000", 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014358900000000001 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610631+0000", 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021016900000000001 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612016+0000", 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001385037 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:38.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612841+0000", 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082419399999999999 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612997+0000", 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000156186 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.613127+0000", 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012979300000000001 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:38.833 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:38.833 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:38.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:11:38.834 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:38.831+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:38.935 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:38.932+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:39.002 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:39.002 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:39.002 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:39.002 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:39.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:11:39.036 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:39.035+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:39.137 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:39.135+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:39.182 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:39.182 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:39.182 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:39.182 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:39.182 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:39.195 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:11:39.241 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:39.240+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:39.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:11:39.319 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4358.0:40 5.1c 5:3fce9a59:::zonegroup_info.6661b8ba-4ecc-4129-afb2-8d0efd9659c2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.432022402000001, 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028118549999999998, 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.320 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4358", 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3756932968", 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 40 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885826+0000", 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4899999999999999e-06 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885835+0000", 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5299999999999996e-06 2024-09-21T09:11:39.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885857+0000", 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1679999999999999e-05 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885871+0000", 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4146e-05 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885969+0000", 2024-09-21T09:11:39.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8212000000000001e-05 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886181+0000", 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021209000000000001 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886450+0000", 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026841000000000001 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.887864+0000", 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001414722 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888500+0000", 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063535399999999998 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888562+0000", 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2176999999999998e-05 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888637+0000", 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5043999999999995e-05 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:214 6.1c e36/30 6:3e426232:gc::gc.9:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.396828716999998, 2024-09-21T09:11:39.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015590160000000001, 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.13e-07 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921028+0000", 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9639999999999992e-06 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921060+0000", 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1822000000000001e-05 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921076+0000", 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6252999999999998e-05 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921213+0000", 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013652299999999999 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921250+0000", 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7685999999999998e-05 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922504+0000", 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001253185 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922578+0000", 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4070000000000001e-05 2024-09-21T09:11:39.330 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.386640227000001, 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036169079999999998, 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:39.331 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 217 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931210+0000", 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6529999999999998e-06 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931223+0000", 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3667e-05 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931257+0000", 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3742999999999999e-05 2024-09-21T09:11:39.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931273+0000", 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5366000000000002e-05 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931414+0000", 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136300000000001 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931673+0000", 2024-09-21T09:11:39.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025924500000000002 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.932066+0000", 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0003927 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.933852+0000", 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017863180000000001 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934605+0000", 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075312800000000004 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934696+0000", 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0328999999999995e-05 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934824+0000", 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128396 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:229 6.1b e36/30 6:db9d130d:gc::gc.24:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.341193270000002, 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015706159999999999, 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.337 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976655+0000", 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8699999999999995e-07 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976661+0000", 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7599999999999997e-06 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976686+0000", 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4396000000000002e-05 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976699+0000", 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3336000000000001e-05 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976836+0000", 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013669299999999999 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976871+0000", 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4913000000000003e-05 2024-09-21T09:11:39.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978136+0000", 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001264851 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978225+0000", 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9179999999999997e-05 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.313461898, 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001626368, 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 237 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.342 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004389+0000", 2024-09-21T09:11:39.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5099999999999999e-06 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004408+0000", 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9154e-05 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004453+0000", 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4385999999999998e-05 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004475+0000", 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2853e-05 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004585+0000", 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000109546 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004656+0000", 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0988999999999994e-05 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004818+0000", 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016166600000000001 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005536+0000", 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071806799999999998 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005917+0000", 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038119100000000002 2024-09-21T09:11:39.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005956+0000", 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9255999999999998e-05 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.006012+0000", 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5748999999999998e-05 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:253 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.309785499, 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001548546, 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 253 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008063+0000", 2024-09-21T09:11:39.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.263e-06 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008070+0000", 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1369999999999996e-06 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008087+0000", 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6263999999999999e-05 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008096+0000", 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6670000000000008e-06 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008178+0000", 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1644999999999995e-05 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008240+0000", 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2453999999999995e-05 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008448+0000", 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020722899999999999 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009447+0000", 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099947600000000001 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009547+0000", 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100268 2024-09-21T09:11:39.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009582+0000", 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4459999999999999e-05 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009610+0000", 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8683e-05 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:709 6.1e e36/30 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.074078910000001, 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015262559999999999, 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243769+0000", 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9999999999999996e-07 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243776+0000", 2024-09-21T09:11:39.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0999999999999998e-06 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243790+0000", 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3882e-05 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243800+0000", 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0083e-05 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243943+0000", 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014281799999999999 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243990+0000", 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7157000000000003e-05 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245247+0000", 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012564200000000001 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245295+0000", 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7895999999999997e-05 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.051186901000001, 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023946290000000001, 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.358 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 721 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266663+0000", 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5289999999999998e-06 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266676+0000", 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.292e-05 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266705+0000", 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8816999999999999e-05 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266732+0000", 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7134000000000001e-05 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266844+0000", 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111848 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267038+0000", 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019389 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267357+0000", 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000319172 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268435+0000", 2024-09-21T09:11:39.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010780430000000001 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268984+0000", 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054955599999999998 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269022+0000", 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7973999999999999e-05 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269055+0000", 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2746000000000001e-05 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.048212607, 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002147342, 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 723 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269636+0000", 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4720000000000001e-06 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269645+0000", 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.32e-06 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269667+0000", 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2487999999999999e-05 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269678+0000", 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0794e-05 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269735+0000", 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269784+0000", 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8266999999999997e-05 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269905+0000", 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121012 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.270906+0000", 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00100125 2024-09-21T09:11:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271576+0000", 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066977200000000001 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271666+0000", 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9952999999999997e-05 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271782+0000", 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116469 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:775 6.1e e36/30 6:7db93595:::obj_delete_at_hint.0000000066:head v 36'5, mlcod=36'3)", 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.926400819000001, 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015332430000000001, 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.370 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391448+0000", 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7570000000000001e-06 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391462+0000", 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3256e-05 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391491+0000", 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9753000000000001e-05 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391515+0000", 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3623999999999999e-05 2024-09-21T09:11:39.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391667+0000", 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152065 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391732+0000", 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5099999999999997e-05 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392906+0000", 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011735719999999999 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392980+0000", 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4116000000000007e-05 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:778 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'4, mlcod=36'2)", 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:39.374 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.919163621999999, 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015037570000000001, 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:39.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398686+0000", 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8369999999999999e-06 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398703+0000", 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7363e-05 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398731+0000", 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8367000000000001e-05 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398745+0000", 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.385e-05 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398923+0000", 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177818 2024-09-21T09:11:39.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398963+0000", 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9867000000000003e-05 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400088+0000", 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011250380000000001 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400188+0000", 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9617000000000005e-05 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:780 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'5, mlcod=36'3)", 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.914317674999999, 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001427673, 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403531+0000", 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6729999999999999e-06 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403568+0000", 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6693000000000003e-05 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403597+0000", 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9130000000000001e-05 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403611+0000", 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3643e-05 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403781+0000", 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016968300000000001 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403820+0000", 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9768999999999998e-05 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404868+0000", 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001047493 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404957+0000", 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9588999999999999e-05 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:814 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'7, mlcod=36'5)", 2024-09-21T09:11:39.383 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.832348873000001, 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014758, 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485500+0000", 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.843e-06 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485513+0000", 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2284e-05 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485542+0000", 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9102999999999999e-05 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485555+0000", 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.375e-05 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485660+0000", 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104849 2024-09-21T09:11:39.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485719+0000", 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8842999999999999e-05 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486885+0000", 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011654250000000001 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486974+0000", 2024-09-21T09:11:39.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9703000000000005e-05 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:816 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'8, mlcod=36'6)", 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.828722634999998, 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016647159999999999, 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489127+0000", 2024-09-21T09:11:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489142+0000", 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5400000000000002e-05 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489177+0000", 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4894000000000002e-05 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489196+0000", 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8873e-05 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489355+0000", 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015918799999999999 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489424+0000", 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8572999999999996e-05 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490705+0000", 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012817079999999999 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490789+0000", 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4019999999999999e-05 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:844 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'12, mlcod=36'10)", 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.761543899999999, 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015352059999999999, 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556305+0000", 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.73e-06 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556317+0000", 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2233e-05 2024-09-21T09:11:39.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556348+0000", 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0176e-05 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556361+0000", 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3694e-05 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556511+0000", 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014973800000000001 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556567+0000", 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6273999999999997e-05 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557740+0000", 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001173065 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557839+0000", 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8295999999999995e-05 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:846 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'13, mlcod=36'11)", 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.757807109000002, 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014368810000000001, 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.397 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560042+0000", 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6500000000000001e-06 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560056+0000", 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4233000000000001e-05 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560085+0000", 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8767000000000001e-05 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560098+0000", 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3436e-05 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560242+0000", 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000143199 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560305+0000", 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3269999999999996e-05 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561354+0000", 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010487630000000001 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561477+0000", 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012356300000000001 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:39.401 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.602220726999999, 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028068680000000001, 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 910 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715630+0000", 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.92e-06 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715647+0000", 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715680+0000", 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3572999999999999e-05 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715696+0000", 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5777000000000002e-05 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715819+0000", 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000122972 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716044+0000", 2024-09-21T09:11:39.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022481500000000001 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716365+0000", 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032138400000000003 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.717426+0000", 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001061223 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:39.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718214+0000", 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078753099999999995 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718304+0000", 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0426999999999993e-05 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718434+0000", 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012908900000000001 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.407 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.598263674000002, 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031243310000000002, 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 912 2024-09-21T09:11:39.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719585+0000", 2024-09-21T09:11:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.72e-06 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719597+0000", 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1229999999999999e-05 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719621+0000", 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4073000000000001e-05 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719633+0000", 2024-09-21T09:11:39.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.259e-05 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719761+0000", 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012745599999999999 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720000+0000", 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023914800000000001 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720482+0000", 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048253400000000001 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.721627+0000", 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001145002 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722556+0000", 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092825299999999998 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722640+0000", 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4542999999999993e-05 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722708+0000", 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7781999999999996e-05 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-21T09:11:39.413 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.558109436999999, 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014824689999999999, 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759740+0000", 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7370000000000001e-06 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759752+0000", 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2483000000000001e-05 2024-09-21T09:11:39.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759782+0000", 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9553e-05 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759798+0000", 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6042999999999999e-05 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759943+0000", 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2024-09-21T09:11:39.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760001+0000", 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8777000000000003e-05 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761134+0000", 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001132922 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761220+0000", 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6044999999999994e-05 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1020 6.10 e45/30 6:0fbdcb32:usage::usage.17:head v 45'5, mlcod=36'3)", 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.278569818, 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001677574, 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:39.418 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039281+0000", 2024-09-21T09:11:39.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0939999999999999e-06 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039305+0000", 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3906000000000001e-05 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039349+0000", 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4064999999999999e-05 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039379+0000", 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9889000000000001e-05 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039517+0000", 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013895300000000001 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039574+0000", 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6162000000000002e-05 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040855+0000", 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001281821 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040955+0000", 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9684000000000003e-05 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:39.422 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:39.424 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:11:39.424 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:39.420+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:39.446 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:39.463 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:39.480 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:39.497 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:39.497 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:39.519 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:39.525 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:39.523+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:39.542 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:39.563 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:39.563 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:39.564 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:39.565 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:39.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:11:39.587 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:39.587 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:39.626 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:39.623+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:39.703 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:39.703 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:39.716 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:11:39.761 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:39.760+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:39.828 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:39.827+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:39.842 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:39.842 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:39.857 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:11:39.929 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:39.927+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:39.992 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:39.992 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:40.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:11:40.051 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:40.051+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:40.130 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:40.128+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:40.174 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T09:11:40.176 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:40.176 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:40.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:11:40.239 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:40.239+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:40.311 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:40.311 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:40.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:11:40.331 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:40.328+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:40.432 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:40.431+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:40.492 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:40.492 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:40.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:11:40.533 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:40.532+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:40.634 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:40.632+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:40.674 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:40.675 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:40.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:11:40.735 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:40.732+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:40.818 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:40.819 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:40.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:11:40.837 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:40.836+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:40.938 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:40.936+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:40.963 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:40.964 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:40.978 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:11:41.039 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:41.039+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:41.103 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:41.104 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:41.118 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:11:41.128 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-09-21T09:11:41.163 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:41.163+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:41.240 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:41.239+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:41.289 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:41.289 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:41.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:11:41.341 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:41.340+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:41.441 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:41.439+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:41.465 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:41.466 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:41.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:11:41.571 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:41.571+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:41.604 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:11:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:41.646 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:41.649 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:41.648+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:41.660 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:11:41.747 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:41.747+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:41.750 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:41.751 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:41.767 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:41.768 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:41.786 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:41.787 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:41.804 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:41.804 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:41.823 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:41.828 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:41.828 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:41.843 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:11:41.844 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:41.844 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:41.863 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:41.863 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:41.883 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:41.883 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:41.891 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:41.891+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:41.946 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:41.943+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:41.957 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:41.957 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:41.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:11:42.047 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:42.047+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:42.084 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:42.084 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:42.084 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:42.084 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:42.084 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:42.098 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:11:42.148 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:42.144+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:42.236 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.348806951, 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.005197709, 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.237 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 46 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883306+0000", 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8680000000000001e-06 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883320+0000", 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3777e-05 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883355+0000", 2024-09-21T09:11:42.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5457000000000003e-05 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883381+0000", 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5548e-05 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883631+0000", 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025032199999999998 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883924+0000", 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029322899999999999 2024-09-21T09:11:42.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.884247+0000", 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032292300000000003 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.885849+0000", 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016019459999999999 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888259+0000", 2024-09-21T09:11:42.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024100409999999999 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888397+0000", 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013753600000000001 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888500+0000", 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103062 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113020240896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.343134798999998, 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058707430000000003, 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 47 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888977+0000", 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888990+0000", 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.33e-05 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889036+0000", 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6328000000000001e-05 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889059+0000", 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3048e-05 2024-09-21T09:11:42.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889882+0000", 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082253800000000005 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890147+0000", 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026500299999999998 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890549+0000", 2024-09-21T09:11:42.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000402323 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.893575+0000", 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030257690000000002 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894522+0000", 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094709000000000004 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894675+0000", 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015305599999999999 2024-09-21T09:11:42.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894845+0000", 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016973100000000001 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.232309448999999, 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035327039999999998, 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 191 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999801+0000", 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999812+0000", 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0183000000000001e-05 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999843+0000", 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1553000000000001e-05 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999858+0000", 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4907e-05 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000009+0000", 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000150786 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000333+0000", 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032434100000000002 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000821+0000", 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048796000000000001 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.002625+0000", 2024-09-21T09:11:42.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001803802 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003193+0000", 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056811000000000003 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003267+0000", 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3980000000000007e-05 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003332+0000", 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5022000000000002e-05 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.366824665999999, 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039222459999999999, 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.254 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 205 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865287+0000", 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3000000000000002e-06 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865304+0000", 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6269999999999998e-05 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865349+0000", 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5652999999999998e-05 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865370+0000", 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1117000000000001e-05 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865572+0000", 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020120199999999999 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865819+0000", 2024-09-21T09:11:42.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024759800000000002 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.866195+0000", 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000375557 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.867603+0000", 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001407967 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.868927+0000", 2024-09-21T09:11:42.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013238410000000001 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869095+0000", 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016838899999999999 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869206+0000", 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111352 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.338391897999998, 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031054379999999999, 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 209 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893719+0000", 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3599999999999999e-06 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893731+0000", 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.222e-05 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893765+0000", 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3782999999999998e-05 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893781+0000", 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:11:42.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893906+0000", 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012485299999999999 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894129+0000", 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022317800000000001 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894535+0000", 2024-09-21T09:11:42.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040575399999999998 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.895977+0000", 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014418199999999999 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896619+0000", 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064255900000000001 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896704+0000", 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4653000000000004e-05 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896822+0000", 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118285 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.265 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.323049783999998, 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037831409999999998, 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 213 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909062+0000", 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0400000000000001e-06 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909075+0000", 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3094e-05 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909106+0000", 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0426e-05 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909121+0000", 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5903e-05 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909280+0000", 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000158772 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909665+0000", 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038435800000000001 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.910380+0000", 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071585799999999999 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912186+0000", 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018052649999999999 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912661+0000", 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047496399999999997 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912752+0000", 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1445000000000003e-05 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912842+0000", 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0016e-05 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.308806722, 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576779, 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 215 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:42.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923305+0000", 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5639999999999999e-06 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923317+0000", 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1956e-05 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923349+0000", 2024-09-21T09:11:42.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2706999999999997e-05 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923366+0000", 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6552999999999999e-05 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923539+0000", 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017352200000000001 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923939+0000", 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000399334 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.924459+0000", 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052057299999999998 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.925959+0000", 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001499703 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926718+0000", 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075869800000000003 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926799+0000", 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0950000000000003e-05 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926879+0000", 2024-09-21T09:11:42.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0218999999999999e-05 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.285573902000003, 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031911079999999998, 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 221 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946537+0000", 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946549+0000", 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1527e-05 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946580+0000", 2024-09-21T09:11:42.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1356999999999998e-05 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946597+0000", 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7093000000000001e-05 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946714+0000", 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116872 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946936+0000", 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022225500000000001 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.947359+0000", 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042271099999999999 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.948825+0000", 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014661159999999999 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949560+0000", 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073491500000000005 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949644+0000", 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4147000000000006e-05 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949726+0000", 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1854999999999995e-05 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.267093484999997, 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030775389999999998, 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 226 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.283 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965018+0000", 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2199999999999999e-06 2024-09-21T09:11:42.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965029+0000", 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1436e-05 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965061+0000", 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2055999999999999e-05 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965077+0000", 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.558e-05 2024-09-21T09:11:42.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965200+0000", 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012353599999999999 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965442+0000", 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024218199999999999 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965830+0000", 2024-09-21T09:11:42.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038740699999999999 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967527+0000", 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001696999 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967943+0000", 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041585999999999999 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968028+0000", 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.53e-05 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968093+0000", 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4962999999999994e-05 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.891649852999997, 2024-09-21T09:11:42.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029016699999999999, 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 754 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340461+0000", 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340471+0000", 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8199999999999992e-06 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340502+0000", 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1047000000000003e-05 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340527+0000", 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4739000000000001e-05 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340685+0000", 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015804600000000001 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340891+0000", 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020627199999999999 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.341212+0000", 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032101500000000002 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.342549+0000", 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013375469999999999 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343214+0000", 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066447900000000005 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343299+0000", 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5154999999999994e-05 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343361+0000", 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1569999999999995e-05 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:757 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.884778781000001, 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029276440000000001, 2024-09-21T09:11:42.294 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 757 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347332+0000", 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0200000000000001e-06 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347343+0000", 2024-09-21T09:11:42.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347374+0000", 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1600000000000002e-05 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347389+0000", 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.486e-05 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347509+0000", 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119815 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347727+0000", 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217956 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.348046+0000", 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031872699999999999 2024-09-21T09:11:42.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.349129+0000", 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010836559999999999 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350046+0000", 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091629999999999999 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350135+0000", 2024-09-21T09:11:42.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9666999999999994e-05 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350258+0000", 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012226899999999999 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:759 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.880946600000001, 2024-09-21T09:11:42.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002979752, 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 759 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351164+0000", 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.703e-06 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351174+0000", 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0013000000000001e-05 2024-09-21T09:11:42.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351205+0000", 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1189999999999998e-05 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351223+0000", 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8003e-05 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351341+0000", 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118306 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351470+0000", 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000129076 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351737+0000", 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026687199999999998 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353037+0000", 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012995509999999999 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353989+0000", 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095197900000000004 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354076+0000", 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6730000000000005e-05 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354142+0000", 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6328999999999995e-05 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.853400647000001, 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002900807, 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 771 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378710+0000", 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.42e-06 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378717+0000", 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4739999999999999e-06 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378740+0000", 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.268e-05 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378751+0000", 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1143e-05 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378925+0000", 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017384900000000001 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379066+0000", 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141712 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379328+0000", 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026180499999999999 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.380651+0000", 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322611 2024-09-21T09:11:42.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381467+0000", 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081640100000000002 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381547+0000", 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9705999999999999e-05 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381609+0000", 2024-09-21T09:11:42.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2006000000000002e-05 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.647966590999999, 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029926800000000002, 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 856 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584144+0000", 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2469999999999998e-06 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584158+0000", 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3519999999999999e-05 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584191+0000", 2024-09-21T09:11:42.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2617000000000003e-05 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584206+0000", 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5276000000000001e-05 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584325+0000", 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118929 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584567+0000", 2024-09-21T09:11:42.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242525 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584885+0000", 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031785100000000002 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.585978+0000", 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001093246 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.586991+0000", 2024-09-21T09:11:42.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00101264 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587071+0000", 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9765999999999995e-05 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587135+0000", 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4063e-05 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:861 6.3 6:c0550c60:::obj_delete_at_hint.0000000094:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.637539525000001, 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00331716, 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 861 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.318 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594571+0000", 2024-09-21T09:11:42.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.686e-06 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594581+0000", 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8870000000000004e-06 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594612+0000", 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1433000000000002e-05 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594630+0000", 2024-09-21T09:11:42.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7589999999999999e-05 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594779+0000", 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014932199999999999 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595030+0000", 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025084100000000002 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595533+0000", 2024-09-21T09:11:42.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050262699999999996 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.596870+0000", 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013373580000000001 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597612+0000", 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074164800000000003 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597770+0000", 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015815499999999999 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597886+0000", 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116613 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.323 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.560960842999997, 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030306669999999999, 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 892 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671150+0000", 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.097e-06 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671161+0000", 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0499999999999999e-05 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671191+0000", 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0383e-05 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671206+0000", 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5437000000000001e-05 2024-09-21T09:11:42.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671359+0000", 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152189 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671584+0000", 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022531499999999999 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671899+0000", 2024-09-21T09:11:42.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031528399999999999 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673019+0000", 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011199560000000001 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673900+0000", 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088067799999999997 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674066+0000", 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016586500000000001 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674179+0000", 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112963 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:904 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:42.329 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.531315116999998, 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003078852, 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 904 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700796+0000", 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1840000000000002e-06 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700807+0000", 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1049999999999999e-05 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700836+0000", 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8833e-05 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700851+0000", 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4813e-05 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700970+0000", 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119456 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701187+0000", 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021738899999999999 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701519+0000", 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033143400000000003 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.702692+0000", 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011726620000000001 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703599+0000", 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090731700000000004 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703756+0000", 2024-09-21T09:11:42.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015696199999999999 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703873+0000", 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116752 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:906 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.527374426999998, 2024-09-21T09:11:42.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031432679999999998, 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 906 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704736+0000", 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7400000000000001e-06 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704746+0000", 2024-09-21T09:11:42.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4499999999999993e-06 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704770+0000", 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.402e-05 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704781+0000", 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1790000000000001e-05 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704909+0000", 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012782900000000001 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705162+0000", 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000253191 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705681+0000", 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051818999999999997 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707026+0000", 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013454840000000001 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707720+0000", 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069363499999999995 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707803+0000", 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3603000000000006e-05 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707878+0000", 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4336000000000001e-05 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:919 6.5 6:a1987d85:::obj_delete_at_hint.0000000114:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.495034310000001, 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003079816, 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.341 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 919 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:42.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737077+0000", 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2699999999999999e-06 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737091+0000", 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3825999999999999e-05 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737121+0000", 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.046e-05 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737138+0000", 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6793999999999999e-05 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737252+0000", 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114552 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737522+0000", 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026934799999999998 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737855+0000", 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033290799999999998 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.739016+0000", 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011608949999999999 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740004+0000", 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098829699999999996 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740090+0000", 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6645999999999997e-05 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740154+0000", 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3819999999999995e-05 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.346 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.438034836, 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003307838, 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 943 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794076+0000", 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.804e-06 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794085+0000", 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5859999999999994e-06 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794113+0000", 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8056999999999999e-05 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794128+0000", 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4382999999999999e-05 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794276+0000", 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000148286 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794649+0000", 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037297399999999998 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.795219+0000", 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056944899999999998 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.796426+0000", 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012075390000000001 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797214+0000", 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078828100000000005 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797295+0000", 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0289000000000003e-05 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797382+0000", 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7189999999999997e-05 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.352 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:42.354 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:11:42.354 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:42.352+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:42.454 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:42.452+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:42.523 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:42.523 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:42.523 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:42.524 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:42.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:11:42.556 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:42.554+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:42.657 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:42.652+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:42.722 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:42.723 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:42.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:11:42.777 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:42.776+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:42.858 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:42.854+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:42.908 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:42.908 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:42.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.007457254999998, 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011873984000000001, 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 87 2024-09-21T09:11:42.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898151+0000", 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9599999999999999e-07 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898264+0000", 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112509 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898277+0000", 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.38e-05 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898286+0000", 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7299999999999994e-06 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906279+0000", 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079924090000000007 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906410+0000", 2024-09-21T09:11:42.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013102900000000001 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906618+0000", 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020801500000000001 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909645+0000", 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030275329999999998 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909823+0000", 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017825499999999999 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909906+0000", 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2688999999999994e-05 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910024+0000", 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118319 2024-09-21T09:11:42.914 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.007305213000002, 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01257903, 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.915 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 88 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:42.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.569999999999999e-07 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898310+0000", 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0360000000000003e-06 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898320+0000", 2024-09-21T09:11:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0373999999999999e-05 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898327+0000", 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1960000000000002e-06 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908138+0000", 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.009810849 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908334+0000", 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000196059 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908540+0000", 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000205775 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910074+0000", 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001534363 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910609+0000", 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053462599999999996 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910764+0000", 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015484599999999999 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910882+0000", 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011794900000000001 2024-09-21T09:11:42.920 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.830988009000002, 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012244817999999999, 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.921 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 110 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7100000000000002e-07 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074625+0000", 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3939999999999998e-06 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074676+0000", 2024-09-21T09:11:42.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1369999999999998e-05 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074681+0000", 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7690000000000004e-06 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079388+0000", 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047075550000000004 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079454+0000", 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5639e-05 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079548+0000", 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4299e-05 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081984+0000", 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024359239999999999 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086803+0000", 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048185880000000004 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086835+0000", 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2487999999999998e-05 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086865+0000", 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9320999999999999e-05 2024-09-21T09:11:42.926 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.927 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.927 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.929 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.830916653999999, 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012339861000000001, 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 111 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5900000000000003e-07 2024-09-21T09:11:42.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074695+0000", 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4410000000000002e-06 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074707+0000", 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2376e-05 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074711+0000", 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9879999999999998e-06 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079878+0000", 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051667869999999999 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080012+0000", 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013358700000000001 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080288+0000", 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027684299999999998 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081987+0000", 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016981450000000001 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086920+0000", 2024-09-21T09:11:42.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049329780000000002 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086966+0000", 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6718999999999998e-05 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.087031+0000", 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4638e-05 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.830885604000002, 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013449694999999999, 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 112 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.936 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:42.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5699999999999998e-07 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074789+0000", 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6396000000000006e-05 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074796+0000", 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0190000000000001e-06 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074802+0000", 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9290000000000003e-06 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080677+0000", 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058755839999999997 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080739+0000", 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1866999999999996e-05 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080833+0000", 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3572000000000005e-05 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083415+0000", 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025824870000000001 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088053+0000", 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004637426 2024-09-21T09:11:42.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088105+0000", 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1993000000000002e-05 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088172+0000", 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7064999999999996e-05 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.830797506000003, 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013475117999999999, 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 113 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074811+0000", 2024-09-21T09:11:42.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6800000000000001e-07 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074814+0000", 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9919999999999999e-06 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074820+0000", 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5060000000000001e-06 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074823+0000", 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3289999999999998e-06 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081613+0000", 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006789331 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081666+0000", 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3482000000000001e-05 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081745+0000", 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8454999999999993e-05 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083786+0000", 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020410850000000002 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088227+0000", 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044407819999999999 2024-09-21T09:11:42.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088260+0000", 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3321000000000002e-05 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088285+0000", 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5466999999999999e-05 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.830686905999997, 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013454595, 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 114 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074922+0000", 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7100000000000001e-07 2024-09-21T09:11:42.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074925+0000", 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8060000000000001e-06 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074933+0000", 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7929999999999998e-06 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074937+0000", 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.749e-06 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082054+0000", 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071175259999999999 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082199+0000", 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014503199999999999 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082445+0000", 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245331 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083789+0000", 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001343943 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088319+0000", 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045298530000000004 2024-09-21T09:11:42.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088350+0000", 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1408000000000002e-05 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088375+0000", 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5483e-05 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.830409547999999, 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013331543, 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 115 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.954 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075199+0000", 2024-09-21T09:11:42.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1699999999999998e-07 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075281+0000", 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2151999999999995e-05 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075291+0000", 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0495e-05 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075298+0000", 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8920000000000003e-06 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082855+0000", 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075570790000000004 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082909+0000", 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3106000000000003e-05 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082988+0000", 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9515e-05 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085228+0000", 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002239736 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088425+0000", 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003197044 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088470+0000", 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5281000000000002e-05 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088530+0000", 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9626000000000001e-05 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.830298050000003, 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013307090000000001, 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 116 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.27e-07 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075314+0000", 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4249999999999998e-06 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075318+0000", 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7829999999999998e-06 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075321+0000", 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1370000000000002e-06 2024-09-21T09:11:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083883+0000", 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0085611369999999999 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083976+0000", 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3492000000000005e-05 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084091+0000", 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114993 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085233+0000", 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011417409999999999 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088565+0000", 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003332532 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088595+0000", 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9675e-05 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088617+0000", 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1747999999999999e-05 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:42.965 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.830280838, 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013638091, 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 117 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:42.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.53e-07 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075330+0000", 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.281e-06 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075336+0000", 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7339999999999996e-06 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075340+0000", 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4010000000000001e-06 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084504+0000", 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091640230000000003 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084560+0000", 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6595000000000003e-05 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084644+0000", 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3326999999999997e-05 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085387+0000", 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074348199999999995 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088913+0000", 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003525855 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088944+0000", 2024-09-21T09:11:42.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1621000000000001e-05 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088965+0000", 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0519000000000001e-05 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:132 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:42.971 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.321396987999996, 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013217052999999999, 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 132 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:42.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584212+0000", 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7700000000000003e-07 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584218+0000", 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584229+0000", 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1046000000000001e-05 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584237+0000", 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0800000000000006e-06 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590506+0000", 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062689440000000003 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590742+0000", 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023612500000000001 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.591121+0000", 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037905099999999999 2024-09-21T09:11:42.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593798+0000", 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026770079999999998 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597134+0000", 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033363009999999999 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597279+0000", 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144945 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597428+0000", 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014840599999999999 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.321225882, 2024-09-21T09:11:42.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013710092, 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 133 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584383+0000", 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1960000000000001e-06 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584391+0000", 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7239999999999992e-06 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584407+0000", 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6138999999999999e-05 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584416+0000", 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5540000000000003e-06 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592608+0000", 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081912370000000005 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592746+0000", 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138512 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592970+0000", 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022379600000000001 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597628+0000", 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046579669999999998 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597829+0000", 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020085599999999999 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597967+0000", 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013828899999999999 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598092+0000", 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012482199999999999 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.321173966000003, 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013969944, 2024-09-21T09:11:42.983 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 134 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1699999999999997e-07 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584594+0000", 2024-09-21T09:11:42.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015906899999999999 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584608+0000", 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.417e-05 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584617+0000", 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2960000000000004e-06 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593907+0000", 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0092901630000000006 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594043+0000", 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013558600000000001 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594285+0000", 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024269499999999999 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597788+0000", 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035024119999999999 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598121+0000", 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033284100000000001 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598256+0000", 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000134816 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598404+0000", 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014817899999999999 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.320972814000001, 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015773928, 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 135 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584636+0000", 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8700000000000004e-07 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584642+0000", 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2099999999999998e-06 2024-09-21T09:11:42.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584653+0000", 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536e-05 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584660+0000", 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.627e-06 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595480+0000", 2024-09-21T09:11:42.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010820214999999999 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595726+0000", 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245682 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.596110+0000", 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038419799999999998 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:42.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600117+0000", 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004006618 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600255+0000", 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013840599999999999 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600346+0000", 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0666000000000002e-05 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600409+0000", 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2883000000000001e-05 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.320935050999999, 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020097924999999999, 2024-09-21T09:11:42.995 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 136 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000004e-07 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584679+0000", 2024-09-21T09:11:42.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6069999999999998e-06 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584694+0000", 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4579999999999999e-05 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584702+0000", 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0730000000000005e-06 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:42.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598512+0000", 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013810578 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598748+0000", 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000236176 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.599125+0000", 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037634399999999997 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:42.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604492+0000", 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053673560000000002 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604613+0000", 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121039 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604703+0000", 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0399e-05 2024-09-21T09:11:43.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604771+0000", 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7119999999999994e-05 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.320893574999999, 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020579828000000001, 2024-09-21T09:11:43.001 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 137 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584715+0000", 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000005e-07 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584888+0000", 2024-09-21T09:11:43.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000173456 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584903+0000", 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.487e-05 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584913+0000", 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9899999999999992e-06 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600531+0000", 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015617987999999999 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600765+0000", 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023383900000000001 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.601148+0000", 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038257100000000001 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604980+0000", 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003832326 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605028+0000", 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8059999999999997e-05 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605166+0000", 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000137959 2024-09-21T09:11:43.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605294+0000", 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012808200000000001 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.320671832999999, 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024357648999999999, 2024-09-21T09:11:43.007 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 138 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584937+0000", 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.54e-07 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584943+0000", 2024-09-21T09:11:43.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6229999999999999e-06 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584959+0000", 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5489999999999999e-05 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584968+0000", 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.516e-06 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.602849+0000", 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017880314000000001 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603120+0000", 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027100799999999999 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603521+0000", 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040112399999999999 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.608899+0000", 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053779300000000004 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609024+0000", 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125699 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609140+0000", 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115982 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609294+0000", 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015310899999999999 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.320624092999999, 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024897698999999999, 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 139 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7999999999999995e-07 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584997+0000", 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2556e-05 2024-09-21T09:11:43.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585013+0000", 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5800000000000001e-05 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585021+0000", 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3340000000000002e-06 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605435+0000", 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020414299 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605604+0000", 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000168615 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605803+0000", 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199256 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609392+0000", 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035888719999999999 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609598+0000", 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020643500000000001 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609747+0000", 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014889600000000001 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609881+0000", 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013395599999999999 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.320571157000003, 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025121831000000001, 2024-09-21T09:11:43.019 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 140 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5400000000000001e-07 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585185+0000", 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014761900000000001 2024-09-21T09:11:43.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585199+0000", 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4450000000000001e-05 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585209+0000", 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2099999999999999e-06 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606615+0000", 2024-09-21T09:11:43.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021406261999999999 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606858+0000", 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024295499999999999 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.607232+0000", 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037427700000000001 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609554+0000", 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023222210000000002 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609917+0000", 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036226800000000001 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610051+0000", 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013447599999999999 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610158+0000", 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107439 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.320382705, 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.027901532, 2024-09-21T09:11:43.025 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 141 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585226+0000", 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5999999999999991e-07 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585238+0000", 2024-09-21T09:11:43.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1717e-05 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585248+0000", 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0776e-05 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585256+0000", 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8140000000000001e-06 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610278+0000", 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025021297000000001 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610421+0000", 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014358900000000001 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610631+0000", 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021016900000000001 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612016+0000", 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001385037 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612841+0000", 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082419399999999999 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612997+0000", 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000156186 2024-09-21T09:11:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.613127+0000", 2024-09-21T09:11:43.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012979300000000001 2024-09-21T09:11:43.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.031 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.031 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.031 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:43.033 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:11:43.033 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:43.030+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:43.133 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:43.130+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:43.152 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T09:11:43.172 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:43.172 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:43.172 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:43.172 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:43.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:11:43.234 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:43.230+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:43.335 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:43.334+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:43.358 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:43.358 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:43.358 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:43.358 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:43.358 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:43.371 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:11:43.436 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:43.432+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:43.493 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:43.493 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:43.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:43.493 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:43.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.493 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4358.0:40 5.1c 5:3fce9a59:::zonegroup_info.6661b8ba-4ecc-4129-afb2-8d0efd9659c2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T09:11:43.493 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:43.493 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.605213054000004, 2024-09-21T09:11:43.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028118549999999998, 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4358", 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3756932968", 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 40 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:43.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885826+0000", 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4899999999999999e-06 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885835+0000", 2024-09-21T09:11:43.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5299999999999996e-06 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885857+0000", 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1679999999999999e-05 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885871+0000", 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4146e-05 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885969+0000", 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8212000000000001e-05 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886181+0000", 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021209000000000001 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886450+0000", 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026841000000000001 2024-09-21T09:11:43.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.887864+0000", 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001414722 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888500+0000", 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063535399999999998 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888562+0000", 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2176999999999998e-05 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888637+0000", 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5043999999999995e-05 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:214 6.1c e36/30 6:3e426232:gc::gc.9:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:43.499 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.570019369000001, 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015590160000000001, 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.13e-07 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921028+0000", 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9639999999999992e-06 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921060+0000", 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1822000000000001e-05 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921076+0000", 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6252999999999998e-05 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921213+0000", 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013652299999999999 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921250+0000", 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7685999999999998e-05 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922504+0000", 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001253185 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922578+0000", 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4070000000000001e-05 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.503 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.559830879000003, 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036169079999999998, 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:43.504 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 217 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931210+0000", 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6529999999999998e-06 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931223+0000", 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3667e-05 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931257+0000", 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3742999999999999e-05 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931273+0000", 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5366000000000002e-05 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931414+0000", 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136300000000001 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931673+0000", 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025924500000000002 2024-09-21T09:11:43.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.932066+0000", 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0003927 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.933852+0000", 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017863180000000001 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934605+0000", 2024-09-21T09:11:43.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075312800000000004 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934696+0000", 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0328999999999995e-05 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934824+0000", 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128396 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:229 6.1b e36/30 6:db9d130d:gc::gc.24:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.514383922, 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015706159999999999, 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976655+0000", 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8699999999999995e-07 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976661+0000", 2024-09-21T09:11:43.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7599999999999997e-06 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976686+0000", 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4396000000000002e-05 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976699+0000", 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3336000000000001e-05 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976836+0000", 2024-09-21T09:11:43.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013669299999999999 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976871+0000", 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4913000000000003e-05 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978136+0000", 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001264851 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978225+0000", 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9179999999999997e-05 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.486652550000002, 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001626368, 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.514 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 237 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:43.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004389+0000", 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5099999999999999e-06 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004408+0000", 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9154e-05 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004453+0000", 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4385999999999998e-05 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004475+0000", 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2853e-05 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004585+0000", 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000109546 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004656+0000", 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0988999999999994e-05 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004818+0000", 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016166600000000001 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005536+0000", 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071806799999999998 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005917+0000", 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038119100000000002 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005956+0000", 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9255999999999998e-05 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.006012+0000", 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5748999999999998e-05 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.519 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:253 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.482976151000003, 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001548546, 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:43.520 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 253 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008063+0000", 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.263e-06 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008070+0000", 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1369999999999996e-06 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008087+0000", 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6263999999999999e-05 2024-09-21T09:11:43.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008096+0000", 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6670000000000008e-06 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008178+0000", 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1644999999999995e-05 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008240+0000", 2024-09-21T09:11:43.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2453999999999995e-05 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008448+0000", 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020722899999999999 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009447+0000", 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099947600000000001 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009547+0000", 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100268 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009582+0000", 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4459999999999999e-05 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009610+0000", 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8683e-05 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:709 6.1e e36/30 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.247269562, 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015262559999999999, 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243769+0000", 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9999999999999996e-07 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243776+0000", 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0999999999999998e-06 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243790+0000", 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3882e-05 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243800+0000", 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0083e-05 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243943+0000", 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014281799999999999 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243990+0000", 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7157000000000003e-05 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245247+0000", 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012564200000000001 2024-09-21T09:11:43.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245295+0000", 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7895999999999997e-05 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.224377552999997, 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023946290000000001, 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.530 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 721 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266663+0000", 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5289999999999998e-06 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266676+0000", 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.292e-05 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266705+0000", 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8816999999999999e-05 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266732+0000", 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7134000000000001e-05 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266844+0000", 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111848 2024-09-21T09:11:43.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267038+0000", 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019389 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267357+0000", 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000319172 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268435+0000", 2024-09-21T09:11:43.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010780430000000001 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268984+0000", 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054955599999999998 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269022+0000", 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7973999999999999e-05 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269055+0000", 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2746000000000001e-05 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.221403258999999, 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002147342, 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.536 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 723 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:43.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269636+0000", 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4720000000000001e-06 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269645+0000", 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.32e-06 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269667+0000", 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2487999999999999e-05 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269678+0000", 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0794e-05 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269735+0000", 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269784+0000", 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8266999999999997e-05 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269905+0000", 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121012 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.270906+0000", 2024-09-21T09:11:43.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00100125 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271576+0000", 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066977200000000001 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271666+0000", 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9952999999999997e-05 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271782+0000", 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116469 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:775 6.1e e36/30 6:7db93595:::obj_delete_at_hint.0000000066:head v 36'5, mlcod=36'3)", 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.099591470999997, 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015332430000000001, 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.542 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391448+0000", 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7570000000000001e-06 2024-09-21T09:11:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391462+0000", 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3256e-05 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391491+0000", 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9753000000000001e-05 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391515+0000", 2024-09-21T09:11:43.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3623999999999999e-05 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391667+0000", 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152065 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391732+0000", 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5099999999999997e-05 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392906+0000", 2024-09-21T09:11:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011735719999999999 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392980+0000", 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4116000000000007e-05 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:778 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'4, mlcod=36'2)", 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.092354274000002, 2024-09-21T09:11:43.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015037570000000001, 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398686+0000", 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8369999999999999e-06 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398703+0000", 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7363e-05 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398731+0000", 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8367000000000001e-05 2024-09-21T09:11:43.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398745+0000", 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.385e-05 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398923+0000", 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177818 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398963+0000", 2024-09-21T09:11:43.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9867000000000003e-05 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400088+0000", 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011250380000000001 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400188+0000", 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9617000000000005e-05 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:780 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'5, mlcod=36'3)", 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.087508327000002, 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001427673, 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403531+0000", 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6729999999999999e-06 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403568+0000", 2024-09-21T09:11:43.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6693000000000003e-05 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403597+0000", 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9130000000000001e-05 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403611+0000", 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3643e-05 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403781+0000", 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016968300000000001 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403820+0000", 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9768999999999998e-05 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404868+0000", 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001047493 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404957+0000", 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9588999999999999e-05 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:814 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'7, mlcod=36'5)", 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.005539525000003, 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014758, 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485500+0000", 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.843e-06 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485513+0000", 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2284e-05 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485542+0000", 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9102999999999999e-05 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485555+0000", 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.375e-05 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485660+0000", 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104849 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485719+0000", 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8842999999999999e-05 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486885+0000", 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011654250000000001 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486974+0000", 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9703000000000005e-05 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:816 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'8, mlcod=36'6)", 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:43.559 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.001913287000001, 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016647159999999999, 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:43.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489127+0000", 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489142+0000", 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5400000000000002e-05 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489177+0000", 2024-09-21T09:11:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4894000000000002e-05 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489196+0000", 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8873e-05 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489355+0000", 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015918799999999999 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489424+0000", 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8572999999999996e-05 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490705+0000", 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012817079999999999 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490789+0000", 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4019999999999999e-05 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:844 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'12, mlcod=36'10)", 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.934734552000002, 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015352059999999999, 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:43.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556305+0000", 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.73e-06 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556317+0000", 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2233e-05 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556348+0000", 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0176e-05 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556361+0000", 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3694e-05 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556511+0000", 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014973800000000001 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556567+0000", 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6273999999999997e-05 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557740+0000", 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001173065 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557839+0000", 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8295999999999995e-05 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:846 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'13, mlcod=36'11)", 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.930997761, 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014368810000000001, 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560042+0000", 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6500000000000001e-06 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560056+0000", 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4233000000000001e-05 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560085+0000", 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8767000000000001e-05 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560098+0000", 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3436e-05 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560242+0000", 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000143199 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560305+0000", 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3269999999999996e-05 2024-09-21T09:11:43.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561354+0000", 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010487630000000001 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561477+0000", 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012356300000000001 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.775411378999998, 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028068680000000001, 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 910 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715630+0000", 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.92e-06 2024-09-21T09:11:43.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715647+0000", 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715680+0000", 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3572999999999999e-05 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715696+0000", 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5777000000000002e-05 2024-09-21T09:11:43.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715819+0000", 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000122972 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716044+0000", 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022481500000000001 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716365+0000", 2024-09-21T09:11:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032138400000000003 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.717426+0000", 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001061223 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718214+0000", 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078753099999999995 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718304+0000", 2024-09-21T09:11:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0426999999999993e-05 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718434+0000", 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012908900000000001 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:43.578 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.771454325999997, 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031243310000000002, 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 912 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719585+0000", 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.72e-06 2024-09-21T09:11:43.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719597+0000", 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1229999999999999e-05 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719621+0000", 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4073000000000001e-05 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719633+0000", 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.259e-05 2024-09-21T09:11:43.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719761+0000", 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012745599999999999 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720000+0000", 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023914800000000001 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720482+0000", 2024-09-21T09:11:43.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048253400000000001 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.721627+0000", 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001145002 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722556+0000", 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092825299999999998 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722640+0000", 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4542999999999993e-05 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722708+0000", 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7781999999999996e-05 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.731300089000001, 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014824689999999999, 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759740+0000", 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7370000000000001e-06 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759752+0000", 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2483000000000001e-05 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759782+0000", 2024-09-21T09:11:43.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9553e-05 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759798+0000", 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6042999999999999e-05 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759943+0000", 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760001+0000", 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8777000000000003e-05 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761134+0000", 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001132922 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761220+0000", 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6044999999999994e-05 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1020 6.10 e45/30 6:0fbdcb32:usage::usage.17:head v 45'5, mlcod=36'3)", 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.45176047, 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001677574, 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039281+0000", 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0939999999999999e-06 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039305+0000", 2024-09-21T09:11:43.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3906000000000001e-05 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039349+0000", 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4064999999999999e-05 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039379+0000", 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9889000000000001e-05 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039517+0000", 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013895300000000001 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039574+0000", 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6162000000000002e-05 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040855+0000", 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001281821 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:43.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040955+0000", 2024-09-21T09:11:43.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9684000000000003e-05 2024-09-21T09:11:43.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.593 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:43.593 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:43.593 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:43.594 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:11:43.595 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:43.594+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:43.694 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:43.692+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:43.763 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:43.764 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:43.764 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:43.764 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:43.777 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:11:43.821 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:43.820+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:43.896 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:43.892+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:43.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:11:43.935 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:43.935 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:43.936 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:43.936 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:43.936 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:43.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:11:43.997 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:43.996+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:44.050 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:44.051 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:44.067 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:44.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:44.084 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:44.085 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:44.098 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:44.094+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:44.101 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:44.102 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:44.123 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-09-21T09:11:44.125 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:44.125 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:44.126 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:44.126 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:44.147 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:11:44.158 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:44.158 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:44.183 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:44.184 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:44.201 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:44.196+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:44.203 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:44.203 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:44.282 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:44.282 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:44.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:11:44.304 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:44.302+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:44.404 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:44.402+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:44.434 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:44.434 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:44.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:11:44.544 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:44.542+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:44.606 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:44.604+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:44.624 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:44.624 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:44.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:11:44.704 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:44.700+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:44.806 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:44.804+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:44.816 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:44.816 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:44.832 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:11:44.906 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:44.902+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:44.966 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:44.966 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:44.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:11:45.007 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:45.004+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:45.108 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:45.104+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:45.152 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:45.152 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:45.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:11:45.208 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:45.204+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:45.296 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:45.296 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:45.309 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:45.306+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:45.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:11:45.410 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:45.406+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:45.482 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:45.483 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:45.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:11:45.511 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:45.508+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:45.612 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:45.608+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:45.674 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:45.674 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:45.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:11:45.712 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:45.708+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:45.813 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:45.812+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:45.815 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:45.815 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:45.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:11:45.914 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:45.910+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:45.949 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:45.949 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:45.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:11:46.051 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:46.050+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:46.095 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T09:11:46.096 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T09:11:46.096 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-21T09:11:46.096 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T09:11:46.096 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T09:11:46.096 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-21T09:11:46.137 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:46.137 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:46.137 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:46.134+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:46.147 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T09:11:46.153 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:11:46.216 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:46.214+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:46.225 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T09:11:46.225 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:46.228 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:11:46.317 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:46.314+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:46.343 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:46.343 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:46.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:11:46.418 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:46.414+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:46.440 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:46.470 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:46.470 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:46.502 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:46.502 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:46.519 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:46.514+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:46.532 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:46.533 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:46.533 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:46.533 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:46.533 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:46.533 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:46.533 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:46.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:11:46.561 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:46.562 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:46.598 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:46.598 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:46.619 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:46.618+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:46.632 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:46.632 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:46.652 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:46.652 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:46.699 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:46.699 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.814703778999998, 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.005197709, 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 46 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883302+0000", 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883306+0000", 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8680000000000001e-06 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883320+0000", 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3777e-05 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883355+0000", 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5457000000000003e-05 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883381+0000", 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5548e-05 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883631+0000", 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025032199999999998 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.883924+0000", 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029322899999999999 2024-09-21T09:11:46.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.884247+0000", 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032292300000000003 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.885849+0000", 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016019459999999999 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888259+0000", 2024-09-21T09:11:46.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024100409999999999 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888397+0000", 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013753600000000001 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888500+0000", 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103062 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113020240896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.809031627000003, 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058707430000000003, 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 47 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888974+0000", 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888977+0000", 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:11:46.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.888990+0000", 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.33e-05 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889036+0000", 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6328000000000001e-05 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889059+0000", 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3048e-05 2024-09-21T09:11:46.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.889882+0000", 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082253800000000005 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890147+0000", 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026500299999999998 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.890549+0000", 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000402323 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.893575+0000", 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030257690000000002 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894522+0000", 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094709000000000004 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894675+0000", 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015305599999999999 2024-09-21T09:11:46.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.894845+0000", 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016973100000000001 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.698206276999997, 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035327039999999998, 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.711 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 191 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999799+0000", 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999801+0000", 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999812+0000", 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0183000000000001e-05 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999843+0000", 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1553000000000001e-05 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:04.999858+0000", 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4907e-05 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000009+0000", 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000150786 2024-09-21T09:11:46.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000333+0000", 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032434100000000002 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.000821+0000", 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048796000000000001 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.002625+0000", 2024-09-21T09:11:46.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001803802 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003193+0000", 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056811000000000003 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003267+0000", 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3980000000000007e-05 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:05.003332+0000", 2024-09-21T09:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5022000000000002e-05 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.832721493999998, 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039222459999999999, 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 205 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865284+0000", 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865287+0000", 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3000000000000002e-06 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865304+0000", 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6269999999999998e-05 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865349+0000", 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5652999999999998e-05 2024-09-21T09:11:46.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865370+0000", 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1117000000000001e-05 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865572+0000", 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020120199999999999 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.865819+0000", 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024759800000000002 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.866195+0000", 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000375557 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.867603+0000", 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001407967 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.868927+0000", 2024-09-21T09:11:46.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013238410000000001 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869095+0000", 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016838899999999999 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.869206+0000", 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111352 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.804288726000003, 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031054379999999999, 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 209 2024-09-21T09:11:46.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893717+0000", 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893719+0000", 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3599999999999999e-06 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893731+0000", 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.222e-05 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893765+0000", 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3782999999999998e-05 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893781+0000", 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.893906+0000", 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012485299999999999 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894129+0000", 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022317800000000001 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.894535+0000", 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040575399999999998 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.895977+0000", 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014418199999999999 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896619+0000", 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064255900000000001 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896704+0000", 2024-09-21T09:11:46.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4653000000000004e-05 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.896822+0000", 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118285 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.788946611999997, 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037831409999999998, 2024-09-21T09:11:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 213 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909059+0000", 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909062+0000", 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0400000000000001e-06 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909075+0000", 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3094e-05 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909106+0000", 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0426e-05 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909121+0000", 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5903e-05 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909280+0000", 2024-09-21T09:11:46.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000158772 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.909665+0000", 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038435800000000001 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.910380+0000", 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071585799999999999 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912186+0000", 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018052649999999999 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912661+0000", 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047496399999999997 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912752+0000", 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1445000000000003e-05 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.912842+0000", 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0016e-05 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.774703549999998, 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576779, 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 215 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923302+0000", 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923305+0000", 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5639999999999999e-06 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923317+0000", 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1956e-05 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923349+0000", 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2706999999999997e-05 2024-09-21T09:11:46.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923366+0000", 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6552999999999999e-05 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923539+0000", 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017352200000000001 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923939+0000", 2024-09-21T09:11:46.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000399334 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.924459+0000", 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052057299999999998 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.925959+0000", 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001499703 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926718+0000", 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075869800000000003 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926799+0000", 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0950000000000003e-05 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.926879+0000", 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0218999999999999e-05 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.739 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.751470730000001, 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031911079999999998, 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 221 2024-09-21T09:11:46.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946535+0000", 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946537+0000", 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946549+0000", 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1527e-05 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946580+0000", 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1356999999999998e-05 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946597+0000", 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7093000000000001e-05 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946714+0000", 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116872 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946936+0000", 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022225500000000001 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.947359+0000", 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042271099999999999 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.948825+0000", 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014661159999999999 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949560+0000", 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073491500000000005 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949644+0000", 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4147000000000006e-05 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.949726+0000", 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1854999999999995e-05 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.732990313000002, 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030775389999999998, 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 226 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965015+0000", 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965018+0000", 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2199999999999999e-06 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965029+0000", 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1436e-05 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965061+0000", 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2055999999999999e-05 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965077+0000", 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.558e-05 2024-09-21T09:11:46.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965200+0000", 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012353599999999999 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965442+0000", 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024218199999999999 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.965830+0000", 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038740699999999999 2024-09-21T09:11:46.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967527+0000", 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001696999 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.967943+0000", 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041585999999999999 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968028+0000", 2024-09-21T09:11:46.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.53e-05 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.968093+0000", 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4962999999999994e-05 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:754 6.a 6:576130b8:::obj_delete_at_hint.0000000059:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:46.751 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.357546681000002, 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029016699999999999, 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 754 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340459+0000", 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340461+0000", 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340471+0000", 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8199999999999992e-06 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340502+0000", 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1047000000000003e-05 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340527+0000", 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4739000000000001e-05 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340685+0000", 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015804600000000001 2024-09-21T09:11:46.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.340891+0000", 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020627199999999999 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.341212+0000", 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032101500000000002 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.342549+0000", 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013375469999999999 2024-09-21T09:11:46.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343214+0000", 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066447900000000005 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343299+0000", 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5154999999999994e-05 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.343361+0000", 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1569999999999995e-05 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:757 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.350675609, 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029276440000000001, 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 757 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347330+0000", 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347332+0000", 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0200000000000001e-06 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347343+0000", 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347374+0000", 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1600000000000002e-05 2024-09-21T09:11:46.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347389+0000", 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.486e-05 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347509+0000", 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119815 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.347727+0000", 2024-09-21T09:11:46.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217956 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.348046+0000", 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031872699999999999 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.349129+0000", 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010836559999999999 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350046+0000", 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091629999999999999 2024-09-21T09:11:46.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350135+0000", 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9666999999999994e-05 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.350258+0000", 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012226899999999999 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:759 6.3 6:c2689b66:::obj_delete_at_hint.0000000060:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.346843428, 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002979752, 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 759 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351162+0000", 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351164+0000", 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.703e-06 2024-09-21T09:11:46.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351174+0000", 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0013000000000001e-05 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351205+0000", 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1189999999999998e-05 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351223+0000", 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8003e-05 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351341+0000", 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118306 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351470+0000", 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000129076 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.351737+0000", 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026687199999999998 2024-09-21T09:11:46.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353037+0000", 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012995509999999999 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.353989+0000", 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095197900000000004 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354076+0000", 2024-09-21T09:11:46.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6730000000000005e-05 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.354142+0000", 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6328999999999995e-05 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.319297474999999, 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002900807, 2024-09-21T09:11:46.768 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 771 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378708+0000", 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378710+0000", 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.42e-06 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378717+0000", 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4739999999999999e-06 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378740+0000", 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.268e-05 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378751+0000", 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1143e-05 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.378925+0000", 2024-09-21T09:11:46.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017384900000000001 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379066+0000", 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141712 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.379328+0000", 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026180499999999999 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.380651+0000", 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322611 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381467+0000", 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081640100000000002 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381547+0000", 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9705999999999999e-05 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.381609+0000", 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2006000000000002e-05 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.113863418999998, 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029926800000000002, 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.774 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 856 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584142+0000", 2024-09-21T09:11:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584144+0000", 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2469999999999998e-06 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584158+0000", 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3519999999999999e-05 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584191+0000", 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2617000000000003e-05 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584206+0000", 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5276000000000001e-05 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584325+0000", 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118929 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584567+0000", 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242525 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.584885+0000", 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031785100000000002 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.585978+0000", 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001093246 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.586991+0000", 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00101264 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587071+0000", 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9765999999999995e-05 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.587135+0000", 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4063e-05 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.779 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:861 6.3 6:c0550c60:::obj_delete_at_hint.0000000094:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.103436352999999, 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00331716, 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.780 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 861 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594569+0000", 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594571+0000", 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.686e-06 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594581+0000", 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8870000000000004e-06 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594612+0000", 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1433000000000002e-05 2024-09-21T09:11:46.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594630+0000", 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7589999999999999e-05 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.594779+0000", 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014932199999999999 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595030+0000", 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025084100000000002 2024-09-21T09:11:46.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.595533+0000", 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050262699999999996 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.596870+0000", 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013373580000000001 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597612+0000", 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074164800000000003 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597770+0000", 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015815499999999999 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.597886+0000", 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116613 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:892 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.026857671000002, 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030306669999999999, 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 892 2024-09-21T09:11:46.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671148+0000", 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671150+0000", 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.097e-06 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671161+0000", 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0499999999999999e-05 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671191+0000", 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0383e-05 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671206+0000", 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5437000000000001e-05 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671359+0000", 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152189 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671584+0000", 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022531499999999999 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.671899+0000", 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031528399999999999 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673019+0000", 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011199560000000001 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.673900+0000", 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088067799999999997 2024-09-21T09:11:46.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674066+0000", 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016586500000000001 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.674179+0000", 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112963 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.791 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:904 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.997211944999997, 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003078852, 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 904 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700794+0000", 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700796+0000", 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1840000000000002e-06 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700807+0000", 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1049999999999999e-05 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700836+0000", 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8833e-05 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700851+0000", 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4813e-05 2024-09-21T09:11:46.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.700970+0000", 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119456 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701187+0000", 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021738899999999999 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.701519+0000", 2024-09-21T09:11:46.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033143400000000003 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.702692+0000", 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011726620000000001 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703599+0000", 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090731700000000004 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703756+0000", 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015696199999999999 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.703873+0000", 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116752 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:906 6.3 6:c35966f0:::obj_delete_at_hint.0000000109:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.993271255000003, 2024-09-21T09:11:46.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031432679999999998, 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 906 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:46.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704734+0000", 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704736+0000", 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7400000000000001e-06 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704746+0000", 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4499999999999993e-06 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704770+0000", 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.402e-05 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704781+0000", 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1790000000000001e-05 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.704909+0000", 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012782900000000001 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705162+0000", 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000253191 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.705681+0000", 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051818999999999997 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707026+0000", 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013454840000000001 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707720+0000", 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069363499999999995 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707803+0000", 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3603000000000006e-05 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.707878+0000", 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4336000000000001e-05 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:919 6.5 6:a1987d85:::obj_delete_at_hint.0000000114:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.960931137999999, 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003079816, 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 919 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737074+0000", 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737077+0000", 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2699999999999999e-06 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737091+0000", 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3825999999999999e-05 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737121+0000", 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.046e-05 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737138+0000", 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6793999999999999e-05 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737252+0000", 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114552 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737522+0000", 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026934799999999998 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.737855+0000", 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033290799999999998 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.739016+0000", 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011608949999999999 2024-09-21T09:11:46.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740004+0000", 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098829699999999996 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740090+0000", 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6645999999999997e-05 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.740154+0000", 2024-09-21T09:11:46.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3819999999999995e-05 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.903931663999998, 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003307838, 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:46.809 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 943 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794074+0000", 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794076+0000", 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.804e-06 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794085+0000", 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5859999999999994e-06 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794113+0000", 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8056999999999999e-05 2024-09-21T09:11:46.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794128+0000", 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4382999999999999e-05 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794276+0000", 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000148286 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.794649+0000", 2024-09-21T09:11:46.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037297399999999998 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.795219+0000", 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056944899999999998 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.796426+0000", 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012075390000000001 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:46.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797214+0000", 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078828100000000005 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797295+0000", 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0289000000000003e-05 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.797382+0000", 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7189999999999997e-05 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:46.815 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:46.816 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:11:46.817 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:46.814+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:46.916 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:46.912+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:46.980 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:46.980 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:46.980 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:46.980 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:46.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:11:47.037 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:47.036+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:47.118 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:47.116+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:47.143 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-09-21T09:11:47.179 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:47.179 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:47.179 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:47.179 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:47.179 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:47.196 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:11:47.237 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:47.236+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:47.319 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:47.318+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:47.359 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:47.359 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:47.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:47.359 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:47.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.458317563000001, 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011873984000000001, 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 87 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898151+0000", 2024-09-21T09:11:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9599999999999999e-07 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898264+0000", 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112509 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898277+0000", 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.38e-05 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898286+0000", 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7299999999999994e-06 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906279+0000", 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079924090000000007 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906410+0000", 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013102900000000001 2024-09-21T09:11:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906618+0000", 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020801500000000001 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909645+0000", 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030275329999999998 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909823+0000", 2024-09-21T09:11:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017825499999999999 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909906+0000", 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2688999999999994e-05 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910024+0000", 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118319 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.458165520999998, 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01257903, 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 88 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.569999999999999e-07 2024-09-21T09:11:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898310+0000", 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0360000000000003e-06 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898320+0000", 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0373999999999999e-05 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898327+0000", 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1960000000000002e-06 2024-09-21T09:11:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908138+0000", 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.009810849 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908334+0000", 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000196059 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908540+0000", 2024-09-21T09:11:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000205775 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910074+0000", 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001534363 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910609+0000", 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053462599999999996 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910764+0000", 2024-09-21T09:11:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015484599999999999 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910882+0000", 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011794900000000001 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.281848316999998, 2024-09-21T09:11:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012244817999999999, 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 110 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7100000000000002e-07 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074625+0000", 2024-09-21T09:11:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3939999999999998e-06 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074676+0000", 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1369999999999998e-05 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074681+0000", 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7690000000000004e-06 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079388+0000", 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047075550000000004 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079454+0000", 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5639e-05 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079548+0000", 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4299e-05 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081984+0000", 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024359239999999999 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086803+0000", 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048185880000000004 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086835+0000", 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2487999999999998e-05 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086865+0000", 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9320999999999999e-05 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.281776962000002, 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012339861000000001, 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 111 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5900000000000003e-07 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074695+0000", 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4410000000000002e-06 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074707+0000", 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2376e-05 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074711+0000", 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9879999999999998e-06 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079878+0000", 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051667869999999999 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080012+0000", 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013358700000000001 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080288+0000", 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027684299999999998 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081987+0000", 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016981450000000001 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086920+0000", 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049329780000000002 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086966+0000", 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6718999999999998e-05 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.087031+0000", 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4638e-05 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.281745911999998, 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013449694999999999, 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 112 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5699999999999998e-07 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074789+0000", 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6396000000000006e-05 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074796+0000", 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0190000000000001e-06 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074802+0000", 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9290000000000003e-06 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080677+0000", 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058755839999999997 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080739+0000", 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1866999999999996e-05 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080833+0000", 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3572000000000005e-05 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083415+0000", 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025824870000000001 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088053+0000", 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004637426 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088105+0000", 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1993000000000002e-05 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088172+0000", 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7064999999999996e-05 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.281657813999999, 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013475117999999999, 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 113 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074811+0000", 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6800000000000001e-07 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074814+0000", 2024-09-21T09:11:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9919999999999999e-06 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074820+0000", 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5060000000000001e-06 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074823+0000", 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3289999999999998e-06 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081613+0000", 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006789331 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081666+0000", 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3482000000000001e-05 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081745+0000", 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8454999999999993e-05 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083786+0000", 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020410850000000002 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088227+0000", 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044407819999999999 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088260+0000", 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3321000000000002e-05 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088285+0000", 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5466999999999999e-05 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.281547214, 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013454595, 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 114 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074922+0000", 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7100000000000001e-07 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074925+0000", 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8060000000000001e-06 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074933+0000", 2024-09-21T09:11:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7929999999999998e-06 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074937+0000", 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.749e-06 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082054+0000", 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071175259999999999 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082199+0000", 2024-09-21T09:11:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014503199999999999 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082445+0000", 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245331 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083789+0000", 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001343943 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088319+0000", 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045298530000000004 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088350+0000", 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1408000000000002e-05 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088375+0000", 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5483e-05 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.281269856000002, 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013331543, 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 115 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075199+0000", 2024-09-21T09:11:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1699999999999998e-07 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075281+0000", 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2151999999999995e-05 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075291+0000", 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0495e-05 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075298+0000", 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8920000000000003e-06 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082855+0000", 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075570790000000004 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082909+0000", 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3106000000000003e-05 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082988+0000", 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9515e-05 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085228+0000", 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002239736 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088425+0000", 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003197044 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088470+0000", 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5281000000000002e-05 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088530+0000", 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9626000000000001e-05 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.281158357999999, 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013307090000000001, 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 116 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.27e-07 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075314+0000", 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4249999999999998e-06 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075318+0000", 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7829999999999998e-06 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075321+0000", 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1370000000000002e-06 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083883+0000", 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0085611369999999999 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083976+0000", 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3492000000000005e-05 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084091+0000", 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114993 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085233+0000", 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011417409999999999 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088565+0000", 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003332532 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088595+0000", 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9675e-05 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088617+0000", 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1747999999999999e-05 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.281141146000003, 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013638091, 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 117 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.53e-07 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075330+0000", 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.281e-06 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075336+0000", 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7339999999999996e-06 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075340+0000", 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4010000000000001e-06 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084504+0000", 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091640230000000003 2024-09-21T09:11:47.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084560+0000", 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6595000000000003e-05 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084644+0000", 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3326999999999997e-05 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085387+0000", 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074348199999999995 2024-09-21T09:11:47.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088913+0000", 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003525855 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088944+0000", 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1621000000000001e-05 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088965+0000", 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0519000000000001e-05 2024-09-21T09:11:47.416 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:132 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.772257295999999, 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013217052999999999, 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 132 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584212+0000", 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7700000000000003e-07 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584218+0000", 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584229+0000", 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1046000000000001e-05 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584237+0000", 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0800000000000006e-06 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590506+0000", 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062689440000000003 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590742+0000", 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023612500000000001 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.591121+0000", 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037905099999999999 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593798+0000", 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026770079999999998 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597134+0000", 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033363009999999999 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597279+0000", 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144945 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597428+0000", 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014840599999999999 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:47.422 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.772086190000003, 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013710092, 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 133 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:47.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584383+0000", 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1960000000000001e-06 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584391+0000", 2024-09-21T09:11:47.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7239999999999992e-06 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584407+0000", 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6138999999999999e-05 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584416+0000", 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5540000000000003e-06 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592608+0000", 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081912370000000005 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592746+0000", 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138512 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592970+0000", 2024-09-21T09:11:47.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022379600000000001 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597628+0000", 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046579669999999998 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597829+0000", 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020085599999999999 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597967+0000", 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013828899999999999 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598092+0000", 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012482199999999999 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:47.428 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.772034273999999, 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013969944, 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 134 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1699999999999997e-07 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584594+0000", 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015906899999999999 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584608+0000", 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.417e-05 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584617+0000", 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2960000000000004e-06 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593907+0000", 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0092901630000000006 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594043+0000", 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013558600000000001 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594285+0000", 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024269499999999999 2024-09-21T09:11:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597788+0000", 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035024119999999999 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598121+0000", 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033284100000000001 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598256+0000", 2024-09-21T09:11:47.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000134816 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598404+0000", 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014817899999999999 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.771833121999997, 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015773928, 2024-09-21T09:11:47.434 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 135 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584636+0000", 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8700000000000004e-07 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584642+0000", 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2099999999999998e-06 2024-09-21T09:11:47.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584653+0000", 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536e-05 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584660+0000", 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.627e-06 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595480+0000", 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010820214999999999 2024-09-21T09:11:47.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595726+0000", 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245682 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.596110+0000", 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038419799999999998 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600117+0000", 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004006618 2024-09-21T09:11:47.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600255+0000", 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013840599999999999 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600346+0000", 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0666000000000002e-05 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600409+0000", 2024-09-21T09:11:47.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2883000000000001e-05 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.771795359000002, 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020097924999999999, 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.440 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 136 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:47.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000004e-07 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584679+0000", 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6069999999999998e-06 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584694+0000", 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4579999999999999e-05 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584702+0000", 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0730000000000005e-06 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598512+0000", 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013810578 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598748+0000", 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000236176 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.599125+0000", 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037634399999999997 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604492+0000", 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053673560000000002 2024-09-21T09:11:47.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604613+0000", 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121039 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604703+0000", 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0399e-05 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604771+0000", 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7119999999999994e-05 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.771753883000002, 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020579828000000001, 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.446 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 137 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584715+0000", 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000005e-07 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584888+0000", 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000173456 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584903+0000", 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.487e-05 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584913+0000", 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9899999999999992e-06 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600531+0000", 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015617987999999999 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600765+0000", 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023383900000000001 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.601148+0000", 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038257100000000001 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604980+0000", 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003832326 2024-09-21T09:11:47.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605028+0000", 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8059999999999997e-05 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605166+0000", 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000137959 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605294+0000", 2024-09-21T09:11:47.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012808200000000001 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.771532141000002, 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024357648999999999, 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.452 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 138 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584937+0000", 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.54e-07 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584943+0000", 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6229999999999999e-06 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584959+0000", 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5489999999999999e-05 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584968+0000", 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.516e-06 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.602849+0000", 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017880314000000001 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603120+0000", 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027100799999999999 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603521+0000", 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040112399999999999 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.608899+0000", 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053779300000000004 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609024+0000", 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125699 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609140+0000", 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115982 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609294+0000", 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015310899999999999 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.457 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.771484401000002, 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024897698999999999, 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.458 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 139 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7999999999999995e-07 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584997+0000", 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2556e-05 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585013+0000", 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5800000000000001e-05 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585021+0000", 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3340000000000002e-06 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605435+0000", 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020414299 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605604+0000", 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000168615 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605803+0000", 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199256 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609392+0000", 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035888719999999999 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609598+0000", 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020643500000000001 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609747+0000", 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014889600000000001 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609881+0000", 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013395599999999999 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.463 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.771431464999999, 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025121831000000001, 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 140 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5400000000000001e-07 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585185+0000", 2024-09-21T09:11:47.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014761900000000001 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585199+0000", 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4450000000000001e-05 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585209+0000", 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2099999999999999e-06 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606615+0000", 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021406261999999999 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606858+0000", 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024295499999999999 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.607232+0000", 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037427700000000001 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609554+0000", 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023222210000000002 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609917+0000", 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036226800000000001 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610051+0000", 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013447599999999999 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610158+0000", 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107439 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.771243013000003, 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.027901532, 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.469 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 141 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585226+0000", 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5999999999999991e-07 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585238+0000", 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1717e-05 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585248+0000", 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0776e-05 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585256+0000", 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8140000000000001e-06 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610278+0000", 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025021297000000001 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610421+0000", 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014358900000000001 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610631+0000", 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021016900000000001 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612016+0000", 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001385037 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612841+0000", 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082419399999999999 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612997+0000", 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000156186 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.613127+0000", 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012979300000000001 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.474 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.475 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.475 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:47.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:11:47.476 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:47.472+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:47.576 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:47.576+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:47.632 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:47.632 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:47.632 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:47.632 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:47.644 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:11:47.689 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:47.688+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:47.778 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:47.776+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:47.811 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:47.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:47.812 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:47.812 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:47.812 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:47.829 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:11:47.879 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:47.878+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:47.980 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:47.978+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:47.984 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:47.984 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:47.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4358.0:40 5.1c 5:3fce9a59:::zonegroup_info.6661b8ba-4ecc-4129-afb2-8d0efd9659c2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.096352631999999, 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028118549999999998, 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4358", 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3756932968", 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 40 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885826+0000", 2024-09-21T09:11:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4899999999999999e-06 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885835+0000", 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5299999999999996e-06 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885857+0000", 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1679999999999999e-05 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885871+0000", 2024-09-21T09:11:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4146e-05 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885969+0000", 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8212000000000001e-05 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886181+0000", 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021209000000000001 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886450+0000", 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026841000000000001 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.887864+0000", 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001414722 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888500+0000", 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063535399999999998 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888562+0000", 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2176999999999998e-05 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888637+0000", 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5043999999999995e-05 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:214 6.1c e36/30 6:3e426232:gc::gc.9:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.061158947000003, 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015590160000000001, 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.13e-07 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921028+0000", 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9639999999999992e-06 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921060+0000", 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1822000000000001e-05 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921076+0000", 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6252999999999998e-05 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921213+0000", 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013652299999999999 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921250+0000", 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7685999999999998e-05 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922504+0000", 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001253185 2024-09-21T09:11:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922578+0000", 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4070000000000001e-05 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.050970456999998, 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036169079999999998, 2024-09-21T09:11:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 217 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931210+0000", 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6529999999999998e-06 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931223+0000", 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3667e-05 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931257+0000", 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3742999999999999e-05 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931273+0000", 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5366000000000002e-05 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931414+0000", 2024-09-21T09:11:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136300000000001 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931673+0000", 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025924500000000002 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.932066+0000", 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0003927 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.933852+0000", 2024-09-21T09:11:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017863180000000001 2024-09-21T09:11:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934605+0000", 2024-09-21T09:11:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075312800000000004 2024-09-21T09:11:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934696+0000", 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0328999999999995e-05 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934824+0000", 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128396 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:229 6.1b e36/30 6:db9d130d:gc::gc.24:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.005523500000002, 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015706159999999999, 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976655+0000", 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8699999999999995e-07 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976661+0000", 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7599999999999997e-06 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976686+0000", 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4396000000000002e-05 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976699+0000", 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3336000000000001e-05 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976836+0000", 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013669299999999999 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976871+0000", 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4913000000000003e-05 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978136+0000", 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001264851 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978225+0000", 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9179999999999997e-05 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.977792127999997, 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001626368, 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 237 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004389+0000", 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5099999999999999e-06 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004408+0000", 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9154e-05 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004453+0000", 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4385999999999998e-05 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004475+0000", 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2853e-05 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004585+0000", 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000109546 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004656+0000", 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0988999999999994e-05 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004818+0000", 2024-09-21T09:11:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016166600000000001 2024-09-21T09:11:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005536+0000", 2024-09-21T09:11:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071806799999999998 2024-09-21T09:11:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005917+0000", 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038119100000000002 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005956+0000", 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9255999999999998e-05 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.006012+0000", 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5748999999999998e-05 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:253 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.974115728999998, 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001548546, 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 253 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008063+0000", 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.263e-06 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008070+0000", 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1369999999999996e-06 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008087+0000", 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6263999999999999e-05 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008096+0000", 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6670000000000008e-06 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008178+0000", 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1644999999999995e-05 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008240+0000", 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2453999999999995e-05 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008448+0000", 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020722899999999999 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009447+0000", 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099947600000000001 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009547+0000", 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100268 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009582+0000", 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4459999999999999e-05 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009610+0000", 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8683e-05 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:709 6.1e e36/30 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.738409140000002, 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015262559999999999, 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243769+0000", 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9999999999999996e-07 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243776+0000", 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0999999999999998e-06 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243790+0000", 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3882e-05 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243800+0000", 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0083e-05 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243943+0000", 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014281799999999999 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243990+0000", 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7157000000000003e-05 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245247+0000", 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012564200000000001 2024-09-21T09:11:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245295+0000", 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7895999999999997e-05 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.715517130999999, 2024-09-21T09:11:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023946290000000001, 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 721 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266663+0000", 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5289999999999998e-06 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266676+0000", 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.292e-05 2024-09-21T09:11:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266705+0000", 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8816999999999999e-05 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266732+0000", 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7134000000000001e-05 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266844+0000", 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111848 2024-09-21T09:11:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267038+0000", 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019389 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267357+0000", 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000319172 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268435+0000", 2024-09-21T09:11:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010780430000000001 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268984+0000", 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054955599999999998 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269022+0000", 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7973999999999999e-05 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269055+0000", 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2746000000000001e-05 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.712542837000001, 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002147342, 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 723 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269636+0000", 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4720000000000001e-06 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269645+0000", 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.32e-06 2024-09-21T09:11:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269667+0000", 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2487999999999999e-05 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269678+0000", 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0794e-05 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269735+0000", 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269784+0000", 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8266999999999997e-05 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269905+0000", 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121012 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.270906+0000", 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00100125 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271576+0000", 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066977200000000001 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271666+0000", 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9952999999999997e-05 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271782+0000", 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116469 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:775 6.1e e36/30 6:7db93595:::obj_delete_at_hint.0000000066:head v 36'5, mlcod=36'3)", 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.590731048999999, 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015332430000000001, 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391448+0000", 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7570000000000001e-06 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391462+0000", 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3256e-05 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391491+0000", 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9753000000000001e-05 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391515+0000", 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3623999999999999e-05 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391667+0000", 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152065 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391732+0000", 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5099999999999997e-05 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392906+0000", 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011735719999999999 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392980+0000", 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4116000000000007e-05 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:778 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'4, mlcod=36'2)", 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.583493851999997, 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015037570000000001, 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398686+0000", 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8369999999999999e-06 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398703+0000", 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7363e-05 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398731+0000", 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8367000000000001e-05 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398745+0000", 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.385e-05 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398923+0000", 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177818 2024-09-21T09:11:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398963+0000", 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9867000000000003e-05 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400088+0000", 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011250380000000001 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400188+0000", 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9617000000000005e-05 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:780 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'5, mlcod=36'3)", 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.578647904999997, 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001427673, 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403531+0000", 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6729999999999999e-06 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403568+0000", 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6693000000000003e-05 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403597+0000", 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9130000000000001e-05 2024-09-21T09:11:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403611+0000", 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3643e-05 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403781+0000", 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016968300000000001 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403820+0000", 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9768999999999998e-05 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404868+0000", 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001047493 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404957+0000", 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9588999999999999e-05 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:814 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'7, mlcod=36'5)", 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.496679102999998, 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014758, 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485500+0000", 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.843e-06 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485513+0000", 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2284e-05 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485542+0000", 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9102999999999999e-05 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485555+0000", 2024-09-21T09:11:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.375e-05 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485660+0000", 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104849 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485719+0000", 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8842999999999999e-05 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486885+0000", 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011654250000000001 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486974+0000", 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9703000000000005e-05 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:816 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'8, mlcod=36'6)", 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.493052865000003, 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016647159999999999, 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489127+0000", 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489142+0000", 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5400000000000002e-05 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489177+0000", 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4894000000000002e-05 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489196+0000", 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8873e-05 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489355+0000", 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015918799999999999 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489424+0000", 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8572999999999996e-05 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490705+0000", 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012817079999999999 2024-09-21T09:11:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490789+0000", 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4019999999999999e-05 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:844 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'12, mlcod=36'10)", 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.425874129999997, 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015352059999999999, 2024-09-21T09:11:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556305+0000", 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.73e-06 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556317+0000", 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2233e-05 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556348+0000", 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0176e-05 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556361+0000", 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3694e-05 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556511+0000", 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014973800000000001 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556567+0000", 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6273999999999997e-05 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557740+0000", 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001173065 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557839+0000", 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8295999999999995e-05 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:846 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'13, mlcod=36'11)", 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.422137339000002, 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014368810000000001, 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560042+0000", 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6500000000000001e-06 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560056+0000", 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4233000000000001e-05 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560085+0000", 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8767000000000001e-05 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560098+0000", 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3436e-05 2024-09-21T09:11:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560242+0000", 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000143199 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560305+0000", 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3269999999999996e-05 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561354+0000", 2024-09-21T09:11:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010487630000000001 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561477+0000", 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012356300000000001 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.266550957, 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028068680000000001, 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 910 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715630+0000", 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.92e-06 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715647+0000", 2024-09-21T09:11:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715680+0000", 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3572999999999999e-05 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715696+0000", 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5777000000000002e-05 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715819+0000", 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000122972 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716044+0000", 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022481500000000001 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716365+0000", 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032138400000000003 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.717426+0000", 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001061223 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718214+0000", 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078753099999999995 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718304+0000", 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0426999999999993e-05 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718434+0000", 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012908900000000001 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.262593903999999, 2024-09-21T09:11:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031243310000000002, 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 912 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719585+0000", 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.72e-06 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719597+0000", 2024-09-21T09:11:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1229999999999999e-05 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719621+0000", 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4073000000000001e-05 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719633+0000", 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.259e-05 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719761+0000", 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012745599999999999 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720000+0000", 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023914800000000001 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720482+0000", 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048253400000000001 2024-09-21T09:11:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.721627+0000", 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001145002 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722556+0000", 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092825299999999998 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722640+0000", 2024-09-21T09:11:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4542999999999993e-05 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722708+0000", 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7781999999999996e-05 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.222439667000003, 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014824689999999999, 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759740+0000", 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7370000000000001e-06 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759752+0000", 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2483000000000001e-05 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759782+0000", 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9553e-05 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759798+0000", 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6042999999999999e-05 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759943+0000", 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760001+0000", 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8777000000000003e-05 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761134+0000", 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001132922 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761220+0000", 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6044999999999994e-05 2024-09-21T09:11:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1020 6.10 e45/30 6:0fbdcb32:usage::usage.17:head v 45'5, mlcod=36'3)", 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.9429000480000003, 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001677574, 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039281+0000", 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0939999999999999e-06 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039305+0000", 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3906000000000001e-05 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039349+0000", 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4064999999999999e-05 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039379+0000", 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9889000000000001e-05 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039517+0000", 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013895300000000001 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039574+0000", 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6162000000000002e-05 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040855+0000", 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001281821 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040955+0000", 2024-09-21T09:11:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9684000000000003e-05 2024-09-21T09:11:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.087 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:48.089 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:11:48.089 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:48.084+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:48.189 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:48.188+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:48.252 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:48.252 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:48.252 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:48.253 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:48.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:11:48.291 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:48.290+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:48.392 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:48.388+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:48.443 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:48.443 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:48.443 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:48.443 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:48.443 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:48.460 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:11:48.493 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:48.490+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:48.593 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:48.592+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:48.616 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.840401079999999, 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073206360000000002, 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 5 2024-09-21T09:11:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772825+0000", 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7129999999999999e-06 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772843+0000", 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8033000000000002e-05 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772882+0000", 2024-09-21T09:11:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9434000000000002e-05 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772902+0000", 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0075999999999999e-05 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773008+0000", 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105351 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773016+0000", 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1419999999999993e-06 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776094+0000", 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030782549999999998 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776289+0000", 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019460899999999999 2024-09-21T09:11:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776487+0000", 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000198142 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.778052+0000", 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001565812 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.779852+0000", 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001799171 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780015+0000", 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000162862 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780142+0000", 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012703599999999999 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.837779234999999, 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01128114, 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2024-09-21T09:11:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775446+0000", 2024-09-21T09:11:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775478+0000", 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775525+0000", 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7734000000000001e-05 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775559+0000", 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4133e-05 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775753+0000", 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000193248 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775773+0000", 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0086999999999999e-05 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783330+0000", 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075572979999999996 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783469+0000", 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138839 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783767+0000", 2024-09-21T09:11:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029823499999999999 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.785719+0000", 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00195207 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786427+0000", 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070740099999999997 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786600+0000", 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017295900000000001 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786724+0000", 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012436599999999999 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.772143911999997, 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011832176, 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 43 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841082+0000", 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9870000000000001e-06 2024-09-21T09:11:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841121+0000", 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8593000000000001e-05 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841153+0000", 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2716000000000003e-05 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841179+0000", 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5190000000000001e-05 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841332+0000", 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000153509 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841368+0000", 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6183000000000002e-05 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845655+0000", 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00428642 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845676+0000", 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1687000000000001e-05 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852576+0000", 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0068992860000000001 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852910+0000", 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033460500000000003 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.700161657999999, 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0099467879999999998, 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 214 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913064+0000", 2024-09-21T09:11:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9439999999999998e-06 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913079+0000", 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4966e-05 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913119+0000", 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9297e-05 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913147+0000", 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8776e-05 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913293+0000", 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014535899999999999 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913303+0000", 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0243e-05 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920048+0000", 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067448569999999999 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920345+0000", 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000297454 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920742+0000", 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039676499999999999 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922048+0000", 2024-09-21T09:11:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00130641 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922865+0000", 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081690500000000004 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922947+0000", 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1751999999999999e-05 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923007+0000", 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0059999999999998e-05 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.670293119999997, 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033742799999999999, 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 220 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942931+0000", 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4030000000000001e-06 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942943+0000", 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942976+0000", 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3120000000000001e-05 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942991+0000", 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5376999999999999e-05 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943103+0000", 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011184900000000001 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943318+0000", 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021467900000000001 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943715+0000", 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039689700000000001 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.945217+0000", 2024-09-21T09:11:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001501973 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946150+0000", 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093294700000000005 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946234+0000", 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4425000000000006e-05 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946303+0000", 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9016999999999993e-05 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.651594965999998, 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031516420000000001, 2024-09-21T09:11:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 225 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961629+0000", 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1730000000000002e-06 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961640+0000", 2024-09-21T09:11:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0927000000000001e-05 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961671+0000", 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1032999999999999e-05 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961686+0000", 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5304000000000001e-05 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961813+0000", 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012683900000000001 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962030+0000", 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021637499999999999 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962446+0000", 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041634700000000002 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.963645+0000", 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011985279999999999 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964623+0000", 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000978673 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964713+0000", 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9660000000000006e-05 2024-09-21T09:11:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964779+0000", 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5783000000000004e-05 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:228 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.641283796000003, 2024-09-21T09:11:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032433039999999998, 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 228 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971940+0000", 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1100000000000001e-06 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971951+0000", 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0556e-05 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971982+0000", 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1442999999999997e-05 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971998+0000", 2024-09-21T09:11:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5673000000000001e-05 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972130+0000", 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000132213 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972337+0000", 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020659899999999999 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972731+0000", 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039369699999999998 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.974129+0000", 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013981029999999999 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975031+0000", 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090264399999999997 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975116+0000", 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4616000000000004e-05 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975182+0000", 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5649999999999997e-05 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:11:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.627148607000002, 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030216219999999998, 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 232 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986076+0000", 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3130000000000001e-06 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986087+0000", 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1387e-05 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986118+0000", 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986134+0000", 2024-09-21T09:11:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.524e-05 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986241+0000", 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010744899999999999 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986461+0000", 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021971600000000001 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986879+0000", 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041845000000000001 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988536+0000", 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001657045 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988933+0000", 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695699999999997 2024-09-21T09:11:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989021+0000", 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7947000000000003e-05 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989095+0000", 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3812000000000004e-05 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.620224075000003, 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032333710000000001, 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 234 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993000+0000", 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993011+0000", 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0647e-05 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993040+0000", 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9456999999999999e-05 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993055+0000", 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.485e-05 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993166+0000", 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000110942 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993409+0000", 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242871 2024-09-21T09:11:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993829+0000", 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000420154 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.995035+0000", 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001206295 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996079+0000", 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00104407 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996167+0000", 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7440000000000003e-05 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996231+0000", 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4589000000000001e-05 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.222695297999998, 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029466929999999998, 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 775 2024-09-21T09:11:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390530+0000", 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9270000000000001e-06 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390542+0000", 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2016e-05 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390574+0000", 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2199999999999997e-05 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390589+0000", 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5339999999999999e-05 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390719+0000", 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012939599999999999 2024-09-21T09:11:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390928+0000", 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000209898 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391244+0000", 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031530799999999998 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392535+0000", 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001291008 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393288+0000", 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075327100000000002 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393404+0000", 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011562599999999999 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393473+0000", 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9703000000000007e-05 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:784 6.8 6:1111b601:::obj_delete_at_hint.0000000069:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.200007952999997, 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003135367, 2024-09-21T09:11:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 784 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:11:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413216+0000", 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.784e-06 2024-09-21T09:11:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413225+0000", 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8580000000000006e-06 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413249+0000", 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4212000000000001e-05 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413260+0000", 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1514e-05 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413401+0000", 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014083699999999999 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413625+0000", 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022383099999999999 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413942+0000", 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317375 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.415132+0000", 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001189072 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416200+0000", 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010679979999999999 2024-09-21T09:11:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416282+0000", 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2713999999999994e-05 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416349+0000", 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7172e-05 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.128664858, 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029415460000000002, 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 814 2024-09-21T09:11:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484559+0000", 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484570+0000", 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.098e-05 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484601+0000", 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1062999999999997e-05 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484616+0000", 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4735999999999999e-05 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484747+0000", 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000130729 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484965+0000", 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217982 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485271+0000", 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000306488 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486347+0000", 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010752030000000001 2024-09-21T09:11:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487293+0000", 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094605299999999998 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487379+0000", 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6558999999999996e-05 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487499+0000", 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011955000000000001 2024-09-21T09:11:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.124839215000002, 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029122929999999998, 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 816 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488385+0000", 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8700000000000001e-06 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488395+0000", 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0723000000000001e-05 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488420+0000", 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.508e-05 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488433+0000", 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2317000000000001e-05 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488538+0000", 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105475 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488669+0000", 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000131073 2024-09-21T09:11:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488940+0000", 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027115100000000002 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490015+0000", 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010748159999999999 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491096+0000", 2024-09-21T09:11:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001080733 2024-09-21T09:11:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491179+0000", 2024-09-21T09:11:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2942999999999995e-05 2024-09-21T09:11:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491295+0000", 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116112 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.078869605000001, 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003172818, 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 835 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534355+0000", 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2840000000000001e-06 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534366+0000", 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1396000000000001e-05 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534398+0000", 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1823999999999999e-05 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534413+0000", 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4919999999999999e-05 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534528+0000", 2024-09-21T09:11:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115209 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534749+0000", 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022136500000000001 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.535063+0000", 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031351399999999998 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.536086+0000", 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010234899999999999 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537283+0000", 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011962819999999999 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537407+0000", 2024-09-21T09:11:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123819 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537525+0000", 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118715 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:11:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.057865112999998, 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030129000000000002, 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 844 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555359+0000", 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555369+0000", 2024-09-21T09:11:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0207000000000001e-05 2024-09-21T09:11:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555398+0000", 2024-09-21T09:11:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8822999999999998e-05 2024-09-21T09:11:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555412+0000", 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4443e-05 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555537+0000", 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012447900000000001 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555756+0000", 2024-09-21T09:11:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021879899999999999 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556069+0000", 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031338399999999999 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557174+0000", 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011049860000000001 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558209+0000", 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034653 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558297+0000", 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8446e-05 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558370+0000", 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2700000000000005e-05 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:864 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.011326613000001, 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002853324, 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 864 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601897+0000", 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.61e-06 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601905+0000", 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2470000000000008e-06 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601930+0000", 2024-09-21T09:11:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4885999999999999e-05 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601949+0000", 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9006000000000001e-05 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602078+0000", 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012905600000000001 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602220+0000", 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141586 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602489+0000", 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026938199999999998 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.603606+0000", 2024-09-21T09:11:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011163880000000001 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604600+0000", 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099397700000000005 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604685+0000", 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5740000000000002e-05 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604749+0000", 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3446000000000002e-05 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.890324006, 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031274219999999999, 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 913 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722901+0000", 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722912+0000", 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1693e-05 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722944+0000", 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.222e-05 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722959+0000", 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4902999999999999e-05 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723110+0000", 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015031500000000001 2024-09-21T09:11:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723344+0000", 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000234799 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723667+0000", 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032255100000000002 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.724725+0000", 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010575859999999999 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725873+0000", 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001148579 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725961+0000", 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8063e-05 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.726025+0000", 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4156e-05 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.886216154000003, 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029665730000000001, 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 915 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727008+0000", 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7129999999999999e-06 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727016+0000", 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6600000000000001e-06 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727041+0000", 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5253e-05 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727055+0000", 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3403e-05 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727227+0000", 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017192600000000001 2024-09-21T09:11:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727363+0000", 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013665199999999999 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727627+0000", 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000263565 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.728717+0000", 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001090029 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729815+0000", 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010975099999999999 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729908+0000", 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3029000000000007e-05 2024-09-21T09:11:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729972+0000", 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4832999999999994e-05 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.854879617000002, 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035043000000000001, 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 928 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:11:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758345+0000", 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4339999999999999e-06 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758356+0000", 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1423000000000001e-05 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758389+0000", 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2336999999999999e-05 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758408+0000", 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9706000000000001e-05 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758579+0000", 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017064599999999999 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758939+0000", 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036013000000000001 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759516+0000", 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057737999999999995 2024-09-21T09:11:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760877+0000", 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013600769999999999 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761559+0000", 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068295900000000002 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761727+0000", 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016766900000000001 2024-09-21T09:11:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761847+0000", 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119539 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4216.0:2 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.61479639, 2024-09-21T09:11:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049270260000000001, 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4216", 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/896302906", 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998428+0000", 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998453+0000", 2024-09-21T09:11:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5449e-05 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998478+0000", 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4769e-05 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998502+0000", 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3448999999999999e-05 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998630+0000", 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012872299999999999 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998640+0000", 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9329999999999996e-06 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003282+0000", 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004641816 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003353+0000", 2024-09-21T09:11:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0627e-05 2024-09-21T09:11:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:48.742 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:48.742 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:11:48.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:11:48.745 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:48.740+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:48.845 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:48.842+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:48.881 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:48.882 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:48.882 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:48.882 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:48.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:11:48.945 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:48.944+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:48.955 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:48.978 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:48.978 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:49.008 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:49.033 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:49.033 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:49.046 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:49.044+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:49.053 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:49.069 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:49.070 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:49.072 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:49.072 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:49.084 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:11:49.091 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:49.091 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:49.109 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:49.169 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:49.168+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:49.170 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T09:11:49.211 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:49.211 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:49.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:11:49.248 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:49.244+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:49.349 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:49.346+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:49.354 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:49.354 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:49.369 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:11:49.455 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:49.454+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:49.538 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:49.539 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:49.551 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:49.548+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:49.554 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:11:49.652 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:49.650+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:49.720 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:49.720 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:49.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:11:49.752 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:49.752+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:49.854 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:49.852+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:49.900 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:49.900 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:49.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:11:49.959 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:49.958+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:50.034 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:50.035 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:50.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:11:50.055 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:50.052+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:50.157 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:50.152+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:50.157 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-09-21T09:11:50.225 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:50.225 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:50.240 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:11:50.287 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:50.286+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:50.359 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:50.354+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:50.370 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:50.370 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:50.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:11:50.471 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:50.470+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:50.554 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:50.554 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:50.561 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:50.558+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:50.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:11:50.662 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:50.658+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:50.738 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:50.739 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:50.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:11:50.795 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:50.794+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:50.864 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:50.862+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:50.885 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:50.885 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:50.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:11:50.965 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:50.964+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:51.028 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:51.028 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:51.045 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:11:51.089 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:51.088+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:51.125 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:11:51.166 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:51.162+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:51.239 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:51.239 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:51.259 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:11:51.305 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:51.304+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:51.338 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:51.338 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:51.368 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:51.366+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:51.370 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:51.401 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:51.401 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:51.405 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:51.405 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:51.418 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:11:51.431 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:51.431 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:51.465 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:51.468 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:51.464+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:51.499 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:51.499 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:51.532 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:51.532 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:51.539 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:51.540 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:51.540 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:51.540 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:51.540 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:51.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:11:51.565 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:51.566 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:51.587 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:51.584+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:51.670 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:51.666+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:51.676 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:51.676 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:51.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.776490984999995, 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011873984000000001, 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 87 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.677 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898151+0000", 2024-09-21T09:11:51.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9599999999999999e-07 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898264+0000", 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112509 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898277+0000", 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.38e-05 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898286+0000", 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7299999999999994e-06 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906279+0000", 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079924090000000007 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906410+0000", 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013102900000000001 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906618+0000", 2024-09-21T09:11:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020801500000000001 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909645+0000", 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030275329999999998 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909823+0000", 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017825499999999999 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909906+0000", 2024-09-21T09:11:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2688999999999994e-05 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910024+0000", 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118319 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.776338942999999, 2024-09-21T09:11:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01257903, 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 88 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.569999999999999e-07 2024-09-21T09:11:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898310+0000", 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0360000000000003e-06 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898320+0000", 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0373999999999999e-05 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898327+0000", 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1960000000000002e-06 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908138+0000", 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.009810849 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908334+0000", 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000196059 2024-09-21T09:11:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908540+0000", 2024-09-21T09:11:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000205775 2024-09-21T09:11:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910074+0000", 2024-09-21T09:11:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001534363 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910609+0000", 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053462599999999996 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910764+0000", 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015484599999999999 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910882+0000", 2024-09-21T09:11:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011794900000000001 2024-09-21T09:11:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.600021738999999, 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012244817999999999, 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 110 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7100000000000002e-07 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074625+0000", 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3939999999999998e-06 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074676+0000", 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1369999999999998e-05 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074681+0000", 2024-09-21T09:11:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7690000000000004e-06 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079388+0000", 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047075550000000004 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079454+0000", 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5639e-05 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079548+0000", 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4299e-05 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081984+0000", 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024359239999999999 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086803+0000", 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048185880000000004 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086835+0000", 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2487999999999998e-05 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086865+0000", 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9320999999999999e-05 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.695 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.599950383999996, 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012339861000000001, 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 111 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5900000000000003e-07 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074695+0000", 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4410000000000002e-06 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074707+0000", 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2376e-05 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074711+0000", 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9879999999999998e-06 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079878+0000", 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051667869999999999 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080012+0000", 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013358700000000001 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080288+0000", 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027684299999999998 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081987+0000", 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016981450000000001 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086920+0000", 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049329780000000002 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086966+0000", 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6718999999999998e-05 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.087031+0000", 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4638e-05 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.599919334000006, 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013449694999999999, 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.701 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 112 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5699999999999998e-07 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074789+0000", 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6396000000000006e-05 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074796+0000", 2024-09-21T09:11:51.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0190000000000001e-06 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074802+0000", 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9290000000000003e-06 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080677+0000", 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058755839999999997 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080739+0000", 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1866999999999996e-05 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080833+0000", 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3572000000000005e-05 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083415+0000", 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025824870000000001 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088053+0000", 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004637426 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088105+0000", 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1993000000000002e-05 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088172+0000", 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7064999999999996e-05 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.706 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.599831236, 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013475117999999999, 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 113 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.707 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074811+0000", 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6800000000000001e-07 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074814+0000", 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9919999999999999e-06 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074820+0000", 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5060000000000001e-06 2024-09-21T09:11:51.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074823+0000", 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3289999999999998e-06 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081613+0000", 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006789331 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081666+0000", 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3482000000000001e-05 2024-09-21T09:11:51.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081745+0000", 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8454999999999993e-05 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083786+0000", 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020410850000000002 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088227+0000", 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044407819999999999 2024-09-21T09:11:51.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088260+0000", 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3321000000000002e-05 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088285+0000", 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5466999999999999e-05 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.712 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.599720636000001, 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013454595, 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 114 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074922+0000", 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7100000000000001e-07 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074925+0000", 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8060000000000001e-06 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074933+0000", 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7929999999999998e-06 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074937+0000", 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.749e-06 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082054+0000", 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071175259999999999 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082199+0000", 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014503199999999999 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082445+0000", 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245331 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083789+0000", 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001343943 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088319+0000", 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045298530000000004 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088350+0000", 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1408000000000002e-05 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088375+0000", 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5483e-05 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.599443277999995, 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013331543, 2024-09-21T09:11:51.718 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 115 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075199+0000", 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1699999999999998e-07 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075281+0000", 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2151999999999995e-05 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075291+0000", 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0495e-05 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075298+0000", 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8920000000000003e-06 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082855+0000", 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075570790000000004 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082909+0000", 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3106000000000003e-05 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082988+0000", 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9515e-05 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085228+0000", 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002239736 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088425+0000", 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003197044 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088470+0000", 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5281000000000002e-05 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088530+0000", 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9626000000000001e-05 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.59933178, 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013307090000000001, 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.724 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 116 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.27e-07 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075314+0000", 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4249999999999998e-06 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075318+0000", 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7829999999999998e-06 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075321+0000", 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1370000000000002e-06 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083883+0000", 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0085611369999999999 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083976+0000", 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3492000000000005e-05 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084091+0000", 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114993 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085233+0000", 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011417409999999999 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088565+0000", 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003332532 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088595+0000", 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9675e-05 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088617+0000", 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1747999999999999e-05 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.599314567999997, 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013638091, 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 117 2024-09-21T09:11:51.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.53e-07 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075330+0000", 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.281e-06 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075336+0000", 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7339999999999996e-06 2024-09-21T09:11:51.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075340+0000", 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4010000000000001e-06 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084504+0000", 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091640230000000003 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084560+0000", 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6595000000000003e-05 2024-09-21T09:11:51.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084644+0000", 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3326999999999997e-05 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085387+0000", 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074348199999999995 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088913+0000", 2024-09-21T09:11:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003525855 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088944+0000", 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1621000000000001e-05 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088965+0000", 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0519000000000001e-05 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:132 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.090430717999993, 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013217052999999999, 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 132 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.736 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584212+0000", 2024-09-21T09:11:51.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7700000000000003e-07 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584218+0000", 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584229+0000", 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1046000000000001e-05 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584237+0000", 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0800000000000006e-06 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590506+0000", 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062689440000000003 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590742+0000", 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023612500000000001 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.591121+0000", 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037905099999999999 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593798+0000", 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026770079999999998 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597134+0000", 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033363009999999999 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597279+0000", 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144945 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597428+0000", 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014840599999999999 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:51.741 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.090259611999997, 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013710092, 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 133 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584383+0000", 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1960000000000001e-06 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584391+0000", 2024-09-21T09:11:51.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7239999999999992e-06 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584407+0000", 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6138999999999999e-05 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584416+0000", 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5540000000000003e-06 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592608+0000", 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081912370000000005 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592746+0000", 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138512 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592970+0000", 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022379600000000001 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597628+0000", 2024-09-21T09:11:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046579669999999998 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597829+0000", 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020085599999999999 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597967+0000", 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013828899999999999 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598092+0000", 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012482199999999999 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.090207695999993, 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013969944, 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 134 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1699999999999997e-07 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584594+0000", 2024-09-21T09:11:51.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015906899999999999 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584608+0000", 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.417e-05 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584617+0000", 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2960000000000004e-06 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593907+0000", 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0092901630000000006 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594043+0000", 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013558600000000001 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594285+0000", 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024269499999999999 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597788+0000", 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035024119999999999 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598121+0000", 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033284100000000001 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598256+0000", 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000134816 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598404+0000", 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014817899999999999 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.090006544000005, 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015773928, 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 135 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584636+0000", 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8700000000000004e-07 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584642+0000", 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2099999999999998e-06 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584653+0000", 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536e-05 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584660+0000", 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.627e-06 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595480+0000", 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010820214999999999 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595726+0000", 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245682 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.596110+0000", 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038419799999999998 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600117+0000", 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004006618 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600255+0000", 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013840599999999999 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600346+0000", 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0666000000000002e-05 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600409+0000", 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2883000000000001e-05 2024-09-21T09:11:51.758 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.089968780999996, 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020097924999999999, 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.759 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 136 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000004e-07 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584679+0000", 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6069999999999998e-06 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584694+0000", 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4579999999999999e-05 2024-09-21T09:11:51.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584702+0000", 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0730000000000005e-06 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598512+0000", 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013810578 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598748+0000", 2024-09-21T09:11:51.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000236176 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.599125+0000", 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037634399999999997 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604492+0000", 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053673560000000002 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604613+0000", 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121039 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604703+0000", 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0399e-05 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604771+0000", 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7119999999999994e-05 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.764 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.089927305000003, 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020579828000000001, 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 137 2024-09-21T09:11:51.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584715+0000", 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000005e-07 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584888+0000", 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000173456 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584903+0000", 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.487e-05 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584913+0000", 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9899999999999992e-06 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600531+0000", 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015617987999999999 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600765+0000", 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023383900000000001 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.601148+0000", 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038257100000000001 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604980+0000", 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003832326 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605028+0000", 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8059999999999997e-05 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605166+0000", 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000137959 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605294+0000", 2024-09-21T09:11:51.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012808200000000001 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.089705562999995, 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024357648999999999, 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.771 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 138 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584937+0000", 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.54e-07 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584943+0000", 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6229999999999999e-06 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584959+0000", 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5489999999999999e-05 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584968+0000", 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.516e-06 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.602849+0000", 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017880314000000001 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603120+0000", 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027100799999999999 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603521+0000", 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040112399999999999 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.608899+0000", 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053779300000000004 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609024+0000", 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125699 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609140+0000", 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115982 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609294+0000", 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015310899999999999 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.776 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.089657822999996, 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024897698999999999, 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 139 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.777 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7999999999999995e-07 2024-09-21T09:11:51.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584997+0000", 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2556e-05 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585013+0000", 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5800000000000001e-05 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585021+0000", 2024-09-21T09:11:51.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3340000000000002e-06 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605435+0000", 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020414299 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605604+0000", 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000168615 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605803+0000", 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199256 2024-09-21T09:11:51.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609392+0000", 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035888719999999999 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609598+0000", 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020643500000000001 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609747+0000", 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014889600000000001 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609881+0000", 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013395599999999999 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.089604886999993, 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025121831000000001, 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 140 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5400000000000001e-07 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585185+0000", 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014761900000000001 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585199+0000", 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4450000000000001e-05 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585209+0000", 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2099999999999999e-06 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606615+0000", 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021406261999999999 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606858+0000", 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024295499999999999 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.607232+0000", 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037427700000000001 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609554+0000", 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023222210000000002 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609917+0000", 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036226800000000001 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610051+0000", 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013447599999999999 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610158+0000", 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107439 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.787 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.089416435000004, 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.027901532, 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 141 2024-09-21T09:11:51.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585226+0000", 2024-09-21T09:11:51.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5999999999999991e-07 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585238+0000", 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1717e-05 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585248+0000", 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0776e-05 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585256+0000", 2024-09-21T09:11:51.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8140000000000001e-06 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610278+0000", 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025021297000000001 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610421+0000", 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014358900000000001 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610631+0000", 2024-09-21T09:11:51.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021016900000000001 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612016+0000", 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001385037 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612841+0000", 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082419399999999999 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:51.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612997+0000", 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000156186 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.613127+0000", 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012979300000000001 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:51.793 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:51.795 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:11:51.795 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:51.792+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:51.896 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:51.894+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:51.997 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:51.994+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:52.010 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:52.010 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:52.010 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:52.011 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:52.028 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:11:52.097 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:52.096+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:52.181 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T09:11:52.199 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:52.198+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:52.199 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:52.199 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:52.200 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:52.200 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:52.200 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:52.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:11:52.300 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:52.298+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:52.401 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:52.398+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:52.439 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4358.0:40 5.1c 5:3fce9a59:::zonegroup_info.6661b8ba-4ecc-4129-afb2-8d0efd9659c2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T09:11:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.551002916999998, 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028118549999999998, 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4358", 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3756932968", 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 40 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885826+0000", 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4899999999999999e-06 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885835+0000", 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5299999999999996e-06 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885857+0000", 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1679999999999999e-05 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885871+0000", 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4146e-05 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885969+0000", 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8212000000000001e-05 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886181+0000", 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021209000000000001 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886450+0000", 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026841000000000001 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.887864+0000", 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001414722 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888500+0000", 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063535399999999998 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888562+0000", 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2176999999999998e-05 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888637+0000", 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5043999999999995e-05 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:214 6.1c e36/30 6:3e426232:gc::gc.9:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.515809232000002, 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015590160000000001, 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.13e-07 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921028+0000", 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9639999999999992e-06 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921060+0000", 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1822000000000001e-05 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921076+0000", 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6252999999999998e-05 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921213+0000", 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013652299999999999 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921250+0000", 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7685999999999998e-05 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922504+0000", 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001253185 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922578+0000", 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4070000000000001e-05 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.505620741999998, 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036169079999999998, 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.449 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 217 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931210+0000", 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6529999999999998e-06 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931223+0000", 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3667e-05 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931257+0000", 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3742999999999999e-05 2024-09-21T09:11:52.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931273+0000", 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5366000000000002e-05 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931414+0000", 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136300000000001 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931673+0000", 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025924500000000002 2024-09-21T09:11:52.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.932066+0000", 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0003927 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.933852+0000", 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017863180000000001 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934605+0000", 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075312800000000004 2024-09-21T09:11:52.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934696+0000", 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0328999999999995e-05 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934824+0000", 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128396 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.454 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:229 6.1b e36/30 6:db9d130d:gc::gc.24:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.460173785000002, 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015706159999999999, 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976655+0000", 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8699999999999995e-07 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976661+0000", 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7599999999999997e-06 2024-09-21T09:11:52.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976686+0000", 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4396000000000002e-05 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976699+0000", 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3336000000000001e-05 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976836+0000", 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013669299999999999 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976871+0000", 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4913000000000003e-05 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978136+0000", 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001264851 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978225+0000", 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9179999999999997e-05 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.432442412999997, 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001626368, 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:52.459 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 237 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004389+0000", 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5099999999999999e-06 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004408+0000", 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9154e-05 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004453+0000", 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4385999999999998e-05 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004475+0000", 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2853e-05 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004585+0000", 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000109546 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004656+0000", 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0988999999999994e-05 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:52.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004818+0000", 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016166600000000001 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005536+0000", 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071806799999999998 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005917+0000", 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038119100000000002 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005956+0000", 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9255999999999998e-05 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.006012+0000", 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5748999999999998e-05 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:253 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.428766013999997, 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001548546, 2024-09-21T09:11:52.464 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 253 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008063+0000", 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.263e-06 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008070+0000", 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1369999999999996e-06 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008087+0000", 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6263999999999999e-05 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008096+0000", 2024-09-21T09:11:52.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6670000000000008e-06 2024-09-21T09:11:52.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008178+0000", 2024-09-21T09:11:52.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1644999999999995e-05 2024-09-21T09:11:52.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008240+0000", 2024-09-21T09:11:52.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2453999999999995e-05 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008448+0000", 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020722899999999999 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009447+0000", 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099947600000000001 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009547+0000", 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100268 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009582+0000", 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4459999999999999e-05 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009610+0000", 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8683e-05 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.470 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:709 6.1e e36/30 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.193059425000001, 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015262559999999999, 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243769+0000", 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9999999999999996e-07 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243776+0000", 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0999999999999998e-06 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243790+0000", 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3882e-05 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243800+0000", 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0083e-05 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243943+0000", 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014281799999999999 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243990+0000", 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7157000000000003e-05 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245247+0000", 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012564200000000001 2024-09-21T09:11:52.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245295+0000", 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7895999999999997e-05 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.170167415999998, 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023946290000000001, 2024-09-21T09:11:52.475 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 721 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:52.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266663+0000", 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5289999999999998e-06 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266676+0000", 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.292e-05 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266705+0000", 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8816999999999999e-05 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266732+0000", 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7134000000000001e-05 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266844+0000", 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111848 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267038+0000", 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019389 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267357+0000", 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000319172 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268435+0000", 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010780430000000001 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268984+0000", 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054955599999999998 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269022+0000", 2024-09-21T09:11:52.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7973999999999999e-05 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269055+0000", 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2746000000000001e-05 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.167193122, 2024-09-21T09:11:52.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002147342, 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 723 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:52.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269636+0000", 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4720000000000001e-06 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269645+0000", 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.32e-06 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269667+0000", 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2487999999999999e-05 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269678+0000", 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0794e-05 2024-09-21T09:11:52.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269735+0000", 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269784+0000", 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8266999999999997e-05 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:52.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269905+0000", 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121012 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.270906+0000", 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00100125 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271576+0000", 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066977200000000001 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271666+0000", 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9952999999999997e-05 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271782+0000", 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116469 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.487 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:775 6.1e e36/30 6:7db93595:::obj_delete_at_hint.0000000066:head v 36'5, mlcod=36'3)", 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.045381333999998, 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015332430000000001, 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391448+0000", 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7570000000000001e-06 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391462+0000", 2024-09-21T09:11:52.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3256e-05 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391491+0000", 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9753000000000001e-05 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391515+0000", 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3623999999999999e-05 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391667+0000", 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152065 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391732+0000", 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5099999999999997e-05 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392906+0000", 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011735719999999999 2024-09-21T09:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392980+0000", 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4116000000000007e-05 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:778 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'4, mlcod=36'2)", 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.038144137000003, 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015037570000000001, 2024-09-21T09:11:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398686+0000", 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8369999999999999e-06 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398703+0000", 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7363e-05 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398731+0000", 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8367000000000001e-05 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398745+0000", 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.385e-05 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398923+0000", 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177818 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398963+0000", 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9867000000000003e-05 2024-09-21T09:11:52.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400088+0000", 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011250380000000001 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400188+0000", 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9617000000000005e-05 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.496 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:780 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'5, mlcod=36'3)", 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.033298189999996, 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001427673, 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403531+0000", 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6729999999999999e-06 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403568+0000", 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6693000000000003e-05 2024-09-21T09:11:52.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403597+0000", 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9130000000000001e-05 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403611+0000", 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3643e-05 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403781+0000", 2024-09-21T09:11:52.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016968300000000001 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403820+0000", 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9768999999999998e-05 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404868+0000", 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001047493 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404957+0000", 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9588999999999999e-05 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:814 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'7, mlcod=36'5)", 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.951329387999998, 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014758, 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485500+0000", 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.843e-06 2024-09-21T09:11:52.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485513+0000", 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2284e-05 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485542+0000", 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9102999999999999e-05 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485555+0000", 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.375e-05 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485660+0000", 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104849 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485719+0000", 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8842999999999999e-05 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486885+0000", 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011654250000000001 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486974+0000", 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9703000000000005e-05 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:816 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'8, mlcod=36'6)", 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.947703150000002, 2024-09-21T09:11:52.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016647159999999999, 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489127+0000", 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489142+0000", 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5400000000000002e-05 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489177+0000", 2024-09-21T09:11:52.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4894000000000002e-05 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489196+0000", 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8873e-05 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489355+0000", 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015918799999999999 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489424+0000", 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8572999999999996e-05 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490705+0000", 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012817079999999999 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490789+0000", 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4019999999999999e-05 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.509 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:844 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'12, mlcod=36'10)", 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.880524414999996, 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015352059999999999, 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:52.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556305+0000", 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.73e-06 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556317+0000", 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2233e-05 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556348+0000", 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0176e-05 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556361+0000", 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3694e-05 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556511+0000", 2024-09-21T09:11:52.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014973800000000001 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556567+0000", 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6273999999999997e-05 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557740+0000", 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001173065 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557839+0000", 2024-09-21T09:11:52.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8295999999999995e-05 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:846 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'13, mlcod=36'11)", 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.876787624000002, 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014368810000000001, 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560042+0000", 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6500000000000001e-06 2024-09-21T09:11:52.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560056+0000", 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4233000000000001e-05 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560085+0000", 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8767000000000001e-05 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560098+0000", 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3436e-05 2024-09-21T09:11:52.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560242+0000", 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000143199 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560305+0000", 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3269999999999996e-05 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561354+0000", 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010487630000000001 2024-09-21T09:11:52.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561477+0000", 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012356300000000001 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.721201241999999, 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028068680000000001, 2024-09-21T09:11:52.518 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 910 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715630+0000", 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.92e-06 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715647+0000", 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715680+0000", 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3572999999999999e-05 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715696+0000", 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5777000000000002e-05 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715819+0000", 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000122972 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716044+0000", 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022481500000000001 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716365+0000", 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032138400000000003 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.717426+0000", 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001061223 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718214+0000", 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078753099999999995 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718304+0000", 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0426999999999993e-05 2024-09-21T09:11:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718434+0000", 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012908900000000001 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.717244188999999, 2024-09-21T09:11:52.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031243310000000002, 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 912 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:52.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719585+0000", 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.72e-06 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719597+0000", 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1229999999999999e-05 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719621+0000", 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4073000000000001e-05 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719633+0000", 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.259e-05 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719761+0000", 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012745599999999999 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720000+0000", 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023914800000000001 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720482+0000", 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048253400000000001 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:52.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.721627+0000", 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001145002 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722556+0000", 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092825299999999998 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722640+0000", 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4542999999999993e-05 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722708+0000", 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7781999999999996e-05 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.677089952000003, 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014824689999999999, 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.530 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759740+0000", 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7370000000000001e-06 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759752+0000", 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2483000000000001e-05 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759782+0000", 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9553e-05 2024-09-21T09:11:52.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759798+0000", 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6042999999999999e-05 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759943+0000", 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760001+0000", 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8777000000000003e-05 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761134+0000", 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001132922 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761220+0000", 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6044999999999994e-05 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1020 6.10 e45/30 6:0fbdcb32:usage::usage.17:head v 45'5, mlcod=36'3)", 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.397550333, 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001677574, 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039281+0000", 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0939999999999999e-06 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:52.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039305+0000", 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3906000000000001e-05 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039349+0000", 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4064999999999999e-05 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039379+0000", 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9889000000000001e-05 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:52.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039517+0000", 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013895300000000001 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039574+0000", 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6162000000000002e-05 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040855+0000", 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001281821 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040955+0000", 2024-09-21T09:11:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9684000000000003e-05 2024-09-21T09:11:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:52.539 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:52.540 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:11:52.541 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:52.536+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:52.642 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:52.642+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:52.742 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:52.738+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:52.752 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:52.752 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:52.752 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:52.753 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:52.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:11:52.844 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:52.842+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:52.941 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:52.941 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:52.941 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:52.941 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:52.941 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:52.944 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:52.940+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:52.959 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:11:53.045 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:53.044+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:53.147 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:53.142+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:53.167 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-09-21T09:11:53.173 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:53.173 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:53.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:53.173 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:53.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.173 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-21T09:11:53.173 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:11:53.173 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.397219266999997, 2024-09-21T09:11:53.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073206360000000002, 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 5 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:11:53.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772825+0000", 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7129999999999999e-06 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772843+0000", 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8033000000000002e-05 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772882+0000", 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9434000000000002e-05 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772902+0000", 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0075999999999999e-05 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773008+0000", 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105351 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773016+0000", 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1419999999999993e-06 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776094+0000", 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030782549999999998 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776289+0000", 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019460899999999999 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776487+0000", 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000198142 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.778052+0000", 2024-09-21T09:11:53.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001565812 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.779852+0000", 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001799171 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780015+0000", 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000162862 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780142+0000", 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012703599999999999 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.394597421999997, 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01128114, 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.180 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775446+0000", 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775478+0000", 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775525+0000", 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7734000000000001e-05 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775559+0000", 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4133e-05 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775753+0000", 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000193248 2024-09-21T09:11:53.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775773+0000", 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0086999999999999e-05 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783330+0000", 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075572979999999996 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783469+0000", 2024-09-21T09:11:53.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138839 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783767+0000", 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029823499999999999 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.785719+0000", 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00195207 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786427+0000", 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070740099999999997 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786600+0000", 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017295900000000001 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786724+0000", 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012436599999999999 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.186 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.328962099000002, 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011832176, 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.187 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 43 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:11:53.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841082+0000", 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9870000000000001e-06 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841121+0000", 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8593000000000001e-05 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841153+0000", 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2716000000000003e-05 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841179+0000", 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5190000000000001e-05 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841332+0000", 2024-09-21T09:11:53.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000153509 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841368+0000", 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6183000000000002e-05 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845655+0000", 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00428642 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2024-09-21T09:11:53.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845676+0000", 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1687000000000001e-05 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852576+0000", 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0068992860000000001 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852910+0000", 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033460500000000003 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.192 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.256979844999996, 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0099467879999999998, 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.193 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 214 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913064+0000", 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9439999999999998e-06 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913079+0000", 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4966e-05 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913119+0000", 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9297e-05 2024-09-21T09:11:53.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913147+0000", 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8776e-05 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913293+0000", 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014535899999999999 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913303+0000", 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0243e-05 2024-09-21T09:11:53.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920048+0000", 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067448569999999999 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920345+0000", 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000297454 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920742+0000", 2024-09-21T09:11:53.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039676499999999999 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922048+0000", 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00130641 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922865+0000", 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081690500000000004 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922947+0000", 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1751999999999999e-05 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923007+0000", 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0059999999999998e-05 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:11:53.199 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.227111307000001, 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033742799999999999, 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 220 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:11:53.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942931+0000", 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4030000000000001e-06 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942943+0000", 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942976+0000", 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3120000000000001e-05 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942991+0000", 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5376999999999999e-05 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943103+0000", 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011184900000000001 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943318+0000", 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021467900000000001 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943715+0000", 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039689700000000001 2024-09-21T09:11:53.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.945217+0000", 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001501973 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946150+0000", 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093294700000000005 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946234+0000", 2024-09-21T09:11:53.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4425000000000006e-05 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946303+0000", 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9016999999999993e-05 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.208413153000002, 2024-09-21T09:11:53.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031516420000000001, 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 225 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:11:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961629+0000", 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1730000000000002e-06 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961640+0000", 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0927000000000001e-05 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961671+0000", 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1032999999999999e-05 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961686+0000", 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5304000000000001e-05 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961813+0000", 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012683900000000001 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962030+0000", 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021637499999999999 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962446+0000", 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041634700000000002 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.963645+0000", 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011985279999999999 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964623+0000", 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000978673 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964713+0000", 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9660000000000006e-05 2024-09-21T09:11:53.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964779+0000", 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5783000000000004e-05 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:228 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.198101983000001, 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032433039999999998, 2024-09-21T09:11:53.211 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 228 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971940+0000", 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1100000000000001e-06 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971951+0000", 2024-09-21T09:11:53.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0556e-05 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971982+0000", 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1442999999999997e-05 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971998+0000", 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5673000000000001e-05 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972130+0000", 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000132213 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972337+0000", 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020659899999999999 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972731+0000", 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039369699999999998 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.974129+0000", 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013981029999999999 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975031+0000", 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090264399999999997 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975116+0000", 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4616000000000004e-05 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975182+0000", 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5649999999999997e-05 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.183966794, 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030216219999999998, 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 232 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986076+0000", 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3130000000000001e-06 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986087+0000", 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1387e-05 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986118+0000", 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986134+0000", 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.524e-05 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986241+0000", 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010744899999999999 2024-09-21T09:11:53.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986461+0000", 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021971600000000001 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986879+0000", 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041845000000000001 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988536+0000", 2024-09-21T09:11:53.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001657045 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988933+0000", 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695699999999997 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989021+0000", 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7947000000000003e-05 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989095+0000", 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3812000000000004e-05 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.177042262000001, 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032333710000000001, 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.223 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 234 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:11:53.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993000+0000", 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993011+0000", 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0647e-05 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993040+0000", 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9456999999999999e-05 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993055+0000", 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.485e-05 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993166+0000", 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000110942 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993409+0000", 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242871 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993829+0000", 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000420154 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.995035+0000", 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001206295 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996079+0000", 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00104407 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996167+0000", 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7440000000000003e-05 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996231+0000", 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4589000000000001e-05 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.228 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.779513485000003, 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029466929999999998, 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.229 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 775 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390530+0000", 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9270000000000001e-06 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390542+0000", 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2016e-05 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390574+0000", 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2199999999999997e-05 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390589+0000", 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5339999999999999e-05 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390719+0000", 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012939599999999999 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390928+0000", 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000209898 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391244+0000", 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031530799999999998 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392535+0000", 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001291008 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393288+0000", 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075327100000000002 2024-09-21T09:11:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393404+0000", 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011562599999999999 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393473+0000", 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9703000000000007e-05 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:784 6.8 6:1111b601:::obj_delete_at_hint.0000000069:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.756826140000001, 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003135367, 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 784 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413216+0000", 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.784e-06 2024-09-21T09:11:53.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413225+0000", 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8580000000000006e-06 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413249+0000", 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4212000000000001e-05 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413260+0000", 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1514e-05 2024-09-21T09:11:53.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413401+0000", 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014083699999999999 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413625+0000", 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022383099999999999 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413942+0000", 2024-09-21T09:11:53.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317375 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.415132+0000", 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001189072 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416200+0000", 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010679979999999999 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416282+0000", 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2713999999999994e-05 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416349+0000", 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7172e-05 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:11:53.240 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.685483044999998, 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029415460000000002, 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 814 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484559+0000", 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484570+0000", 2024-09-21T09:11:53.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.098e-05 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484601+0000", 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1062999999999997e-05 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484616+0000", 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4735999999999999e-05 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484747+0000", 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000130729 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484965+0000", 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217982 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485271+0000", 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000306488 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486347+0000", 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010752030000000001 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487293+0000", 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094605299999999998 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487379+0000", 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6558999999999996e-05 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487499+0000", 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011955000000000001 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.681657401999999, 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029122929999999998, 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.246 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 816 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488385+0000", 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8700000000000001e-06 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488395+0000", 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0723000000000001e-05 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488420+0000", 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.508e-05 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488433+0000", 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2317000000000001e-05 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488538+0000", 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105475 2024-09-21T09:11:53.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488669+0000", 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000131073 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488940+0000", 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027115100000000002 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490015+0000", 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010748159999999999 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491096+0000", 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001080733 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491179+0000", 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2942999999999995e-05 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491295+0000", 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116112 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.635687791999999, 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003172818, 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.252 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 835 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:11:53.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534355+0000", 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2840000000000001e-06 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534366+0000", 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1396000000000001e-05 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534398+0000", 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1823999999999999e-05 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534413+0000", 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4919999999999999e-05 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534528+0000", 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115209 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534749+0000", 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022136500000000001 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.535063+0000", 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031351399999999998 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.536086+0000", 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010234899999999999 2024-09-21T09:11:53.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537283+0000", 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011962819999999999 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537407+0000", 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123819 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537525+0000", 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118715 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.614683300000003, 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030129000000000002, 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.258 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 844 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:11:53.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555359+0000", 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555369+0000", 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0207000000000001e-05 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555398+0000", 2024-09-21T09:11:53.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8822999999999998e-05 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555412+0000", 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4443e-05 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555537+0000", 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012447900000000001 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555756+0000", 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021879899999999999 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556069+0000", 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031338399999999999 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557174+0000", 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011049860000000001 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558209+0000", 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034653 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558297+0000", 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8446e-05 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558370+0000", 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2700000000000005e-05 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.263 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:864 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.568144799999999, 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002853324, 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.264 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 864 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601897+0000", 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.61e-06 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601905+0000", 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2470000000000008e-06 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601930+0000", 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4885999999999999e-05 2024-09-21T09:11:53.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601949+0000", 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9006000000000001e-05 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602078+0000", 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012905600000000001 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602220+0000", 2024-09-21T09:11:53.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141586 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602489+0000", 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026938199999999998 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.603606+0000", 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011163880000000001 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604600+0000", 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099397700000000005 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604685+0000", 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5740000000000002e-05 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604749+0000", 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3446000000000002e-05 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.447142192999998, 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031274219999999999, 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.270 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 913 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722901+0000", 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722912+0000", 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1693e-05 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722944+0000", 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.222e-05 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722959+0000", 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4902999999999999e-05 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723110+0000", 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015031500000000001 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723344+0000", 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000234799 2024-09-21T09:11:53.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723667+0000", 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032255100000000002 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.724725+0000", 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010575859999999999 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725873+0000", 2024-09-21T09:11:53.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001148579 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725961+0000", 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8063e-05 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.726025+0000", 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4156e-05 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.443034341000001, 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029665730000000001, 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 915 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727008+0000", 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7129999999999999e-06 2024-09-21T09:11:53.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727016+0000", 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6600000000000001e-06 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727041+0000", 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5253e-05 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727055+0000", 2024-09-21T09:11:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3403e-05 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727227+0000", 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017192600000000001 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727363+0000", 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013665199999999999 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727627+0000", 2024-09-21T09:11:53.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000263565 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.728717+0000", 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001090029 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729815+0000", 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010975099999999999 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729908+0000", 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3029000000000007e-05 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729972+0000", 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4832999999999994e-05 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:11:53.281 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.411697803999999, 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035043000000000001, 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 928 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:11:53.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758345+0000", 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4339999999999999e-06 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758356+0000", 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1423000000000001e-05 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758389+0000", 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2336999999999999e-05 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758408+0000", 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9706000000000001e-05 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758579+0000", 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017064599999999999 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758939+0000", 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036013000000000001 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759516+0000", 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057737999999999995 2024-09-21T09:11:53.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760877+0000", 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013600769999999999 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761559+0000", 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068295900000000002 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761727+0000", 2024-09-21T09:11:53.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016766900000000001 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761847+0000", 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119539 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4216.0:2 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:11:53.287 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.171614577, 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049270260000000001, 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4216", 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/896302906", 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998428+0000", 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998453+0000", 2024-09-21T09:11:53.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5449e-05 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998478+0000", 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4769e-05 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998502+0000", 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3448999999999999e-05 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998630+0000", 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012872299999999999 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998640+0000", 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9329999999999996e-06 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003282+0000", 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004641816 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:53.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:53.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:53.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003353+0000", 2024-09-21T09:11:53.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0627e-05 2024-09-21T09:11:53.292 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.292 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.292 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.292 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:53.292 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:53.292 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:53.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:11:53.295 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:53.294+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:53.394 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:53.392+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:53.428 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:53.429 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:53.429 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:53.429 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:53.443 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:11:53.495 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:53.494+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:53.563 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:11:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:11:53.564 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:53.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:11:53.588 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:11:53.619 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:53.618+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:53.697 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:53.696+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:53.749 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:11:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:11:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.890889858999998, 2024-09-21T09:11:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083044959999999998, 2024-09-21T09:11:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 44 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857525+0000", 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2059999999999999e-06 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857541+0000", 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5826999999999999e-05 2024-09-21T09:11:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857608+0000", 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7353000000000004e-05 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857632+0000", 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3595999999999999e-05 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857842+0000", 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021056800000000001 2024-09-21T09:11:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857863+0000", 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0917e-05 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865509+0000", 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076459040000000002 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865826+0000", 2024-09-21T09:11:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031712500000000002 2024-09-21T09:11:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.876884578000002, 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0108574, 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 206 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:11:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:11:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871530+0000", 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871545+0000", 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4620000000000001e-05 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871584+0000", 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9582999999999997e-05 2024-09-21T09:11:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871602+0000", 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8057e-05 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871776+0000", 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017372500000000001 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871792+0000", 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878149+0000", 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063566910000000003 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878502+0000", 2024-09-21T09:11:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284800000000001 2024-09-21T09:11:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.879223+0000", 2024-09-21T09:11:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072110100000000003 2024-09-21T09:11:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.881741+0000", 2024-09-21T09:11:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025179310000000002 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882232+0000", 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00049132199999999998 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882325+0000", 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2816e-05 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882384+0000", 2024-09-21T09:11:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9509999999999998e-05 2024-09-21T09:11:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:11:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.865652400999998, 2024-09-21T09:11:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032285479999999999, 2024-09-21T09:11:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 207 2024-09-21T09:11:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:11:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:11:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882761+0000", 2024-09-21T09:11:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0729999999999999e-06 2024-09-21T09:11:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882771+0000", 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0287e-05 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882796+0000", 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4873000000000001e-05 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882811+0000", 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4752999999999999e-05 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882904+0000", 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2869999999999997e-05 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883081+0000", 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017743500000000001 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883433+0000", 2024-09-21T09:11:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035207000000000001 2024-09-21T09:11:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.884576+0000", 2024-09-21T09:11:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001142405 2024-09-21T09:11:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885843+0000", 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012676230000000001 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885921+0000", 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7338999999999999e-05 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885988+0000", 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6820000000000001e-05 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.849248985000003, 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033258939999999998, 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 210 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899165+0000", 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3199999999999998e-06 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899176+0000", 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1154e-05 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899209+0000", 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2580000000000003e-05 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899224+0000", 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4976e-05 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899345+0000", 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121296 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899542+0000", 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019720499999999999 2024-09-21T09:11:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899947+0000", 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040540299999999998 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.901475+0000", 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015280319999999999 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902217+0000", 2024-09-21T09:11:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074172400000000003 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902369+0000", 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015137899999999999 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902488+0000", 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119825 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.796352902999999, 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037626880000000001, 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 222 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952061+0000", 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4700000000000001e-06 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952073+0000", 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.155e-05 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952103+0000", 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0716999999999997e-05 2024-09-21T09:11:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952119+0000", 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5613000000000001e-05 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952271+0000", 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015167499999999999 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952654+0000", 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038366399999999998 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.953387+0000", 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073280800000000005 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955064+0000", 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016773000000000001 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955552+0000", 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048774000000000002 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955707+0000", 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154878 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955821+0000", 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114273 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.767362357000003, 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030613469999999999, 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 230 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981052+0000", 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4169999999999999e-06 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981066+0000", 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3933e-05 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981098+0000", 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2023999999999997e-05 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981114+0000", 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6453e-05 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981230+0000", 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116092 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981448+0000", 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021825499999999999 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981870+0000", 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0004214 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.983260+0000", 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013901429999999999 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.983949+0000", 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068917399999999997 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984038+0000", 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9322999999999998e-05 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984111+0000", 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2132999999999995e-05 2024-09-21T09:11:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:11:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.741926943000003, 2024-09-21T09:11:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032388619999999999, 2024-09-21T09:11:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 238 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006487+0000", 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006497+0000", 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0457e-05 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006526+0000", 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8975999999999998e-05 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006547+0000", 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0613000000000001e-05 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006669+0000", 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121896 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006881+0000", 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021207499999999999 2024-09-21T09:11:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.007199+0000", 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031782099999999998 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.008434+0000", 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012349609999999999 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009576+0000", 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001141998 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009661+0000", 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5982000000000004e-05 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009723+0000", 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1940000000000007e-05 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:256 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.737715166000001, 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030661970000000001, 2024-09-21T09:11:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 256 2024-09-21T09:11:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:11:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:11:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010698+0000", 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5740000000000001e-06 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010707+0000", 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3530000000000001e-06 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010735+0000", 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7293000000000001e-05 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010759+0000", 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4054e-05 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010890+0000", 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131822 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.011023+0000", 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132612 2024-09-21T09:11:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.011351+0000", 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032816399999999998 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012826+0000", 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014745820000000001 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013497+0000", 2024-09-21T09:11:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00067147500000000004 2024-09-21T09:11:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013654+0000", 2024-09-21T09:11:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015681199999999999 2024-09-21T09:11:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013763+0000", 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010845600000000001 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:378 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:11:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.703383397000003, 2024-09-21T09:11:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036030390000000002, 2024-09-21T09:11:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 378 2024-09-21T09:11:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045031+0000", 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9859999999999999e-06 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045069+0000", 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7876999999999997e-05 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045123+0000", 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4202e-05 2024-09-21T09:11:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045148+0000", 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4924000000000001e-05 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045310+0000", 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016157899999999999 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045542+0000", 2024-09-21T09:11:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023267399999999999 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045859+0000", 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000316872 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047142+0000", 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001283216 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048468+0000", 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001325534 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048562+0000", 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4015e-05 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048631+0000", 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9159999999999995e-05 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:383 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.701367412000003, 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030650489999999998, 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 383 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047046+0000", 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.306e-06 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047060+0000", 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3716999999999999e-05 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047090+0000", 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9456000000000001e-05 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047138+0000", 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.884e-05 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047236+0000", 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7141999999999999e-05 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047484+0000", 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024807200000000001 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047923+0000", 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043972599999999998 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049320+0000", 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001396883 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049881+0000", 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056092200000000005 2024-09-21T09:11:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049991+0000", 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109709 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.050109+0000", 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118276 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:398 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.696927567000003, 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037105979999999998, 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 398 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051486+0000", 2024-09-21T09:11:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0030000000000001e-06 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051497+0000", 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0957e-05 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051519+0000", 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2263e-05 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051531+0000", 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2306999999999999e-05 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052064+0000", 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00053253199999999995 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052392+0000", 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000327628 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052743+0000", 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035127699999999999 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053814+0000", 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010707049999999999 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055011+0000", 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001197814 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055126+0000", 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114262 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055195+0000", 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8850000000000007e-05 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:405 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.694602584999998, 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033493780000000001, 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 405 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053811+0000", 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7999999999999999e-06 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053823+0000", 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1800000000000001e-05 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053857+0000", 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.464e-05 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053875+0000", 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7479999999999999e-05 2024-09-21T09:11:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054016+0000", 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014128200000000001 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054142+0000", 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012590600000000001 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054426+0000", 2024-09-21T09:11:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028461399999999998 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.056935+0000", 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025088799999999998 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057011+0000", 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6097e-05 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057091+0000", 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9098999999999996e-05 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057158+0000", 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7780000000000005e-05 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:566 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:11:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.613957568000004, 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003214822, 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 566 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:11:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134456+0000", 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1289999999999999e-06 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134467+0000", 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1396999999999999e-05 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134499+0000", 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1111000000000001e-05 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134516+0000", 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7893999999999998e-05 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134669+0000", 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015240100000000001 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.135038+0000", 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036941799999999999 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.135615+0000", 2024-09-21T09:11:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057627500000000001 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137179+0000", 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015641450000000001 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137473+0000", 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029436399999999998 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137562+0000", 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8566000000000006e-05 2024-09-21T09:11:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137669+0000", 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107122 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:603 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.584690803000001, 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030919720000000001, 2024-09-21T09:11:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 603 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163722+0000", 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.513e-06 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163730+0000", 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4930000000000001e-06 2024-09-21T09:11:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163754+0000", 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3900000000000002e-05 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163775+0000", 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1500000000000001e-05 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163914+0000", 2024-09-21T09:11:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013844899999999999 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.164143+0000", 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022904699999999999 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.164616+0000", 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047342400000000001 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166515+0000", 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001898903 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166641+0000", 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125573 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166721+0000", 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0513999999999995e-05 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166813+0000", 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1656000000000005e-05 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.254792076000001, 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031191460000000002, 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 817 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493622+0000", 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6800000000000002e-06 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493633+0000", 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0987e-05 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493665+0000", 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2356e-05 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493680+0000", 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4647000000000001e-05 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493835+0000", 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015487500000000001 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.494066+0000", 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231432 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.494380+0000", 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031386700000000001 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.495603+0000", 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012222940000000001 2024-09-21T09:11:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496574+0000", 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00097185200000000005 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496662+0000", 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7836000000000004e-05 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496739+0000", 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6320000000000001e-05 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.198004046999998, 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030747119999999998, 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 841 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550410+0000", 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3360000000000002e-06 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550421+0000", 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1590000000000001e-05 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550454+0000", 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2206000000000003e-05 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550471+0000", 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7099999999999999e-05 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550621+0000", 2024-09-21T09:11:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015060900000000001 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550830+0000", 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000208428 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.551146+0000", 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031587100000000001 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.552316+0000", 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011707810000000001 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553331+0000", 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010147890000000001 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553416+0000", 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4575999999999998e-05 2024-09-21T09:11:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553482+0000", 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6426000000000004e-05 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.184187184000002, 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002967543, 2024-09-21T09:11:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 847 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564226+0000", 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8560000000000001e-06 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564237+0000", 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0417e-05 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564269+0000", 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2116999999999998e-05 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564284+0000", 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4936000000000001e-05 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564454+0000", 2024-09-21T09:11:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017048500000000001 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564661+0000", 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020732199999999999 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564967+0000", 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030554699999999998 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.566203+0000", 2024-09-21T09:11:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012363039999999999 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567037+0000", 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00083360699999999999 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567123+0000", 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6428999999999995e-05 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567192+0000", 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8522999999999994e-05 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.061020911999996, 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029426840000000001, 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 898 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687393+0000", 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.554e-06 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687405+0000", 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2313000000000001e-05 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687437+0000", 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1325999999999998e-05 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687452+0000", 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5449999999999999e-05 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687601+0000", 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149219 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687842+0000", 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240418 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.688157+0000", 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031470800000000002 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.689278+0000", 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001121768 2024-09-21T09:11:53.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690187+0000", 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090817999999999997 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690267+0000", 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0284999999999994e-05 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690333+0000", 2024-09-21T09:11:53.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6463000000000004e-05 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.038198754, 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031788189999999998, 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.863 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 907 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710215+0000", 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4770000000000002e-06 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710227+0000", 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1293e-05 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710258+0000", 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1585999999999999e-05 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710273+0000", 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5330000000000001e-05 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710423+0000", 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014969199999999999 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710650+0000", 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-21T09:11:53.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710993+0000", 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000342725 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.712231+0000", 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012387800000000001 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713240+0000", 2024-09-21T09:11:53.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001008805 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713327+0000", 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6349999999999998e-05 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713392+0000", 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4953e-05 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.708874532999999, 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032957440000000002, 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1020 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:53.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:53.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039540+0000", 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1499999999999999e-06 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039558+0000", 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7549000000000001e-05 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039596+0000", 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8583e-05 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039615+0000", 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8805e-05 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039759+0000", 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143702 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040000+0000", 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024096600000000001 2024-09-21T09:11:53.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040380+0000", 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038004199999999998 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.041780+0000", 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400625 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042670+0000", 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088968599999999999 2024-09-21T09:11:53.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042760+0000", 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9602e-05 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042833+0000", 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3034000000000006e-05 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:53.874 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:53.875 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:53.876 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:53.876 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:53.877 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:53.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:11:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:53.878 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:53.878 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:53.872+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:53.878 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:53.879 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:53.910 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:53.910 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:53.941 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:53.941 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:53.973 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:53.973 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:53.977 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:53.974+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:54.006 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:54.006 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:54.012 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:54.012 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:54.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:11:54.111 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:54.110+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:54.179 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:54.176+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:54.194 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:54.194 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:54.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:11:54.280 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:54.276+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:54.377 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:54.377 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:54.381 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:54.378+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:54.392 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:11:54.483 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:54.482+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:54.560 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:54.560 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:54.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:11:54.615 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:54.614+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:54.683 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:54.682+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:54.743 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:54.743 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:54.759 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:11:54.807 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:54.806+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:54.884 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:54.880+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:54.937 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:54.937 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:54.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:11:54.995 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:54.994+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:55.079 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:55.079 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:55.086 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:55.084+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:55.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:11:55.187 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:55.186+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:55.264 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:55.264 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:55.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:11:55.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T09:11:55.319 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:55.318+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:55.388 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:55.386+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:55.444 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:55.444 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:55.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:11:55.509 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:55.508+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:55.591 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:55.588+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:55.632 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:55.632 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:55.650 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:11:55.697 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:55.696+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:55.793 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:55.790+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:55.867 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:55.867 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:55.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:11:55.893 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:55.894+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:55.994 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:55.992+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:56.028 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:11:56.056 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:56.056 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:56.078 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:11:56.096 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:56.094+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:56.182 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-09-21T09:11:56.196 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:56.192+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:56.245 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:56.245 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:56.276 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:56.276 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:56.298 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:56.294+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:56.305 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:56.305 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:56.305 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:56.306 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:56.306 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:56.325 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:11:56.337 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:56.338 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:56.371 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:56.371 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:56.399 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:56.396+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:56.405 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:56.405 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:56.439 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:56.439 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:56.472 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:56.472 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:56.508 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:56.509 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:56.509 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:56.509 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:56.509 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:56.509 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:56.508+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:56.526 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:11:56.600 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:56.598+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:56.701 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:56.698+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:56.741 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.840129320000003, 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011873984000000001, 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 87 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898151+0000", 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9599999999999999e-07 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898264+0000", 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112509 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898277+0000", 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.38e-05 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898286+0000", 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7299999999999994e-06 2024-09-21T09:11:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906279+0000", 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079924090000000007 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906410+0000", 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013102900000000001 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906618+0000", 2024-09-21T09:11:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020801500000000001 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909645+0000", 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030275329999999998 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909823+0000", 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017825499999999999 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909906+0000", 2024-09-21T09:11:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2688999999999994e-05 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910024+0000", 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118319 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.839977278000006, 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01257903, 2024-09-21T09:11:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 88 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.569999999999999e-07 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898310+0000", 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0360000000000003e-06 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898320+0000", 2024-09-21T09:11:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0373999999999999e-05 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898327+0000", 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1960000000000002e-06 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908138+0000", 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.009810849 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908334+0000", 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000196059 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908540+0000", 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000205775 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910074+0000", 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001534363 2024-09-21T09:11:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910609+0000", 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053462599999999996 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910764+0000", 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015484599999999999 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910882+0000", 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011794900000000001 2024-09-21T09:11:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.663660074000006, 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012244817999999999, 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 110 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7100000000000002e-07 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074625+0000", 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3939999999999998e-06 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074676+0000", 2024-09-21T09:11:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1369999999999998e-05 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074681+0000", 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7690000000000004e-06 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079388+0000", 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047075550000000004 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079454+0000", 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5639e-05 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079548+0000", 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4299e-05 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081984+0000", 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024359239999999999 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086803+0000", 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048185880000000004 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086835+0000", 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2487999999999998e-05 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086865+0000", 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9320999999999999e-05 2024-09-21T09:11:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.663588719000003, 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012339861000000001, 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 111 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5900000000000003e-07 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074695+0000", 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4410000000000002e-06 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074707+0000", 2024-09-21T09:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2376e-05 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074711+0000", 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9879999999999998e-06 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079878+0000", 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051667869999999999 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080012+0000", 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013358700000000001 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080288+0000", 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027684299999999998 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081987+0000", 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016981450000000001 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086920+0000", 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049329780000000002 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086966+0000", 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6718999999999998e-05 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.087031+0000", 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4638e-05 2024-09-21T09:11:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.663557668999999, 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013449694999999999, 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 112 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5699999999999998e-07 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074789+0000", 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6396000000000006e-05 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074796+0000", 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0190000000000001e-06 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074802+0000", 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9290000000000003e-06 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080677+0000", 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058755839999999997 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080739+0000", 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1866999999999996e-05 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080833+0000", 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3572000000000005e-05 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083415+0000", 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025824870000000001 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088053+0000", 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004637426 2024-09-21T09:11:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088105+0000", 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1993000000000002e-05 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088172+0000", 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7064999999999996e-05 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.663469570999993, 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013475117999999999, 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 113 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074811+0000", 2024-09-21T09:11:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6800000000000001e-07 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074814+0000", 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9919999999999999e-06 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074820+0000", 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5060000000000001e-06 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074823+0000", 2024-09-21T09:11:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3289999999999998e-06 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081613+0000", 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006789331 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081666+0000", 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3482000000000001e-05 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081745+0000", 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8454999999999993e-05 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083786+0000", 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020410850000000002 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088227+0000", 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044407819999999999 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088260+0000", 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3321000000000002e-05 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088285+0000", 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5466999999999999e-05 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.663358970999994, 2024-09-21T09:11:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013454595, 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 114 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074922+0000", 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7100000000000001e-07 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074925+0000", 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8060000000000001e-06 2024-09-21T09:11:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074933+0000", 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7929999999999998e-06 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074937+0000", 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.749e-06 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082054+0000", 2024-09-21T09:11:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071175259999999999 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082199+0000", 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014503199999999999 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082445+0000", 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245331 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083789+0000", 2024-09-21T09:11:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001343943 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088319+0000", 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045298530000000004 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088350+0000", 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1408000000000002e-05 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088375+0000", 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5483e-05 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.663081613000003, 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013331543, 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 115 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:11:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075199+0000", 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1699999999999998e-07 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075281+0000", 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2151999999999995e-05 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075291+0000", 2024-09-21T09:11:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0495e-05 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075298+0000", 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8920000000000003e-06 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082855+0000", 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075570790000000004 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082909+0000", 2024-09-21T09:11:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3106000000000003e-05 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082988+0000", 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9515e-05 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085228+0000", 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002239736 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088425+0000", 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003197044 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088470+0000", 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5281000000000002e-05 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088530+0000", 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9626000000000001e-05 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.662970114999993, 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013307090000000001, 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 116 2024-09-21T09:11:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.27e-07 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075314+0000", 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4249999999999998e-06 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075318+0000", 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7829999999999998e-06 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075321+0000", 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1370000000000002e-06 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083883+0000", 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0085611369999999999 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083976+0000", 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3492000000000005e-05 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084091+0000", 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114993 2024-09-21T09:11:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085233+0000", 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011417409999999999 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088565+0000", 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003332532 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088595+0000", 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9675e-05 2024-09-21T09:11:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088617+0000", 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1747999999999999e-05 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.662952903000004, 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013638091, 2024-09-21T09:11:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 117 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.53e-07 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075330+0000", 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.281e-06 2024-09-21T09:11:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075336+0000", 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7339999999999996e-06 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075340+0000", 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4010000000000001e-06 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084504+0000", 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091640230000000003 2024-09-21T09:11:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084560+0000", 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6595000000000003e-05 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084644+0000", 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3326999999999997e-05 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085387+0000", 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074348199999999995 2024-09-21T09:11:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088913+0000", 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003525855 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088944+0000", 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1621000000000001e-05 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088965+0000", 2024-09-21T09:11:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0519000000000001e-05 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:132 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.154069053000001, 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013217052999999999, 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 132 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584212+0000", 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7700000000000003e-07 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584218+0000", 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584229+0000", 2024-09-21T09:11:56.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1046000000000001e-05 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584237+0000", 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0800000000000006e-06 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590506+0000", 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062689440000000003 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590742+0000", 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023612500000000001 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.591121+0000", 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037905099999999999 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593798+0000", 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026770079999999998 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597134+0000", 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033363009999999999 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597279+0000", 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144945 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597428+0000", 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014840599999999999 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.153897947000004, 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013710092, 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 133 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584383+0000", 2024-09-21T09:11:56.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1960000000000001e-06 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584391+0000", 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7239999999999992e-06 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584407+0000", 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6138999999999999e-05 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584416+0000", 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5540000000000003e-06 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592608+0000", 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081912370000000005 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592746+0000", 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138512 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592970+0000", 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022379600000000001 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597628+0000", 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046579669999999998 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597829+0000", 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020085599999999999 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597967+0000", 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013828899999999999 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598092+0000", 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012482199999999999 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.153846031, 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013969944, 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 134 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1699999999999997e-07 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584594+0000", 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015906899999999999 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584608+0000", 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.417e-05 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584617+0000", 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2960000000000004e-06 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593907+0000", 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0092901630000000006 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594043+0000", 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013558600000000001 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594285+0000", 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024269499999999999 2024-09-21T09:11:56.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597788+0000", 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035024119999999999 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598121+0000", 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033284100000000001 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598256+0000", 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000134816 2024-09-21T09:11:56.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598404+0000", 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014817899999999999 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.153644878999998, 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015773928, 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 135 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584636+0000", 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8700000000000004e-07 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584642+0000", 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2099999999999998e-06 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584653+0000", 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536e-05 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584660+0000", 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.627e-06 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595480+0000", 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010820214999999999 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595726+0000", 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245682 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.596110+0000", 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038419799999999998 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600117+0000", 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004006618 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600255+0000", 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013840599999999999 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600346+0000", 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0666000000000002e-05 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600409+0000", 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2883000000000001e-05 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.821 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.153607116000003, 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020097924999999999, 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.822 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 136 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000004e-07 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584679+0000", 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6069999999999998e-06 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584694+0000", 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4579999999999999e-05 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584702+0000", 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0730000000000005e-06 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598512+0000", 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013810578 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598748+0000", 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000236176 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.599125+0000", 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037634399999999997 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604492+0000", 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053673560000000002 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604613+0000", 2024-09-21T09:11:56.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121039 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604703+0000", 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0399e-05 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604771+0000", 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7119999999999994e-05 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.153565639999997, 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020579828000000001, 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 137 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584715+0000", 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000005e-07 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584888+0000", 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000173456 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584903+0000", 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.487e-05 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584913+0000", 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9899999999999992e-06 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600531+0000", 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015617987999999999 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600765+0000", 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023383900000000001 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.601148+0000", 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038257100000000001 2024-09-21T09:11:56.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604980+0000", 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003832326 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605028+0000", 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8059999999999997e-05 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605166+0000", 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000137959 2024-09-21T09:11:56.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605294+0000", 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012808200000000001 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.153343898000003, 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024357648999999999, 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 138 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584937+0000", 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.54e-07 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584943+0000", 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6229999999999999e-06 2024-09-21T09:11:56.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584959+0000", 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5489999999999999e-05 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584968+0000", 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.516e-06 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.602849+0000", 2024-09-21T09:11:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017880314000000001 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603120+0000", 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027100799999999999 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603521+0000", 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040112399999999999 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.608899+0000", 2024-09-21T09:11:56.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053779300000000004 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609024+0000", 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125699 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609140+0000", 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115982 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609294+0000", 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015310899999999999 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.153296158000003, 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024897698999999999, 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.839 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 139 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:56.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7999999999999995e-07 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584997+0000", 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2556e-05 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585013+0000", 2024-09-21T09:11:56.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5800000000000001e-05 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585021+0000", 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3340000000000002e-06 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605435+0000", 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020414299 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605604+0000", 2024-09-21T09:11:56.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000168615 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605803+0000", 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199256 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609392+0000", 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035888719999999999 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609598+0000", 2024-09-21T09:11:56.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020643500000000001 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609747+0000", 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014889600000000001 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609881+0000", 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013395599999999999 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.153243222, 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025121831000000001, 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 140 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5400000000000001e-07 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585185+0000", 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014761900000000001 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585199+0000", 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4450000000000001e-05 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585209+0000", 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2099999999999999e-06 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606615+0000", 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021406261999999999 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606858+0000", 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024295499999999999 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.607232+0000", 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037427700000000001 2024-09-21T09:11:56.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609554+0000", 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023222210000000002 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609917+0000", 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036226800000000001 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610051+0000", 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013447599999999999 2024-09-21T09:11:56.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610158+0000", 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107439 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.153054769999997, 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.027901532, 2024-09-21T09:11:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 141 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585226+0000", 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5999999999999991e-07 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585238+0000", 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1717e-05 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585248+0000", 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0776e-05 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585256+0000", 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8140000000000001e-06 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610278+0000", 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025021297000000001 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610421+0000", 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014358900000000001 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610631+0000", 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021016900000000001 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612016+0000", 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001385037 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612841+0000", 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082419399999999999 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612997+0000", 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000156186 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.613127+0000", 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012979300000000001 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.855 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:56.856 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:56.856 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:56.857 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:11:56.857 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:56.854+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:56.958 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:56.954+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:57.030 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:57.030 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:57.030 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:57.030 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:57.049 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:11:57.058 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:57.054+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:57.159 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:57.156+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:57.221 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:57.221 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:57.221 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:57.221 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:57.221 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:57.239 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:11:57.260 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:57.258+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:57.360 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:57.356+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:57.453 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4358.0:40 5.1c 5:3fce9a59:::zonegroup_info.6661b8ba-4ecc-4129-afb2-8d0efd9659c2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.565524830000001, 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028118549999999998, 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4358", 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3756932968", 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 40 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885826+0000", 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4899999999999999e-06 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885835+0000", 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5299999999999996e-06 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885857+0000", 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1679999999999999e-05 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885871+0000", 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4146e-05 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885969+0000", 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8212000000000001e-05 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886181+0000", 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021209000000000001 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886450+0000", 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026841000000000001 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.887864+0000", 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001414722 2024-09-21T09:11:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888500+0000", 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063535399999999998 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888562+0000", 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2176999999999998e-05 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888637+0000", 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5043999999999995e-05 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:214 6.1c e36/30 6:3e426232:gc::gc.9:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.530331144999998, 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015590160000000001, 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:11:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.13e-07 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921028+0000", 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9639999999999992e-06 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921060+0000", 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1822000000000001e-05 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921076+0000", 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6252999999999998e-05 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921213+0000", 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013652299999999999 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921250+0000", 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7685999999999998e-05 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922504+0000", 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001253185 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922578+0000", 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4070000000000001e-05 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.520142655000001, 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036169079999999998, 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 217 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931210+0000", 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6529999999999998e-06 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931223+0000", 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3667e-05 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931257+0000", 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3742999999999999e-05 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931273+0000", 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5366000000000002e-05 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931414+0000", 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136300000000001 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931673+0000", 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025924500000000002 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.932066+0000", 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0003927 2024-09-21T09:11:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.933852+0000", 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017863180000000001 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934605+0000", 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075312800000000004 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934696+0000", 2024-09-21T09:11:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0328999999999995e-05 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934824+0000", 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128396 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:229 6.1b e36/30 6:db9d130d:gc::gc.24:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.474695697999998, 2024-09-21T09:11:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015706159999999999, 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:11:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976655+0000", 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8699999999999995e-07 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976661+0000", 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7599999999999997e-06 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976686+0000", 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4396000000000002e-05 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976699+0000", 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3336000000000001e-05 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976836+0000", 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013669299999999999 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976871+0000", 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4913000000000003e-05 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978136+0000", 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001264851 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978225+0000", 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9179999999999997e-05 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.446964326, 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001626368, 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 237 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004389+0000", 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5099999999999999e-06 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004408+0000", 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9154e-05 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004453+0000", 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4385999999999998e-05 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004475+0000", 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2853e-05 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004585+0000", 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000109546 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004656+0000", 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0988999999999994e-05 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004818+0000", 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016166600000000001 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005536+0000", 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071806799999999998 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005917+0000", 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038119100000000002 2024-09-21T09:11:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005956+0000", 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9255999999999998e-05 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.006012+0000", 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5748999999999998e-05 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:253 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.443287927, 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001548546, 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 253 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008063+0000", 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.263e-06 2024-09-21T09:11:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008070+0000", 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1369999999999996e-06 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008087+0000", 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6263999999999999e-05 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008096+0000", 2024-09-21T09:11:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6670000000000008e-06 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008178+0000", 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1644999999999995e-05 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008240+0000", 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2453999999999995e-05 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008448+0000", 2024-09-21T09:11:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020722899999999999 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009447+0000", 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099947600000000001 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009547+0000", 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100268 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009582+0000", 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4459999999999999e-05 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009610+0000", 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8683e-05 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:709 6.1e e36/30 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 36'1, mlcod=0'0)", 2024-09-21T09:11:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.207581337999997, 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015262559999999999, 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243769+0000", 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9999999999999996e-07 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243776+0000", 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0999999999999998e-06 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243790+0000", 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3882e-05 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243800+0000", 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0083e-05 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243943+0000", 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014281799999999999 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243990+0000", 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7157000000000003e-05 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245247+0000", 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012564200000000001 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245295+0000", 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7895999999999997e-05 2024-09-21T09:11:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.184689329000001, 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023946290000000001, 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 721 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266663+0000", 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5289999999999998e-06 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266676+0000", 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.292e-05 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266705+0000", 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8816999999999999e-05 2024-09-21T09:11:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266732+0000", 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7134000000000001e-05 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266844+0000", 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111848 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267038+0000", 2024-09-21T09:11:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019389 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267357+0000", 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000319172 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268435+0000", 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010780430000000001 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268984+0000", 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054955599999999998 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269022+0000", 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7973999999999999e-05 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269055+0000", 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2746000000000001e-05 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.181715035000003, 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002147342, 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 723 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269636+0000", 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4720000000000001e-06 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269645+0000", 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.32e-06 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269667+0000", 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2487999999999999e-05 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269678+0000", 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0794e-05 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269735+0000", 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269784+0000", 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8266999999999997e-05 2024-09-21T09:11:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269905+0000", 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121012 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.270906+0000", 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00100125 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271576+0000", 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066977200000000001 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271666+0000", 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9952999999999997e-05 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271782+0000", 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116469 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:775 6.1e e36/30 6:7db93595:::obj_delete_at_hint.0000000066:head v 36'5, mlcod=36'3)", 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.059903247000001, 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015332430000000001, 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:11:57.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391448+0000", 2024-09-21T09:11:57.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7570000000000001e-06 2024-09-21T09:11:57.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391462+0000", 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3256e-05 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391491+0000", 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9753000000000001e-05 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391515+0000", 2024-09-21T09:11:57.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3623999999999999e-05 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391667+0000", 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152065 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391732+0000", 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5099999999999997e-05 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392906+0000", 2024-09-21T09:11:57.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011735719999999999 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392980+0000", 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4116000000000007e-05 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:778 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'4, mlcod=36'2)", 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.052666049999999, 2024-09-21T09:11:57.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015037570000000001, 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398686+0000", 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8369999999999999e-06 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398703+0000", 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7363e-05 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398731+0000", 2024-09-21T09:11:57.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8367000000000001e-05 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398745+0000", 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.385e-05 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398923+0000", 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177818 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398963+0000", 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9867000000000003e-05 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400088+0000", 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011250380000000001 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400188+0000", 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9617000000000005e-05 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.512 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:780 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'5, mlcod=36'3)", 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.047820102999999, 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001427673, 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403531+0000", 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6729999999999999e-06 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403568+0000", 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6693000000000003e-05 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403597+0000", 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9130000000000001e-05 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403611+0000", 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3643e-05 2024-09-21T09:11:57.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403781+0000", 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016968300000000001 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403820+0000", 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9768999999999998e-05 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404868+0000", 2024-09-21T09:11:57.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001047493 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404957+0000", 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9588999999999999e-05 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:814 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'7, mlcod=36'5)", 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.965851301000001, 2024-09-21T09:11:57.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014758, 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485500+0000", 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.843e-06 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485513+0000", 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2284e-05 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485542+0000", 2024-09-21T09:11:57.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9102999999999999e-05 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485555+0000", 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.375e-05 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485660+0000", 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104849 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485719+0000", 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8842999999999999e-05 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486885+0000", 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011654250000000001 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486974+0000", 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9703000000000005e-05 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.521 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:816 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'8, mlcod=36'6)", 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.962225062999998, 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016647159999999999, 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489127+0000", 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489142+0000", 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5400000000000002e-05 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489177+0000", 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4894000000000002e-05 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489196+0000", 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8873e-05 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489355+0000", 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015918799999999999 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489424+0000", 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8572999999999996e-05 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490705+0000", 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012817079999999999 2024-09-21T09:11:57.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490789+0000", 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4019999999999999e-05 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:844 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'12, mlcod=36'10)", 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.895046327999999, 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015352059999999999, 2024-09-21T09:11:57.526 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556305+0000", 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.73e-06 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556317+0000", 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2233e-05 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556348+0000", 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0176e-05 2024-09-21T09:11:57.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556361+0000", 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3694e-05 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556511+0000", 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014973800000000001 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556567+0000", 2024-09-21T09:11:57.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6273999999999997e-05 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557740+0000", 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001173065 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557839+0000", 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8295999999999995e-05 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:846 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'13, mlcod=36'11)", 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.891309536999998, 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014368810000000001, 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560042+0000", 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6500000000000001e-06 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560056+0000", 2024-09-21T09:11:57.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4233000000000001e-05 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560085+0000", 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8767000000000001e-05 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560098+0000", 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3436e-05 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560242+0000", 2024-09-21T09:11:57.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000143199 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560305+0000", 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3269999999999996e-05 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561354+0000", 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010487630000000001 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561477+0000", 2024-09-21T09:11:57.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012356300000000001 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.735723155000002, 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028068680000000001, 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:57.535 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 910 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715630+0000", 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.92e-06 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715647+0000", 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715680+0000", 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3572999999999999e-05 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715696+0000", 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5777000000000002e-05 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715819+0000", 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000122972 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716044+0000", 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022481500000000001 2024-09-21T09:11:57.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716365+0000", 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032138400000000003 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.717426+0000", 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001061223 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718214+0000", 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078753099999999995 2024-09-21T09:11:57.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718304+0000", 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0426999999999993e-05 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718434+0000", 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012908900000000001 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.731766102000002, 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031243310000000002, 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 912 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719585+0000", 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.72e-06 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719597+0000", 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1229999999999999e-05 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719621+0000", 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4073000000000001e-05 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719633+0000", 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.259e-05 2024-09-21T09:11:57.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719761+0000", 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012745599999999999 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720000+0000", 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023914800000000001 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720482+0000", 2024-09-21T09:11:57.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048253400000000001 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.721627+0000", 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001145002 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722556+0000", 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092825299999999998 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722640+0000", 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4542999999999993e-05 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722708+0000", 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7781999999999996e-05 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:57.546 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.691611864999999, 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014824689999999999, 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759740+0000", 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7370000000000001e-06 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759752+0000", 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2483000000000001e-05 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759782+0000", 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9553e-05 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759798+0000", 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6042999999999999e-05 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759943+0000", 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760001+0000", 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8777000000000003e-05 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761134+0000", 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001132922 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761220+0000", 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6044999999999994e-05 2024-09-21T09:11:57.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1020 6.10 e45/30 6:0fbdcb32:usage::usage.17:head v 45'5, mlcod=36'3)", 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.412072246000001, 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001677574, 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039281+0000", 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0939999999999999e-06 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039305+0000", 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3906000000000001e-05 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039349+0000", 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4064999999999999e-05 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039379+0000", 2024-09-21T09:11:57.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9889000000000001e-05 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039517+0000", 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013895300000000001 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039574+0000", 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6162000000000002e-05 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040855+0000", 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001281821 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040955+0000", 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9684000000000003e-05 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:57.555 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:57.557 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:11:57.557 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:57.554+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:57.657 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:57.654+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:57.758 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:57.756+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:57.770 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:57.770 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:57.770 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:11:57.770 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:57.788 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:11:57.859 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:57.858+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:57.960 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:11:57.958+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:11:58.001 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:58.002 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:11:58.002 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:11:58.002 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:11:58.002 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:58.021 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:11:58.061 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:58.058+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:58.162 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:58.158+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:58.194 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:11:58.194 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:11:58.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:11:58.194 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:11:58.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.194 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-21T09:11:58.194 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:11:58.194 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.418412946999993, 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073206360000000002, 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 5 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:11:58.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772825+0000", 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7129999999999999e-06 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772843+0000", 2024-09-21T09:11:58.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8033000000000002e-05 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772882+0000", 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9434000000000002e-05 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772902+0000", 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0075999999999999e-05 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773008+0000", 2024-09-21T09:11:58.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105351 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773016+0000", 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1419999999999993e-06 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776094+0000", 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030782549999999998 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776289+0000", 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019460899999999999 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776487+0000", 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000198142 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.778052+0000", 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001565812 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.779852+0000", 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001799171 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780015+0000", 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000162862 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780142+0000", 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012703599999999999 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.200 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.415791102, 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01128114, 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2024-09-21T09:11:58.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775446+0000", 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775478+0000", 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775525+0000", 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7734000000000001e-05 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775559+0000", 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4133e-05 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775753+0000", 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000193248 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775773+0000", 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0086999999999999e-05 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783330+0000", 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075572979999999996 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783469+0000", 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138839 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783767+0000", 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029823499999999999 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.785719+0000", 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00195207 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786427+0000", 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070740099999999997 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786600+0000", 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017295900000000001 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786724+0000", 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012436599999999999 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.350155778999998, 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011832176, 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.207 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 43 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841082+0000", 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9870000000000001e-06 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841121+0000", 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8593000000000001e-05 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841153+0000", 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2716000000000003e-05 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841179+0000", 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5190000000000001e-05 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841332+0000", 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000153509 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841368+0000", 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6183000000000002e-05 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845655+0000", 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00428642 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845676+0000", 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1687000000000001e-05 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852576+0000", 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0068992860000000001 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852910+0000", 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033460500000000003 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.212 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.278173525, 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0099467879999999998, 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 214 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913064+0000", 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9439999999999998e-06 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913079+0000", 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4966e-05 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913119+0000", 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9297e-05 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913147+0000", 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8776e-05 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913293+0000", 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014535899999999999 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913303+0000", 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0243e-05 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920048+0000", 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067448569999999999 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920345+0000", 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000297454 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920742+0000", 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039676499999999999 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922048+0000", 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00130641 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922865+0000", 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081690500000000004 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922947+0000", 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1751999999999999e-05 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923007+0000", 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0059999999999998e-05 2024-09-21T09:11:58.218 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.248304986999997, 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033742799999999999, 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.219 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 220 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942931+0000", 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4030000000000001e-06 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942943+0000", 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942976+0000", 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3120000000000001e-05 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942991+0000", 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5376999999999999e-05 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943103+0000", 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011184900000000001 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943318+0000", 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021467900000000001 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943715+0000", 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039689700000000001 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.945217+0000", 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001501973 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946150+0000", 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093294700000000005 2024-09-21T09:11:58.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946234+0000", 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4425000000000006e-05 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946303+0000", 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9016999999999993e-05 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.229606832999998, 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031516420000000001, 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 225 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961629+0000", 2024-09-21T09:11:58.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1730000000000002e-06 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961640+0000", 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0927000000000001e-05 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961671+0000", 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1032999999999999e-05 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961686+0000", 2024-09-21T09:11:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5304000000000001e-05 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961813+0000", 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012683900000000001 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962030+0000", 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021637499999999999 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962446+0000", 2024-09-21T09:11:58.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041634700000000002 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.963645+0000", 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011985279999999999 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964623+0000", 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000978673 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964713+0000", 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9660000000000006e-05 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964779+0000", 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5783000000000004e-05 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:228 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:11:58.230 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.219295662999997, 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032433039999999998, 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 228 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971940+0000", 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1100000000000001e-06 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971951+0000", 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0556e-05 2024-09-21T09:11:58.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971982+0000", 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1442999999999997e-05 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971998+0000", 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5673000000000001e-05 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972130+0000", 2024-09-21T09:11:58.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000132213 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972337+0000", 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020659899999999999 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972731+0000", 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039369699999999998 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.974129+0000", 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013981029999999999 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975031+0000", 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090264399999999997 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975116+0000", 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4616000000000004e-05 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975182+0000", 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5649999999999997e-05 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.205160474000003, 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030216219999999998, 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 232 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:11:58.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986076+0000", 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3130000000000001e-06 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986087+0000", 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1387e-05 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986118+0000", 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986134+0000", 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.524e-05 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986241+0000", 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010744899999999999 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986461+0000", 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021971600000000001 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986879+0000", 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041845000000000001 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988536+0000", 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001657045 2024-09-21T09:11:58.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988933+0000", 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695699999999997 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989021+0000", 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7947000000000003e-05 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989095+0000", 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3812000000000004e-05 2024-09-21T09:11:58.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.198235941999997, 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032333710000000001, 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.242 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 234 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993000+0000", 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993011+0000", 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0647e-05 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993040+0000", 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9456999999999999e-05 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993055+0000", 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.485e-05 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993166+0000", 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000110942 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993409+0000", 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242871 2024-09-21T09:11:58.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993829+0000", 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000420154 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.995035+0000", 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001206295 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996079+0000", 2024-09-21T09:11:58.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00104407 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996167+0000", 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7440000000000003e-05 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996231+0000", 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4589000000000001e-05 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.800707164999999, 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029466929999999998, 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 775 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.248 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390530+0000", 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9270000000000001e-06 2024-09-21T09:11:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390542+0000", 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2016e-05 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390574+0000", 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2199999999999997e-05 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390589+0000", 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5339999999999999e-05 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390719+0000", 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012939599999999999 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390928+0000", 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000209898 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391244+0000", 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031530799999999998 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392535+0000", 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001291008 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393288+0000", 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075327100000000002 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393404+0000", 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011562599999999999 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393473+0000", 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9703000000000007e-05 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:784 6.8 6:1111b601:::obj_delete_at_hint.0000000069:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:11:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.778019819999997, 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003135367, 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 784 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413216+0000", 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.784e-06 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413225+0000", 2024-09-21T09:11:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8580000000000006e-06 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413249+0000", 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4212000000000001e-05 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413260+0000", 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1514e-05 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413401+0000", 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014083699999999999 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413625+0000", 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022383099999999999 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413942+0000", 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317375 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.415132+0000", 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001189072 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416200+0000", 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010679979999999999 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416282+0000", 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2713999999999994e-05 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416349+0000", 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7172e-05 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.706676725000001, 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029415460000000002, 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 814 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484559+0000", 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484570+0000", 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.098e-05 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484601+0000", 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1062999999999997e-05 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484616+0000", 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4735999999999999e-05 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484747+0000", 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000130729 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484965+0000", 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217982 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485271+0000", 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000306488 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486347+0000", 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010752030000000001 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487293+0000", 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094605299999999998 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487379+0000", 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6558999999999996e-05 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487499+0000", 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011955000000000001 2024-09-21T09:11:58.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.702851082000002, 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029122929999999998, 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.265 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 816 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488385+0000", 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8700000000000001e-06 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488395+0000", 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0723000000000001e-05 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488420+0000", 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.508e-05 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488433+0000", 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2317000000000001e-05 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488538+0000", 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105475 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488669+0000", 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000131073 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488940+0000", 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027115100000000002 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490015+0000", 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010748159999999999 2024-09-21T09:11:58.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491096+0000", 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001080733 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491179+0000", 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2942999999999995e-05 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491295+0000", 2024-09-21T09:11:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116112 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.656881472000002, 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003172818, 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.271 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 835 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:11:58.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534355+0000", 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2840000000000001e-06 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534366+0000", 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1396000000000001e-05 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534398+0000", 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1823999999999999e-05 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534413+0000", 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4919999999999999e-05 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534528+0000", 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115209 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534749+0000", 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022136500000000001 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.535063+0000", 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031351399999999998 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.536086+0000", 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010234899999999999 2024-09-21T09:11:58.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537283+0000", 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011962819999999999 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537407+0000", 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123819 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537525+0000", 2024-09-21T09:11:58.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118715 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.635876979999999, 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030129000000000002, 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 844 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555359+0000", 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555369+0000", 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0207000000000001e-05 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555398+0000", 2024-09-21T09:11:58.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8822999999999998e-05 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555412+0000", 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4443e-05 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555537+0000", 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012447900000000001 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555756+0000", 2024-09-21T09:11:58.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021879899999999999 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556069+0000", 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031338399999999999 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557174+0000", 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011049860000000001 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558209+0000", 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034653 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558297+0000", 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8446e-05 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558370+0000", 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2700000000000005e-05 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:864 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.589338480000002, 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002853324, 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 864 2024-09-21T09:11:58.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601897+0000", 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.61e-06 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601905+0000", 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2470000000000008e-06 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601930+0000", 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4885999999999999e-05 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601949+0000", 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9006000000000001e-05 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602078+0000", 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012905600000000001 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602220+0000", 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141586 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602489+0000", 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026938199999999998 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.603606+0000", 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011163880000000001 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604600+0000", 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099397700000000005 2024-09-21T09:11:58.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604685+0000", 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5740000000000002e-05 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604749+0000", 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3446000000000002e-05 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.468335873000001, 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031274219999999999, 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 913 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722901+0000", 2024-09-21T09:11:58.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722912+0000", 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1693e-05 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722944+0000", 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.222e-05 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722959+0000", 2024-09-21T09:11:58.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4902999999999999e-05 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723110+0000", 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015031500000000001 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723344+0000", 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000234799 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:58.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723667+0000", 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032255100000000002 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.724725+0000", 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010575859999999999 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725873+0000", 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001148579 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725961+0000", 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8063e-05 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.726025+0000", 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4156e-05 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:11:58.294 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.464228020999997, 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029665730000000001, 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 915 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:11:58.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727008+0000", 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7129999999999999e-06 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727016+0000", 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6600000000000001e-06 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727041+0000", 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5253e-05 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727055+0000", 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3403e-05 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727227+0000", 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017192600000000001 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727363+0000", 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013665199999999999 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727627+0000", 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000263565 2024-09-21T09:11:58.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.728717+0000", 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001090029 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729815+0000", 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010975099999999999 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729908+0000", 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3029000000000007e-05 2024-09-21T09:11:58.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729972+0000", 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4832999999999994e-05 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.432891484000002, 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035043000000000001, 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 928 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758345+0000", 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4339999999999999e-06 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758356+0000", 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1423000000000001e-05 2024-09-21T09:11:58.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758389+0000", 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2336999999999999e-05 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758408+0000", 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9706000000000001e-05 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758579+0000", 2024-09-21T09:11:58.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017064599999999999 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758939+0000", 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036013000000000001 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759516+0000", 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057737999999999995 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760877+0000", 2024-09-21T09:11:58.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013600769999999999 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761559+0000", 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068295900000000002 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761727+0000", 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016766900000000001 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761847+0000", 2024-09-21T09:11:58.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119539 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4216.0:2 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.192808256999999, 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049270260000000001, 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:11:58.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4216", 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/896302906", 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:11:58.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998428+0000", 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998453+0000", 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5449e-05 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998478+0000", 2024-09-21T09:11:58.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4769e-05 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998502+0000", 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3448999999999999e-05 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998630+0000", 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012872299999999999 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:11:58.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998640+0000", 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9329999999999996e-06 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003282+0000", 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004641816 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003353+0000", 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0627e-05 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.310 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:11:58.311 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:11:58.311 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:11:58.311 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T09:11:58.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:11:58.313 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:58.308+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:58.413 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:58.410+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:58.448 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:58.448 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:58.448 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:11:58.448 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:58.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:11:58.493 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:11:58.551 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:11:58.550+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:11:58.615 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:58.614+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:11:58.627 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:58.627 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:11:58.627 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:11:58.627 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:11:58.627 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:58.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:11:58.696 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:11:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:11:58.717 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:58.716+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:58.727 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:11:58.727 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:11:58.758 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:11:58.758 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:11:58.788 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:11:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 55.954412468999998, 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083044959999999998, 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 44 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857525+0000", 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2059999999999999e-06 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857541+0000", 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5826999999999999e-05 2024-09-21T09:11:58.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857608+0000", 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7353000000000004e-05 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857632+0000", 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3595999999999999e-05 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857842+0000", 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021056800000000001 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857863+0000", 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0917e-05 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865509+0000", 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076459040000000002 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865826+0000", 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031712500000000002 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.940407188000002, 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0108574, 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 206 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871530+0000", 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871545+0000", 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4620000000000001e-05 2024-09-21T09:11:58.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871584+0000", 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9582999999999997e-05 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871602+0000", 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8057e-05 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871776+0000", 2024-09-21T09:11:58.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017372500000000001 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871792+0000", 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878149+0000", 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063566910000000003 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878502+0000", 2024-09-21T09:11:58.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284800000000001 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.879223+0000", 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072110100000000003 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.881741+0000", 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025179310000000002 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882232+0000", 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00049132199999999998 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882325+0000", 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2816e-05 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882384+0000", 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9509999999999998e-05 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.827 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.929175010999998, 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032285479999999999, 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 207 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882761+0000", 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0729999999999999e-06 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882771+0000", 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0287e-05 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882796+0000", 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4873000000000001e-05 2024-09-21T09:11:58.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882811+0000", 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4752999999999999e-05 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882904+0000", 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2869999999999997e-05 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883081+0000", 2024-09-21T09:11:58.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017743500000000001 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883433+0000", 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035207000000000001 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.884576+0000", 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001142405 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885843+0000", 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012676230000000001 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885921+0000", 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7338999999999999e-05 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885988+0000", 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6820000000000001e-05 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.833 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.912771595000002, 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033258939999999998, 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.834 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 210 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899165+0000", 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3199999999999998e-06 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899176+0000", 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1154e-05 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899209+0000", 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2580000000000003e-05 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899224+0000", 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4976e-05 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899345+0000", 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121296 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899542+0000", 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019720499999999999 2024-09-21T09:11:58.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899947+0000", 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040540299999999998 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.901475+0000", 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015280319999999999 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902217+0000", 2024-09-21T09:11:58.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074172400000000003 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902369+0000", 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015137899999999999 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902488+0000", 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119825 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.859875512999999, 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037626880000000001, 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 222 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952061+0000", 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4700000000000001e-06 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952073+0000", 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.155e-05 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952103+0000", 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0716999999999997e-05 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952119+0000", 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5613000000000001e-05 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952271+0000", 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015167499999999999 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952654+0000", 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038366399999999998 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.953387+0000", 2024-09-21T09:11:58.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073280800000000005 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955064+0000", 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016773000000000001 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955552+0000", 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048774000000000002 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955707+0000", 2024-09-21T09:11:58.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154878 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955821+0000", 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114273 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.830884967000003, 2024-09-21T09:11:58.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030613469999999999, 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 230 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981052+0000", 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4169999999999999e-06 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981066+0000", 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3933e-05 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981098+0000", 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2023999999999997e-05 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981114+0000", 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6453e-05 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981230+0000", 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116092 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981448+0000", 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021825499999999999 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981870+0000", 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0004214 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.983260+0000", 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013901429999999999 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.983949+0000", 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068917399999999997 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984038+0000", 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9322999999999998e-05 2024-09-21T09:11:58.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984111+0000", 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2132999999999995e-05 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.805449553000003, 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032388619999999999, 2024-09-21T09:11:58.851 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 238 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006487+0000", 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006497+0000", 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0457e-05 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006526+0000", 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8975999999999998e-05 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006547+0000", 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0613000000000001e-05 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006669+0000", 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121896 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006881+0000", 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021207499999999999 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.007199+0000", 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031782099999999998 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.008434+0000", 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012349609999999999 2024-09-21T09:11:58.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009576+0000", 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001141998 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009661+0000", 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5982000000000004e-05 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009723+0000", 2024-09-21T09:11:58.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1940000000000007e-05 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:256 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.801237776000001, 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030661970000000001, 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 256 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:11:58.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010698+0000", 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5740000000000001e-06 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010707+0000", 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3530000000000001e-06 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010735+0000", 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7293000000000001e-05 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010759+0000", 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4054e-05 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010890+0000", 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131822 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.011023+0000", 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132612 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.011351+0000", 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032816399999999998 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012826+0000", 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014745820000000001 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013497+0000", 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00067147500000000004 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013654+0000", 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015681199999999999 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013763+0000", 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010845600000000001 2024-09-21T09:11:58.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:378 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.766906007000003, 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036030390000000002, 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.863 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 378 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045031+0000", 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9859999999999999e-06 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045069+0000", 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7876999999999997e-05 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045123+0000", 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4202e-05 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045148+0000", 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4924000000000001e-05 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045310+0000", 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016157899999999999 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045542+0000", 2024-09-21T09:11:58.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023267399999999999 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045859+0000", 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000316872 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047142+0000", 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001283216 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048468+0000", 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001325534 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048562+0000", 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4015e-05 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048631+0000", 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9159999999999995e-05 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:383 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.764890022000003, 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030650489999999998, 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 383 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047046+0000", 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.306e-06 2024-09-21T09:11:58.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047060+0000", 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3716999999999999e-05 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047090+0000", 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9456000000000001e-05 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047138+0000", 2024-09-21T09:11:58.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.884e-05 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047236+0000", 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7141999999999999e-05 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047484+0000", 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024807200000000001 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:58.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047923+0000", 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043972599999999998 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049320+0000", 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001396883 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049881+0000", 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056092200000000005 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049991+0000", 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109709 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.050109+0000", 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118276 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:398 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.760450177000003, 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037105979999999998, 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 398 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051486+0000", 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0030000000000001e-06 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051497+0000", 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0957e-05 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051519+0000", 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2263e-05 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051531+0000", 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2306999999999999e-05 2024-09-21T09:11:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052064+0000", 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00053253199999999995 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052392+0000", 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000327628 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052743+0000", 2024-09-21T09:11:58.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035127699999999999 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053814+0000", 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010707049999999999 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055011+0000", 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001197814 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055126+0000", 2024-09-21T09:11:58.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114262 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055195+0000", 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8850000000000007e-05 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:405 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.758125194999998, 2024-09-21T09:11:58.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033493780000000001, 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 405 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053811+0000", 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7999999999999999e-06 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053823+0000", 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1800000000000001e-05 2024-09-21T09:11:58.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053857+0000", 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.464e-05 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053875+0000", 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7479999999999999e-05 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054016+0000", 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014128200000000001 2024-09-21T09:11:58.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054142+0000", 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012590600000000001 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054426+0000", 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028461399999999998 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.056935+0000", 2024-09-21T09:11:58.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025088799999999998 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057011+0000", 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6097e-05 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057091+0000", 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9098999999999996e-05 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057158+0000", 2024-09-21T09:11:58.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7780000000000005e-05 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:566 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.677480178000003, 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003214822, 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.886 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 566 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134456+0000", 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1289999999999999e-06 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134467+0000", 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1396999999999999e-05 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134499+0000", 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1111000000000001e-05 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134516+0000", 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7893999999999998e-05 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134669+0000", 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015240100000000001 2024-09-21T09:11:58.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.135038+0000", 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036941799999999999 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.135615+0000", 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057627500000000001 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137179+0000", 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015641450000000001 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137473+0000", 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029436399999999998 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137562+0000", 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8566000000000006e-05 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137669+0000", 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107122 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:603 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.648213413000001, 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030919720000000001, 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.892 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 603 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163722+0000", 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.513e-06 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163730+0000", 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4930000000000001e-06 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163754+0000", 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3900000000000002e-05 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163775+0000", 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1500000000000001e-05 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163914+0000", 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013844899999999999 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.164143+0000", 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022904699999999999 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.164616+0000", 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047342400000000001 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166515+0000", 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001898903 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166641+0000", 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125573 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166721+0000", 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0513999999999995e-05 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166813+0000", 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1656000000000005e-05 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.897 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.318314686000001, 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031191460000000002, 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.898 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 817 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493622+0000", 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6800000000000002e-06 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493633+0000", 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0987e-05 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493665+0000", 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2356e-05 2024-09-21T09:11:58.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493680+0000", 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4647000000000001e-05 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493835+0000", 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015487500000000001 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.494066+0000", 2024-09-21T09:11:58.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231432 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.494380+0000", 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031386700000000001 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.495603+0000", 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012222940000000001 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496574+0000", 2024-09-21T09:11:58.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00097185200000000005 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496662+0000", 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7836000000000004e-05 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496739+0000", 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6320000000000001e-05 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.261526656999997, 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030747119999999998, 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 841 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550410+0000", 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3360000000000002e-06 2024-09-21T09:11:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550421+0000", 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1590000000000001e-05 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550454+0000", 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2206000000000003e-05 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550471+0000", 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7099999999999999e-05 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550621+0000", 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015060900000000001 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550830+0000", 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000208428 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.551146+0000", 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031587100000000001 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.552316+0000", 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011707810000000001 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553331+0000", 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010147890000000001 2024-09-21T09:11:58.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553416+0000", 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4575999999999998e-05 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553482+0000", 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6426000000000004e-05 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.247709794000002, 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002967543, 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 847 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564226+0000", 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8560000000000001e-06 2024-09-21T09:11:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564237+0000", 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0417e-05 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564269+0000", 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2116999999999998e-05 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564284+0000", 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4936000000000001e-05 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564454+0000", 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017048500000000001 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564661+0000", 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020732199999999999 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564967+0000", 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030554699999999998 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.566203+0000", 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012363039999999999 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567037+0000", 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00083360699999999999 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567123+0000", 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6428999999999995e-05 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567192+0000", 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8522999999999994e-05 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.124543522000003, 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029426840000000001, 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 898 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687393+0000", 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.554e-06 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687405+0000", 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2313000000000001e-05 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687437+0000", 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1325999999999998e-05 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687452+0000", 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5449999999999999e-05 2024-09-21T09:11:58.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687601+0000", 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149219 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687842+0000", 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240418 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.688157+0000", 2024-09-21T09:11:58.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031470800000000002 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.689278+0000", 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001121768 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690187+0000", 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090817999999999997 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690267+0000", 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0284999999999994e-05 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690333+0000", 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6463000000000004e-05 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:11:58.921 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.101721363999999, 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031788189999999998, 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 907 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:11:58.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710215+0000", 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4770000000000002e-06 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710227+0000", 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1293e-05 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710258+0000", 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1585999999999999e-05 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710273+0000", 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5330000000000001e-05 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710423+0000", 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014969199999999999 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710650+0000", 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710993+0000", 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000342725 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.712231+0000", 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012387800000000001 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713240+0000", 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001008805 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713327+0000", 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6349999999999998e-05 2024-09-21T09:11:58.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713392+0000", 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4953e-05 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.772397142999999, 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032957440000000002, 2024-09-21T09:11:58.927 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1020 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039540+0000", 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1499999999999999e-06 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039558+0000", 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7549000000000001e-05 2024-09-21T09:11:58.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039596+0000", 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8583e-05 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039615+0000", 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8805e-05 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039759+0000", 2024-09-21T09:11:58.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143702 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040000+0000", 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024096600000000001 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040380+0000", 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038004199999999998 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:11:58.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.041780+0000", 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400625 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042670+0000", 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088968599999999999 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042760+0000", 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9602e-05 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:11:58.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:11:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042833+0000", 2024-09-21T09:11:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3034000000000006e-05 2024-09-21T09:11:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:11:58.933 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:11:58.933 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:11:58.934 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:58.812+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:58.934 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:11:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:11:58.937 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:11:58.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:11:58.938 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:11:58.939 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:11:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:11:58.939 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:11:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:11:58.940 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:11:58.932+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:11:59.035 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:11:59.032+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:11:59.072 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:59.072 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:59.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:11:59.136 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:59.133+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:59.208 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:59.208 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:59.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:11:59.263 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:59.261+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:59.336 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:59.332+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:59.392 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:59.392 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:59.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:11:59.451 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:59.449+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:59.526 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:59.526 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:59.538 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:11:59.536+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:11:59.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:11:59.639 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:59.637+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:59.703 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:59.704 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:59.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:11:59.720 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-09-21T09:11:59.759 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:11:59.757+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:11:59.841 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:11:59.836+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:11:59.890 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:11:59.890 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:11:59.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:11:59.951 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:11:59.949+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:00.023 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:00.023 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:00.037 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:00.079 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:00.077+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:00.143 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:00.140+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:00.199 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:00.199 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:00.214 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:00.244 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:00.240+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:00.340 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:00.341 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:00.345 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:00.344+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:00.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:00.446 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:00.444+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:00.526 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:00.527 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:00.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:00.546 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:00.545+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:00.647 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:00.644+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:00.749 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:00.744+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:00.758 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:00.758 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:00.778 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:00.865 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:00.864+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:00.944 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:00.991 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:00.991 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:00.992 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:00.988+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:01.010 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:01.053 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:01.052+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:01.148 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:01.148 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:01.152 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:01.149+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:01.179 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:01.179 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:01.210 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:01.210 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:01.226 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:01.226 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:01.226 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:01.226 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:01.241 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:01.241 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:01.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:01.275 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:01.275 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:01.272+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:01.308 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:01.309 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:01.342 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:01.342 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:01.354 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:01.352+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:01.375 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:01.375 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:01.423 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:01.423 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:01.423 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:01.423 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:01.424 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:01.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:01.454 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:01.453+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:01.555 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:01.553+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:01.657 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:12:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.755540733000004, 2024-09-21T09:12:01.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011873984000000001, 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 87 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:12:01.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898151+0000", 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9599999999999999e-07 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898264+0000", 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112509 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898277+0000", 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.38e-05 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898286+0000", 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7299999999999994e-06 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906279+0000", 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079924090000000007 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906410+0000", 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013102900000000001 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906618+0000", 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020801500000000001 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909645+0000", 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030275329999999998 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909823+0000", 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017825499999999999 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909906+0000", 2024-09-21T09:12:01.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2688999999999994e-05 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910024+0000", 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118319 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.755388690999993, 2024-09-21T09:12:01.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01257903, 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 88 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.569999999999999e-07 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898310+0000", 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0360000000000003e-06 2024-09-21T09:12:01.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898320+0000", 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0373999999999999e-05 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898327+0000", 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1960000000000002e-06 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908138+0000", 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.009810849 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908334+0000", 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000196059 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908540+0000", 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000205775 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910074+0000", 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001534363 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910609+0000", 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053462599999999996 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910764+0000", 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015484599999999999 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910882+0000", 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011794900000000001 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.579071486999993, 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012244817999999999, 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 110 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7100000000000002e-07 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074625+0000", 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3939999999999998e-06 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074676+0000", 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1369999999999998e-05 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074681+0000", 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7690000000000004e-06 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079388+0000", 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047075550000000004 2024-09-21T09:12:01.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079454+0000", 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5639e-05 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079548+0000", 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4299e-05 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081984+0000", 2024-09-21T09:12:01.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024359239999999999 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086803+0000", 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048185880000000004 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086835+0000", 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2487999999999998e-05 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086865+0000", 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9320999999999999e-05 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.579000132000004, 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012339861000000001, 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 111 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5900000000000003e-07 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074695+0000", 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4410000000000002e-06 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074707+0000", 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2376e-05 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074711+0000", 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9879999999999998e-06 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079878+0000", 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051667869999999999 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080012+0000", 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013358700000000001 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080288+0000", 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027684299999999998 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081987+0000", 2024-09-21T09:12:01.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016981450000000001 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086920+0000", 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049329780000000002 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086966+0000", 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6718999999999998e-05 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.087031+0000", 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4638e-05 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.578969082, 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013449694999999999, 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.681 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 112 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5699999999999998e-07 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074789+0000", 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6396000000000006e-05 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074796+0000", 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0190000000000001e-06 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074802+0000", 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9290000000000003e-06 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080677+0000", 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058755839999999997 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080739+0000", 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1866999999999996e-05 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080833+0000", 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3572000000000005e-05 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083415+0000", 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025824870000000001 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088053+0000", 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004637426 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088105+0000", 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1993000000000002e-05 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088172+0000", 2024-09-21T09:12:01.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7064999999999996e-05 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.578880983999994, 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013475117999999999, 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 113 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:12:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074811+0000", 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6800000000000001e-07 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074814+0000", 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9919999999999999e-06 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074820+0000", 2024-09-21T09:12:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5060000000000001e-06 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074823+0000", 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3289999999999998e-06 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081613+0000", 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006789331 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081666+0000", 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3482000000000001e-05 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081745+0000", 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8454999999999993e-05 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083786+0000", 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020410850000000002 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088227+0000", 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044407819999999999 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088260+0000", 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3321000000000002e-05 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088285+0000", 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5466999999999999e-05 2024-09-21T09:12:01.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.578770383999995, 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013454595, 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.693 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 114 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074922+0000", 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7100000000000001e-07 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074925+0000", 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8060000000000001e-06 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074933+0000", 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7929999999999998e-06 2024-09-21T09:12:01.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074937+0000", 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.749e-06 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082054+0000", 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071175259999999999 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082199+0000", 2024-09-21T09:12:01.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014503199999999999 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082445+0000", 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245331 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083789+0000", 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001343943 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088319+0000", 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045298530000000004 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088350+0000", 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1408000000000002e-05 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088375+0000", 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5483e-05 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.698 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.578493026000004, 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013331543, 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.699 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 115 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075199+0000", 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1699999999999998e-07 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075281+0000", 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2151999999999995e-05 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075291+0000", 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0495e-05 2024-09-21T09:12:01.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075298+0000", 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8920000000000003e-06 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082855+0000", 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075570790000000004 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082909+0000", 2024-09-21T09:12:01.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3106000000000003e-05 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082988+0000", 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9515e-05 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085228+0000", 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002239736 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088425+0000", 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003197044 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088470+0000", 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5281000000000002e-05 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088530+0000", 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9626000000000001e-05 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.704 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.578381527999994, 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013307090000000001, 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 116 2024-09-21T09:12:01.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.27e-07 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075314+0000", 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4249999999999998e-06 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075318+0000", 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7829999999999998e-06 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075321+0000", 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1370000000000002e-06 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083883+0000", 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0085611369999999999 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083976+0000", 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3492000000000005e-05 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084091+0000", 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114993 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085233+0000", 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011417409999999999 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088565+0000", 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003332532 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088595+0000", 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9675e-05 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088617+0000", 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1747999999999999e-05 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.710 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.578364316000005, 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013638091, 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 117 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:01.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.53e-07 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075330+0000", 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.281e-06 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075336+0000", 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7339999999999996e-06 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075340+0000", 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4010000000000001e-06 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084504+0000", 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091640230000000003 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084560+0000", 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6595000000000003e-05 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084644+0000", 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3326999999999997e-05 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085387+0000", 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074348199999999995 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088913+0000", 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003525855 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088944+0000", 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1621000000000001e-05 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088965+0000", 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0519000000000001e-05 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:132 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.069480466000002, 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013217052999999999, 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 132 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584212+0000", 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7700000000000003e-07 2024-09-21T09:12:01.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584218+0000", 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584229+0000", 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1046000000000001e-05 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584237+0000", 2024-09-21T09:12:01.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0800000000000006e-06 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590506+0000", 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062689440000000003 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590742+0000", 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023612500000000001 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.591121+0000", 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037905099999999999 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593798+0000", 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026770079999999998 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597134+0000", 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033363009999999999 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597279+0000", 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144945 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597428+0000", 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014840599999999999 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.722 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.069309360000005, 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013710092, 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 133 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584383+0000", 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1960000000000001e-06 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584391+0000", 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7239999999999992e-06 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584407+0000", 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6138999999999999e-05 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584416+0000", 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5540000000000003e-06 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592608+0000", 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081912370000000005 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592746+0000", 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138512 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592970+0000", 2024-09-21T09:12:01.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022379600000000001 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597628+0000", 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046579669999999998 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597829+0000", 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020085599999999999 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597967+0000", 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013828899999999999 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598092+0000", 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012482199999999999 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:01.728 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.069257444000002, 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013969944, 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 134 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:01.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1699999999999997e-07 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584594+0000", 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015906899999999999 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584608+0000", 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.417e-05 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584617+0000", 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2960000000000004e-06 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593907+0000", 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0092901630000000006 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594043+0000", 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013558600000000001 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594285+0000", 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024269499999999999 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597788+0000", 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035024119999999999 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598121+0000", 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033284100000000001 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598256+0000", 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000134816 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598404+0000", 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014817899999999999 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.069056291999999, 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015773928, 2024-09-21T09:12:01.734 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 135 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584636+0000", 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8700000000000004e-07 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584642+0000", 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2099999999999998e-06 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584653+0000", 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536e-05 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584660+0000", 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.627e-06 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595480+0000", 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010820214999999999 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595726+0000", 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245682 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.596110+0000", 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038419799999999998 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600117+0000", 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004006618 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600255+0000", 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013840599999999999 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600346+0000", 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0666000000000002e-05 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600409+0000", 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2883000000000001e-05 2024-09-21T09:12:01.739 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.069018529000004, 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020097924999999999, 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.740 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 136 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000004e-07 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584679+0000", 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6069999999999998e-06 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584694+0000", 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4579999999999999e-05 2024-09-21T09:12:01.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584702+0000", 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0730000000000005e-06 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598512+0000", 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013810578 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598748+0000", 2024-09-21T09:12:01.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000236176 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.599125+0000", 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037634399999999997 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604492+0000", 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053673560000000002 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604613+0000", 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121039 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604703+0000", 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0399e-05 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604771+0000", 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7119999999999994e-05 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.745 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.068977052999998, 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020579828000000001, 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 137 2024-09-21T09:12:01.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584715+0000", 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000005e-07 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584888+0000", 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000173456 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584903+0000", 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.487e-05 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584913+0000", 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9899999999999992e-06 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600531+0000", 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015617987999999999 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600765+0000", 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023383900000000001 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.601148+0000", 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038257100000000001 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604980+0000", 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003832326 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605028+0000", 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8059999999999997e-05 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605166+0000", 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000137959 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605294+0000", 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012808200000000001 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.751 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.068755311000004, 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024357648999999999, 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 138 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584937+0000", 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.54e-07 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584943+0000", 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6229999999999999e-06 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584959+0000", 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5489999999999999e-05 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584968+0000", 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.516e-06 2024-09-21T09:12:01.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.602849+0000", 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017880314000000001 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603120+0000", 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027100799999999999 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603521+0000", 2024-09-21T09:12:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040112399999999999 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.608899+0000", 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053779300000000004 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609024+0000", 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125699 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609140+0000", 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115982 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609294+0000", 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015310899999999999 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.757 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.068707571000004, 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024897698999999999, 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 139 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7999999999999995e-07 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584997+0000", 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2556e-05 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585013+0000", 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5800000000000001e-05 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585021+0000", 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3340000000000002e-06 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605435+0000", 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020414299 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605604+0000", 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000168615 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605803+0000", 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199256 2024-09-21T09:12:01.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609392+0000", 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035888719999999999 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609598+0000", 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020643500000000001 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609747+0000", 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014889600000000001 2024-09-21T09:12:01.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609881+0000", 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013395599999999999 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.068654635000001, 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025121831000000001, 2024-09-21T09:12:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 140 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5400000000000001e-07 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585185+0000", 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014761900000000001 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585199+0000", 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4450000000000001e-05 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585209+0000", 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2099999999999999e-06 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606615+0000", 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021406261999999999 2024-09-21T09:12:01.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606858+0000", 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024295499999999999 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.607232+0000", 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037427700000000001 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609554+0000", 2024-09-21T09:12:01.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023222210000000002 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609917+0000", 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036226800000000001 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610051+0000", 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013447599999999999 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610158+0000", 2024-09-21T09:12:01.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107439 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.068466182999998, 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.027901532, 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:01.769 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 141 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:01.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585226+0000", 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5999999999999991e-07 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585238+0000", 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1717e-05 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585248+0000", 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0776e-05 2024-09-21T09:12:01.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585256+0000", 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8140000000000001e-06 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610278+0000", 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025021297000000001 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610421+0000", 2024-09-21T09:12:01.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014358900000000001 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610631+0000", 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021016900000000001 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612016+0000", 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001385037 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612841+0000", 2024-09-21T09:12:01.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082419399999999999 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612997+0000", 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000156186 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.613127+0000", 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012979300000000001 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:01.775 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:01.775 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:01.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T09:12:01.776 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:01.653+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:01.777 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:01.777 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:01.773+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:01.877 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:01.876+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:01.978 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:01.976+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:01.991 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:01.991 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:01.991 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:01.991 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:02.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:02.079 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:02.073+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:02.179 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:02.177+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:02.222 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:02.222 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:02.222 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:02.222 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:02.222 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:02.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:02.285 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:02.284+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:02.381 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:02.380+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:02.414 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:02.414 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:02.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:02.414 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4358.0:40 5.1c 5:3fce9a59:::zonegroup_info.6661b8ba-4ecc-4129-afb2-8d0efd9659c2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.524534179, 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028118549999999998, 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4358", 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3756932968", 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 40 2024-09-21T09:12:02.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885826+0000", 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4899999999999999e-06 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885835+0000", 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5299999999999996e-06 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885857+0000", 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1679999999999999e-05 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885871+0000", 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4146e-05 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885969+0000", 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8212000000000001e-05 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886181+0000", 2024-09-21T09:12:02.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021209000000000001 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886450+0000", 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026841000000000001 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.887864+0000", 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001414722 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:02.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888500+0000", 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063535399999999998 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888562+0000", 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2176999999999998e-05 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888637+0000", 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5043999999999995e-05 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.420 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:214 6.1c e36/30 6:3e426232:gc::gc.9:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.489340493999997, 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015590160000000001, 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.13e-07 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921028+0000", 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9639999999999992e-06 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921060+0000", 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1822000000000001e-05 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921076+0000", 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6252999999999998e-05 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921213+0000", 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013652299999999999 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921250+0000", 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7685999999999998e-05 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922504+0000", 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001253185 2024-09-21T09:12:02.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922578+0000", 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4070000000000001e-05 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.479152003999999, 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036169079999999998, 2024-09-21T09:12:02.425 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 217 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931210+0000", 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6529999999999998e-06 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931223+0000", 2024-09-21T09:12:02.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3667e-05 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931257+0000", 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3742999999999999e-05 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931273+0000", 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5366000000000002e-05 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931414+0000", 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136300000000001 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931673+0000", 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025924500000000002 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.932066+0000", 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0003927 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.933852+0000", 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017863180000000001 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934605+0000", 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075312800000000004 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934696+0000", 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0328999999999995e-05 2024-09-21T09:12:02.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934824+0000", 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128396 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:229 6.1b e36/30 6:db9d130d:gc::gc.24:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.433705046999997, 2024-09-21T09:12:02.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015706159999999999, 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976655+0000", 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8699999999999995e-07 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976661+0000", 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7599999999999997e-06 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976686+0000", 2024-09-21T09:12:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4396000000000002e-05 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976699+0000", 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3336000000000001e-05 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976836+0000", 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013669299999999999 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976871+0000", 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4913000000000003e-05 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978136+0000", 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001264851 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978225+0000", 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9179999999999997e-05 2024-09-21T09:12:02.435 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.405973674999998, 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001626368, 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:02.436 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 237 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004389+0000", 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5099999999999999e-06 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004408+0000", 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9154e-05 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004453+0000", 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4385999999999998e-05 2024-09-21T09:12:02.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004475+0000", 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2853e-05 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004585+0000", 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000109546 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004656+0000", 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0988999999999994e-05 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004818+0000", 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016166600000000001 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005536+0000", 2024-09-21T09:12:02.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071806799999999998 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005917+0000", 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038119100000000002 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005956+0000", 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9255999999999998e-05 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.006012+0000", 2024-09-21T09:12:02.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5748999999999998e-05 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:253 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.402297275999999, 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001548546, 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.442 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 253 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008063+0000", 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.263e-06 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008070+0000", 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1369999999999996e-06 2024-09-21T09:12:02.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008087+0000", 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6263999999999999e-05 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008096+0000", 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6670000000000008e-06 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008178+0000", 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1644999999999995e-05 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008240+0000", 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2453999999999995e-05 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008448+0000", 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020722899999999999 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009447+0000", 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099947600000000001 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009547+0000", 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100268 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009582+0000", 2024-09-21T09:12:02.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4459999999999999e-05 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009610+0000", 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8683e-05 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:709 6.1e e36/30 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.166590687000003, 2024-09-21T09:12:02.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015262559999999999, 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:02.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243769+0000", 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9999999999999996e-07 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243776+0000", 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0999999999999998e-06 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243790+0000", 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3882e-05 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243800+0000", 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0083e-05 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243943+0000", 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014281799999999999 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243990+0000", 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7157000000000003e-05 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245247+0000", 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012564200000000001 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245295+0000", 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7895999999999997e-05 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.452 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.143698678, 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023946290000000001, 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:02.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 721 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266663+0000", 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5289999999999998e-06 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266676+0000", 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.292e-05 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266705+0000", 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8816999999999999e-05 2024-09-21T09:12:02.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266732+0000", 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7134000000000001e-05 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266844+0000", 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111848 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267038+0000", 2024-09-21T09:12:02.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019389 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267357+0000", 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000319172 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268435+0000", 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010780430000000001 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:02.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268984+0000", 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054955599999999998 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269022+0000", 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7973999999999999e-05 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269055+0000", 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2746000000000001e-05 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.458 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.140724384000002, 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002147342, 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:02.459 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 723 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269636+0000", 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4720000000000001e-06 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269645+0000", 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.32e-06 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269667+0000", 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2487999999999999e-05 2024-09-21T09:12:02.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269678+0000", 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0794e-05 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269735+0000", 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269784+0000", 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8266999999999997e-05 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269905+0000", 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121012 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.270906+0000", 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00100125 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271576+0000", 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066977200000000001 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271666+0000", 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9952999999999997e-05 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271782+0000", 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116469 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:775 6.1e e36/30 6:7db93595:::obj_delete_at_hint.0000000066:head v 36'5, mlcod=36'3)", 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.018912596, 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015332430000000001, 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391448+0000", 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7570000000000001e-06 2024-09-21T09:12:02.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391462+0000", 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3256e-05 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391491+0000", 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9753000000000001e-05 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391515+0000", 2024-09-21T09:12:02.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3623999999999999e-05 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391667+0000", 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152065 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391732+0000", 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5099999999999997e-05 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392906+0000", 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011735719999999999 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392980+0000", 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4116000000000007e-05 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:778 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'4, mlcod=36'2)", 2024-09-21T09:12:02.469 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.011675398999998, 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015037570000000001, 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398686+0000", 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8369999999999999e-06 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398703+0000", 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7363e-05 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398731+0000", 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8367000000000001e-05 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398745+0000", 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.385e-05 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398923+0000", 2024-09-21T09:12:02.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177818 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398963+0000", 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9867000000000003e-05 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400088+0000", 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011250380000000001 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400188+0000", 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9617000000000005e-05 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:780 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'5, mlcod=36'3)", 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.006829451999998, 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001427673, 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403531+0000", 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6729999999999999e-06 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403568+0000", 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6693000000000003e-05 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403597+0000", 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9130000000000001e-05 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403611+0000", 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3643e-05 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403781+0000", 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016968300000000001 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403820+0000", 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9768999999999998e-05 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404868+0000", 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001047493 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404957+0000", 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9588999999999999e-05 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.478 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:814 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'7, mlcod=36'5)", 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.924860649999999, 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014758, 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485500+0000", 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.843e-06 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485513+0000", 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2284e-05 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485542+0000", 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9102999999999999e-05 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485555+0000", 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.375e-05 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485660+0000", 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104849 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485719+0000", 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8842999999999999e-05 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486885+0000", 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011654250000000001 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486974+0000", 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9703000000000005e-05 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.482 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:816 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'8, mlcod=36'6)", 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.921234411999997, 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016647159999999999, 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489127+0000", 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489142+0000", 2024-09-21T09:12:02.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5400000000000002e-05 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489177+0000", 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4894000000000002e-05 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489196+0000", 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8873e-05 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489355+0000", 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015918799999999999 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489424+0000", 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8572999999999996e-05 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490705+0000", 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012817079999999999 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490789+0000", 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4019999999999999e-05 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:844 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'12, mlcod=36'10)", 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.854055676999998, 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015352059999999999, 2024-09-21T09:12:02.487 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556305+0000", 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.73e-06 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556317+0000", 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2233e-05 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556348+0000", 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0176e-05 2024-09-21T09:12:02.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556361+0000", 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3694e-05 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556511+0000", 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014973800000000001 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556567+0000", 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6273999999999997e-05 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557740+0000", 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001173065 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557839+0000", 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8295999999999995e-05 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.491 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:846 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'13, mlcod=36'11)", 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.850318885999997, 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014368810000000001, 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:02.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560042+0000", 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6500000000000001e-06 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560056+0000", 2024-09-21T09:12:02.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4233000000000001e-05 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560085+0000", 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8767000000000001e-05 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560098+0000", 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3436e-05 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560242+0000", 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000143199 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560305+0000", 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3269999999999996e-05 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561354+0000", 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010487630000000001 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561477+0000", 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012356300000000001 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.694732504000001, 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028068680000000001, 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 910 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715630+0000", 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.92e-06 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715647+0000", 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:12:02.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715680+0000", 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3572999999999999e-05 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715696+0000", 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5777000000000002e-05 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715819+0000", 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000122972 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716044+0000", 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022481500000000001 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716365+0000", 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032138400000000003 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.717426+0000", 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001061223 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718214+0000", 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078753099999999995 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718304+0000", 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0426999999999993e-05 2024-09-21T09:12:02.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718434+0000", 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012908900000000001 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.690775451, 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031243310000000002, 2024-09-21T09:12:02.502 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 912 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:02.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719585+0000", 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.72e-06 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719597+0000", 2024-09-21T09:12:02.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1229999999999999e-05 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719621+0000", 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4073000000000001e-05 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719633+0000", 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.259e-05 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719761+0000", 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012745599999999999 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720000+0000", 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023914800000000001 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720482+0000", 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048253400000000001 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.721627+0000", 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001145002 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722556+0000", 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092825299999999998 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722640+0000", 2024-09-21T09:12:02.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4542999999999993e-05 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722708+0000", 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7781999999999996e-05 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:02.508 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.650621213999997, 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014824689999999999, 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:02.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759740+0000", 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7370000000000001e-06 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759752+0000", 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2483000000000001e-05 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759782+0000", 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9553e-05 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759798+0000", 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6042999999999999e-05 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759943+0000", 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2024-09-21T09:12:02.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760001+0000", 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8777000000000003e-05 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761134+0000", 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001132922 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761220+0000", 2024-09-21T09:12:02.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6044999999999994e-05 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1020 6.10 e45/30 6:0fbdcb32:usage::usage.17:head v 45'5, mlcod=36'3)", 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.371081595, 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001677574, 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:02.513 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039281+0000", 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0939999999999999e-06 2024-09-21T09:12:02.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039305+0000", 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3906000000000001e-05 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039349+0000", 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4064999999999999e-05 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039379+0000", 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9889000000000001e-05 2024-09-21T09:12:02.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039517+0000", 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013895300000000001 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039574+0000", 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6162000000000002e-05 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040855+0000", 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001281821 2024-09-21T09:12:02.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:02.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:02.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:02.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040955+0000", 2024-09-21T09:12:02.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9684000000000003e-05 2024-09-21T09:12:02.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.517 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:02.517 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:02.517 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:02.519 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:02.519 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:02.516+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:02.619 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:02.617+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:02.720 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:02.716+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:02.730 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:02.730 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:02.730 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:02.730 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-09-21T09:12:02.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:02.853 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:02.852+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:02.924 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:02.921+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:02.978 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:02.978 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:02.978 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:02.978 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:02.978 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:02.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:03.037 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:03.036+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:03.126 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:03.121+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:03.209 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:03.209 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:03.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:03.209 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:03.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.209 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-21T09:12:03.209 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 73.433299532000007, 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073206360000000002, 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 5 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772825+0000", 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7129999999999999e-06 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772843+0000", 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8033000000000002e-05 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772882+0000", 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9434000000000002e-05 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772902+0000", 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0075999999999999e-05 2024-09-21T09:12:03.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773008+0000", 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105351 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773016+0000", 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1419999999999993e-06 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776094+0000", 2024-09-21T09:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030782549999999998 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776289+0000", 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019460899999999999 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776487+0000", 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000198142 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.778052+0000", 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001565812 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.779852+0000", 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001799171 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780015+0000", 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000162862 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780142+0000", 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012703599999999999 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.430677686999999, 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01128114, 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.216 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775446+0000", 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775478+0000", 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775525+0000", 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7734000000000001e-05 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775559+0000", 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4133e-05 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775753+0000", 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000193248 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775773+0000", 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0086999999999999e-05 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783330+0000", 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075572979999999996 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783469+0000", 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138839 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783767+0000", 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029823499999999999 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.785719+0000", 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00195207 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786427+0000", 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070740099999999997 2024-09-21T09:12:03.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786600+0000", 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017295900000000001 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786724+0000", 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012436599999999999 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.365042363999997, 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011832176, 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 43 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841082+0000", 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9870000000000001e-06 2024-09-21T09:12:03.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841121+0000", 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8593000000000001e-05 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841153+0000", 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2716000000000003e-05 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841179+0000", 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5190000000000001e-05 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841332+0000", 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000153509 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841368+0000", 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6183000000000002e-05 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845655+0000", 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00428642 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845676+0000", 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1687000000000001e-05 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852576+0000", 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0068992860000000001 2024-09-21T09:12:03.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852910+0000", 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033460500000000003 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.293060109999999, 2024-09-21T09:12:03.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0099467879999999998, 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 214 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913064+0000", 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9439999999999998e-06 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913079+0000", 2024-09-21T09:12:03.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4966e-05 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913119+0000", 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9297e-05 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913147+0000", 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8776e-05 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913293+0000", 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014535899999999999 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913303+0000", 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0243e-05 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920048+0000", 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067448569999999999 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920345+0000", 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000297454 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920742+0000", 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039676499999999999 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922048+0000", 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00130641 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922865+0000", 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081690500000000004 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922947+0000", 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1751999999999999e-05 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923007+0000", 2024-09-21T09:12:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0059999999999998e-05 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.263191571999997, 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033742799999999999, 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.235 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 220 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942931+0000", 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4030000000000001e-06 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942943+0000", 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942976+0000", 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3120000000000001e-05 2024-09-21T09:12:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942991+0000", 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5376999999999999e-05 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943103+0000", 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011184900000000001 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943318+0000", 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021467900000000001 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943715+0000", 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039689700000000001 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.945217+0000", 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001501973 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946150+0000", 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093294700000000005 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946234+0000", 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4425000000000006e-05 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946303+0000", 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9016999999999993e-05 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.244493417999998, 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031516420000000001, 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 225 2024-09-21T09:12:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961629+0000", 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1730000000000002e-06 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961640+0000", 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0927000000000001e-05 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961671+0000", 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1032999999999999e-05 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961686+0000", 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5304000000000001e-05 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961813+0000", 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012683900000000001 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962030+0000", 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021637499999999999 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962446+0000", 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041634700000000002 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.963645+0000", 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011985279999999999 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964623+0000", 2024-09-21T09:12:03.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000978673 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964713+0000", 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9660000000000006e-05 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964779+0000", 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5783000000000004e-05 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:228 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.234182248000003, 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032433039999999998, 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 228 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971940+0000", 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1100000000000001e-06 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971951+0000", 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0556e-05 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971982+0000", 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1442999999999997e-05 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971998+0000", 2024-09-21T09:12:03.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5673000000000001e-05 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972130+0000", 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000132213 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972337+0000", 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020659899999999999 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:03.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972731+0000", 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039369699999999998 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.974129+0000", 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013981029999999999 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975031+0000", 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090264399999999997 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975116+0000", 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4616000000000004e-05 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975182+0000", 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5649999999999997e-05 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.220047059000002, 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030216219999999998, 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 232 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986076+0000", 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3130000000000001e-06 2024-09-21T09:12:03.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986087+0000", 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1387e-05 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986118+0000", 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986134+0000", 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.524e-05 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986241+0000", 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010744899999999999 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986461+0000", 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021971600000000001 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986879+0000", 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041845000000000001 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988536+0000", 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001657045 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988933+0000", 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695699999999997 2024-09-21T09:12:03.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989021+0000", 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7947000000000003e-05 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989095+0000", 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3812000000000004e-05 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.213122527000003, 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032333710000000001, 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 234 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.259 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993000+0000", 2024-09-21T09:12:03.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993011+0000", 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0647e-05 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993040+0000", 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9456999999999999e-05 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993055+0000", 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.485e-05 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993166+0000", 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000110942 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993409+0000", 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242871 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993829+0000", 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000420154 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.995035+0000", 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001206295 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996079+0000", 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00104407 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996167+0000", 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7440000000000003e-05 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996231+0000", 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4589000000000001e-05 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.264 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.815593749999998, 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029466929999999998, 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 775 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390530+0000", 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9270000000000001e-06 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390542+0000", 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2016e-05 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390574+0000", 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2199999999999997e-05 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390589+0000", 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5339999999999999e-05 2024-09-21T09:12:03.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390719+0000", 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012939599999999999 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390928+0000", 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000209898 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391244+0000", 2024-09-21T09:12:03.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031530799999999998 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392535+0000", 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001291008 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393288+0000", 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075327100000000002 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393404+0000", 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011562599999999999 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393473+0000", 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9703000000000007e-05 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:784 6.8 6:1111b601:::obj_delete_at_hint.0000000069:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.792906404999997, 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003135367, 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 784 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413216+0000", 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.784e-06 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413225+0000", 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8580000000000006e-06 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413249+0000", 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4212000000000001e-05 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413260+0000", 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1514e-05 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413401+0000", 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014083699999999999 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413625+0000", 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022383099999999999 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413942+0000", 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317375 2024-09-21T09:12:03.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.415132+0000", 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001189072 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416200+0000", 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010679979999999999 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416282+0000", 2024-09-21T09:12:03.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2713999999999994e-05 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416349+0000", 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7172e-05 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.721563310000001, 2024-09-21T09:12:03.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029415460000000002, 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 814 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484559+0000", 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484570+0000", 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.098e-05 2024-09-21T09:12:03.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484601+0000", 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1062999999999997e-05 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484616+0000", 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4735999999999999e-05 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484747+0000", 2024-09-21T09:12:03.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000130729 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484965+0000", 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217982 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485271+0000", 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000306488 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486347+0000", 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010752030000000001 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487293+0000", 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094605299999999998 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487379+0000", 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6558999999999996e-05 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487499+0000", 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011955000000000001 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.717737667000002, 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029122929999999998, 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 816 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488385+0000", 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8700000000000001e-06 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488395+0000", 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0723000000000001e-05 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488420+0000", 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.508e-05 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488433+0000", 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2317000000000001e-05 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488538+0000", 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105475 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488669+0000", 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000131073 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488940+0000", 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027115100000000002 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490015+0000", 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010748159999999999 2024-09-21T09:12:03.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491096+0000", 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001080733 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491179+0000", 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2942999999999995e-05 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491295+0000", 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116112 2024-09-21T09:12:03.287 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.671768057000001, 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003172818, 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.288 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 835 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534355+0000", 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2840000000000001e-06 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534366+0000", 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1396000000000001e-05 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534398+0000", 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1823999999999999e-05 2024-09-21T09:12:03.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534413+0000", 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4919999999999999e-05 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534528+0000", 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115209 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534749+0000", 2024-09-21T09:12:03.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022136500000000001 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.535063+0000", 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031351399999999998 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.536086+0000", 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010234899999999999 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537283+0000", 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011962819999999999 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537407+0000", 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123819 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537525+0000", 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118715 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.293 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.650763564999998, 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030129000000000002, 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 844 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555359+0000", 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555369+0000", 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0207000000000001e-05 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555398+0000", 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8822999999999998e-05 2024-09-21T09:12:03.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555412+0000", 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4443e-05 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555537+0000", 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012447900000000001 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555756+0000", 2024-09-21T09:12:03.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021879899999999999 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556069+0000", 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031338399999999999 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557174+0000", 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011049860000000001 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558209+0000", 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034653 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558297+0000", 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8446e-05 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558370+0000", 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2700000000000005e-05 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.299 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:864 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.604225065000001, 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002853324, 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.300 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 864 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601897+0000", 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.61e-06 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601905+0000", 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2470000000000008e-06 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601930+0000", 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4885999999999999e-05 2024-09-21T09:12:03.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601949+0000", 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9006000000000001e-05 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602078+0000", 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012905600000000001 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602220+0000", 2024-09-21T09:12:03.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141586 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602489+0000", 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026938199999999998 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.603606+0000", 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011163880000000001 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604600+0000", 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099397700000000005 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604685+0000", 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5740000000000002e-05 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604749+0000", 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3446000000000002e-05 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.305 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.483222458, 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031274219999999999, 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 913 2024-09-21T09:12:03.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722901+0000", 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722912+0000", 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1693e-05 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722944+0000", 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.222e-05 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722959+0000", 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4902999999999999e-05 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723110+0000", 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015031500000000001 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723344+0000", 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000234799 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723667+0000", 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032255100000000002 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.724725+0000", 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010575859999999999 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725873+0000", 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001148579 2024-09-21T09:12:03.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725961+0000", 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8063e-05 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.726025+0000", 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4156e-05 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.479114606000003, 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029665730000000001, 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 915 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727008+0000", 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7129999999999999e-06 2024-09-21T09:12:03.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727016+0000", 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6600000000000001e-06 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727041+0000", 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5253e-05 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727055+0000", 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3403e-05 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727227+0000", 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017192600000000001 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727363+0000", 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013665199999999999 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727627+0000", 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000263565 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.728717+0000", 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001090029 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729815+0000", 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010975099999999999 2024-09-21T09:12:03.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729908+0000", 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3029000000000007e-05 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729972+0000", 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4832999999999994e-05 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.317 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.447778069000002, 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035043000000000001, 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 928 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758345+0000", 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4339999999999999e-06 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758356+0000", 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1423000000000001e-05 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758389+0000", 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2336999999999999e-05 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758408+0000", 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9706000000000001e-05 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758579+0000", 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017064599999999999 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758939+0000", 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036013000000000001 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759516+0000", 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057737999999999995 2024-09-21T09:12:03.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760877+0000", 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013600769999999999 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761559+0000", 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068295900000000002 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761727+0000", 2024-09-21T09:12:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016766900000000001 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761847+0000", 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119539 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4216.0:2 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.207694841999999, 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049270260000000001, 2024-09-21T09:12:03.323 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4216", 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/896302906", 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998428+0000", 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998453+0000", 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5449e-05 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998478+0000", 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4769e-05 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998502+0000", 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3448999999999999e-05 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998630+0000", 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012872299999999999 2024-09-21T09:12:03.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998640+0000", 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9329999999999996e-06 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003282+0000", 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004641816 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003353+0000", 2024-09-21T09:12:03.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0627e-05 2024-09-21T09:12:03.328 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.328 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.328 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.328 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:03.328 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:03.328 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:03.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:03.330 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:03.329+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:03.399 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:03.430 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:03.425+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:03.465 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:03.465 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:03.465 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:03.466 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:03.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:03.530 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:03.528+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:03.598 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:03.598 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:03.629 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:03.629 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:03.630 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:03.628+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:03.653 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:03.653 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:03.653 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:03.653 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:03.653 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:03.660 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:03.660 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:03.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:03.691 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:03.722 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:03.722 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:03.731 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:03.728+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:03.752 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:03.753 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:03.786 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:03.786 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:03.800 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:03.800 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:03.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:03.818 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:03.818 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:03.832 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:03.828+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:03.933 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:03.932+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:03.934 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:03.934 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:03.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:04.034 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:04.029+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:04.076 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:04.076 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:04.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:04.135 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:04.132+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:04.236 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:04.232+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:04.256 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:04.256 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:04.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:04.337 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:04.333+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:04.400 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:04.400 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:04.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:04.438 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:04.436+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:04.539 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:04.536+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:04.583 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:04.583 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:04.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:04.643 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:04.641+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:04.724 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:04.724 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:04.738 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:04.766 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T09:12:04.780 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:04.777+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:04.841 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:04.840+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:04.911 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:04.911 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:04.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:04.942 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:04.940+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:05.043 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:05.040+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:05.051 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:05.052 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:05.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:05.144 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:05.141+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:05.192 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:05.192 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:05.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:05.248 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:05.245+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:05.346 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:05.341+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:05.377 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:05.377 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:05.395 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:05.447 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:05.441+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:05.547 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:05.545+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:05.564 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:05.564 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:05.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:05.649 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:05.645+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:05.750 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:05.745+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:05.752 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:05.752 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:05.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:05.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:05.885 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:05.884+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:05.943 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:05.943 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:05.951 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:05.949+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:05.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:06.041 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:06.052 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:06.048+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:06.073 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:06.073 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:06.086 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-09-21T09:12:06.106 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:06.106 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:06.138 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:06.138 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:06.150 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:06.151 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:06.151 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:06.151 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:06.151 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:06.153 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:06.152+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:06.164 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:06.172 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:06.172 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:06.207 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:06.207 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:06.242 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:06.242 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:06.254 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:06.249+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:06.275 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:06.275 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:06.291 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:06.291 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:06.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:06.292 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:06.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.292 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.293 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:12:06.293 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.391486510999997, 2024-09-21T09:12:06.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011873984000000001, 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 87 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898151+0000", 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9599999999999999e-07 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898264+0000", 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112509 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898277+0000", 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.38e-05 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898286+0000", 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7299999999999994e-06 2024-09-21T09:12:06.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906279+0000", 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079924090000000007 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906410+0000", 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013102900000000001 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906618+0000", 2024-09-21T09:12:06.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020801500000000001 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909645+0000", 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030275329999999998 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909823+0000", 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017825499999999999 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909906+0000", 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2688999999999994e-05 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910024+0000", 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118319 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.391334469, 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01257903, 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 88 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.569999999999999e-07 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898310+0000", 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0360000000000003e-06 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898320+0000", 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0373999999999999e-05 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898327+0000", 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1960000000000002e-06 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908138+0000", 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.009810849 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908334+0000", 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000196059 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908540+0000", 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000205775 2024-09-21T09:12:06.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910074+0000", 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001534363 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910609+0000", 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053462599999999996 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910764+0000", 2024-09-21T09:12:06.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015484599999999999 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910882+0000", 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011794900000000001 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.215017265, 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012244817999999999, 2024-09-21T09:12:06.305 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 110 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7100000000000002e-07 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074625+0000", 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3939999999999998e-06 2024-09-21T09:12:06.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074676+0000", 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1369999999999998e-05 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074681+0000", 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7690000000000004e-06 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079388+0000", 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047075550000000004 2024-09-21T09:12:06.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079454+0000", 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5639e-05 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079548+0000", 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4299e-05 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081984+0000", 2024-09-21T09:12:06.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024359239999999999 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086803+0000", 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048185880000000004 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086835+0000", 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2487999999999998e-05 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086865+0000", 2024-09-21T09:12:06.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9320999999999999e-05 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.214945909999997, 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012339861000000001, 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.311 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 111 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5900000000000003e-07 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074695+0000", 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4410000000000002e-06 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074707+0000", 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2376e-05 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074711+0000", 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9879999999999998e-06 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079878+0000", 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051667869999999999 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080012+0000", 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013358700000000001 2024-09-21T09:12:06.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080288+0000", 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027684299999999998 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081987+0000", 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016981450000000001 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086920+0000", 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049329780000000002 2024-09-21T09:12:06.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086966+0000", 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6718999999999998e-05 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.087031+0000", 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4638e-05 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.214914859999993, 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013449694999999999, 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 112 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5699999999999998e-07 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074789+0000", 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6396000000000006e-05 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074796+0000", 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0190000000000001e-06 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074802+0000", 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9290000000000003e-06 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080677+0000", 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058755839999999997 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080739+0000", 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1866999999999996e-05 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080833+0000", 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3572000000000005e-05 2024-09-21T09:12:06.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083415+0000", 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025824870000000001 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088053+0000", 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004637426 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088105+0000", 2024-09-21T09:12:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1993000000000002e-05 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088172+0000", 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7064999999999996e-05 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.214826762000001, 2024-09-21T09:12:06.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013475117999999999, 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 113 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074811+0000", 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6800000000000001e-07 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074814+0000", 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9919999999999999e-06 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074820+0000", 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5060000000000001e-06 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074823+0000", 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3289999999999998e-06 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081613+0000", 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006789331 2024-09-21T09:12:06.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081666+0000", 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3482000000000001e-05 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081745+0000", 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8454999999999993e-05 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083786+0000", 2024-09-21T09:12:06.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020410850000000002 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088227+0000", 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044407819999999999 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088260+0000", 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3321000000000002e-05 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088285+0000", 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5466999999999999e-05 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.214716162000002, 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013454595, 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.328 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 114 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:12:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074922+0000", 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7100000000000001e-07 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074925+0000", 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8060000000000001e-06 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074933+0000", 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7929999999999998e-06 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074937+0000", 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.749e-06 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082054+0000", 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071175259999999999 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082199+0000", 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014503199999999999 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082445+0000", 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245331 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083789+0000", 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001343943 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088319+0000", 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045298530000000004 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088350+0000", 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1408000000000002e-05 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088375+0000", 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5483e-05 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.333 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.214438803999997, 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013331543, 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.334 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 115 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075199+0000", 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1699999999999998e-07 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075281+0000", 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2151999999999995e-05 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075291+0000", 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0495e-05 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075298+0000", 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8920000000000003e-06 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082855+0000", 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075570790000000004 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082909+0000", 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3106000000000003e-05 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082988+0000", 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9515e-05 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085228+0000", 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002239736 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088425+0000", 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003197044 2024-09-21T09:12:06.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088470+0000", 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5281000000000002e-05 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088530+0000", 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9626000000000001e-05 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.214327306000001, 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013307090000000001, 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 116 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.27e-07 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075314+0000", 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4249999999999998e-06 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075318+0000", 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7829999999999998e-06 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075321+0000", 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1370000000000002e-06 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083883+0000", 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0085611369999999999 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083976+0000", 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3492000000000005e-05 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084091+0000", 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114993 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085233+0000", 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011417409999999999 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088565+0000", 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003332532 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088595+0000", 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9675e-05 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088617+0000", 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1747999999999999e-05 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.214310093999998, 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013638091, 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.345 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 117 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:06.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.53e-07 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075330+0000", 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.281e-06 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075336+0000", 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7339999999999996e-06 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075340+0000", 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4010000000000001e-06 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084504+0000", 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091640230000000003 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084560+0000", 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6595000000000003e-05 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084644+0000", 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3326999999999997e-05 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085387+0000", 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074348199999999995 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088913+0000", 2024-09-21T09:12:06.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003525855 2024-09-21T09:12:06.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088944+0000", 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1621000000000001e-05 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088965+0000", 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0519000000000001e-05 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:132 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.705426243999995, 2024-09-21T09:12:06.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013217052999999999, 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 132 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584212+0000", 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7700000000000003e-07 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584218+0000", 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584229+0000", 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1046000000000001e-05 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584237+0000", 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0800000000000006e-06 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590506+0000", 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062689440000000003 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590742+0000", 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023612500000000001 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.591121+0000", 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037905099999999999 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593798+0000", 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026770079999999998 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597134+0000", 2024-09-21T09:12:06.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033363009999999999 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597279+0000", 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144945 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597428+0000", 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014840599999999999 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.356 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.705255137999998, 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013710092, 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 133 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:12:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584383+0000", 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1960000000000001e-06 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584391+0000", 2024-09-21T09:12:06.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7239999999999992e-06 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584407+0000", 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6138999999999999e-05 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584416+0000", 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5540000000000003e-06 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592608+0000", 2024-09-21T09:12:06.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081912370000000005 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592746+0000", 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138512 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592970+0000", 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022379600000000001 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597628+0000", 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046579669999999998 2024-09-21T09:12:06.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597829+0000", 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020085599999999999 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597967+0000", 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013828899999999999 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598092+0000", 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012482199999999999 2024-09-21T09:12:06.361 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.705203221999994, 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013969944, 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.362 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 134 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1699999999999997e-07 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584594+0000", 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015906899999999999 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584608+0000", 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.417e-05 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584617+0000", 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2960000000000004e-06 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593907+0000", 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0092901630000000006 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594043+0000", 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013558600000000001 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594285+0000", 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024269499999999999 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597788+0000", 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035024119999999999 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598121+0000", 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033284100000000001 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598256+0000", 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000134816 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598404+0000", 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014817899999999999 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.367 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.705002070000006, 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015773928, 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 135 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584636+0000", 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8700000000000004e-07 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584642+0000", 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2099999999999998e-06 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584653+0000", 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536e-05 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584660+0000", 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.627e-06 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595480+0000", 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010820214999999999 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595726+0000", 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245682 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.596110+0000", 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038419799999999998 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600117+0000", 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004006618 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600255+0000", 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013840599999999999 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600346+0000", 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0666000000000002e-05 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600409+0000", 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2883000000000001e-05 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.704964306999997, 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020097924999999999, 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.373 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 136 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000004e-07 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584679+0000", 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6069999999999998e-06 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584694+0000", 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4579999999999999e-05 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584702+0000", 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0730000000000005e-06 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598512+0000", 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013810578 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598748+0000", 2024-09-21T09:12:06.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000236176 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.599125+0000", 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037634399999999997 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604492+0000", 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053673560000000002 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604613+0000", 2024-09-21T09:12:06.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121039 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604703+0000", 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0399e-05 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604771+0000", 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7119999999999994e-05 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.704922831000005, 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020579828000000001, 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 137 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584715+0000", 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000005e-07 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584888+0000", 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000173456 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584903+0000", 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.487e-05 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584913+0000", 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9899999999999992e-06 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600531+0000", 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015617987999999999 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600765+0000", 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023383900000000001 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.601148+0000", 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038257100000000001 2024-09-21T09:12:06.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604980+0000", 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003832326 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605028+0000", 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8059999999999997e-05 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605166+0000", 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000137959 2024-09-21T09:12:06.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605294+0000", 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012808200000000001 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.704701088999997, 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024357648999999999, 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.384 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 138 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584937+0000", 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.54e-07 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584943+0000", 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6229999999999999e-06 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584959+0000", 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5489999999999999e-05 2024-09-21T09:12:06.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584968+0000", 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.516e-06 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.602849+0000", 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017880314000000001 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603120+0000", 2024-09-21T09:12:06.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027100799999999999 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603521+0000", 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040112399999999999 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.608899+0000", 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053779300000000004 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609024+0000", 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125699 2024-09-21T09:12:06.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609140+0000", 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115982 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609294+0000", 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015310899999999999 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.389 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.704653348999997, 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024897698999999999, 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 139 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:06.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7999999999999995e-07 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584997+0000", 2024-09-21T09:12:06.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2556e-05 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585013+0000", 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5800000000000001e-05 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585021+0000", 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3340000000000002e-06 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605435+0000", 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020414299 2024-09-21T09:12:06.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605604+0000", 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000168615 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605803+0000", 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199256 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609392+0000", 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035888719999999999 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609598+0000", 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020643500000000001 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609747+0000", 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014889600000000001 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609881+0000", 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013395599999999999 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.394 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.704600412999994, 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025121831000000001, 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.395 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 140 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:06.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5400000000000001e-07 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585185+0000", 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014761900000000001 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585199+0000", 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4450000000000001e-05 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585209+0000", 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2099999999999999e-06 2024-09-21T09:12:06.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606615+0000", 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021406261999999999 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606858+0000", 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024295499999999999 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.607232+0000", 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037427700000000001 2024-09-21T09:12:06.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609554+0000", 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023222210000000002 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609917+0000", 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036226800000000001 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610051+0000", 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013447599999999999 2024-09-21T09:12:06.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610158+0000", 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107439 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.704411961000005, 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.027901532, 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:06.400 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 141 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:12:06.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585226+0000", 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5999999999999991e-07 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585238+0000", 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1717e-05 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585248+0000", 2024-09-21T09:12:06.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0776e-05 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585256+0000", 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8140000000000001e-06 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610278+0000", 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025021297000000001 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610421+0000", 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014358900000000001 2024-09-21T09:12:06.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610631+0000", 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021016900000000001 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612016+0000", 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001385037 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612841+0000", 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082419399999999999 2024-09-21T09:12:06.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612997+0000", 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000156186 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.613127+0000", 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012979300000000001 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:06.405 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:06.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:06.407 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:06.404+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:06.507 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:06.504+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:06.609 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:06.604+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:06.622 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:06.622 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:06.622 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:06.622 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:06.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:06.733 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:06.732+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:06.811 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:06.805+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:06.854 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:06.855 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:06.855 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:06.855 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:06.855 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:06.872 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:06.912 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:06.909+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:07.013 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:07.009+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:07.091 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:07.091 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:07.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:07.091 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:07.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4358.0:40 5.1c 5:3fce9a59:::zonegroup_info.6661b8ba-4ecc-4129-afb2-8d0efd9659c2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.201078827000003, 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028118549999999998, 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4358", 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3756932968", 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 40 2024-09-21T09:12:07.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885826+0000", 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4899999999999999e-06 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885835+0000", 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5299999999999996e-06 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885857+0000", 2024-09-21T09:12:07.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1679999999999999e-05 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885871+0000", 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4146e-05 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885969+0000", 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8212000000000001e-05 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886181+0000", 2024-09-21T09:12:07.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021209000000000001 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886450+0000", 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026841000000000001 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.887864+0000", 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001414722 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888500+0000", 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063535399999999998 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888562+0000", 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2176999999999998e-05 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888637+0000", 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5043999999999995e-05 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:214 6.1c e36/30 6:3e426232:gc::gc.9:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.165885142, 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015590160000000001, 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:07.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.13e-07 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921028+0000", 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9639999999999992e-06 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921060+0000", 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1822000000000001e-05 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921076+0000", 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6252999999999998e-05 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921213+0000", 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013652299999999999 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921250+0000", 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7685999999999998e-05 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922504+0000", 2024-09-21T09:12:07.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001253185 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922578+0000", 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4070000000000001e-05 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.155696652000003, 2024-09-21T09:12:07.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036169079999999998, 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 217 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:07.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931210+0000", 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6529999999999998e-06 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931223+0000", 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3667e-05 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931257+0000", 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3742999999999999e-05 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931273+0000", 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5366000000000002e-05 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931414+0000", 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136300000000001 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931673+0000", 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025924500000000002 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.932066+0000", 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0003927 2024-09-21T09:12:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.933852+0000", 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017863180000000001 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934605+0000", 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075312800000000004 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934696+0000", 2024-09-21T09:12:07.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0328999999999995e-05 2024-09-21T09:12:07.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934824+0000", 2024-09-21T09:12:07.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128396 2024-09-21T09:12:07.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.109 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:229 6.1b e36/30 6:db9d130d:gc::gc.24:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.110249695, 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015706159999999999, 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976655+0000", 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8699999999999995e-07 2024-09-21T09:12:07.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976661+0000", 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7599999999999997e-06 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976686+0000", 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4396000000000002e-05 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976699+0000", 2024-09-21T09:12:07.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3336000000000001e-05 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976836+0000", 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013669299999999999 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976871+0000", 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4913000000000003e-05 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978136+0000", 2024-09-21T09:12:07.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001264851 2024-09-21T09:12:07.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978225+0000", 2024-09-21T09:12:07.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9179999999999997e-05 2024-09-21T09:12:07.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.114 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.115 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.115 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.115 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.082518323000002, 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001626368, 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 237 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004389+0000", 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5099999999999999e-06 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004408+0000", 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9154e-05 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004453+0000", 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4385999999999998e-05 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004475+0000", 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2853e-05 2024-09-21T09:12:07.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004585+0000", 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000109546 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004656+0000", 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0988999999999994e-05 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004818+0000", 2024-09-21T09:12:07.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016166600000000001 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005536+0000", 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071806799999999998 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005917+0000", 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038119100000000002 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005956+0000", 2024-09-21T09:12:07.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9255999999999998e-05 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.006012+0000", 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5748999999999998e-05 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:253 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.078841924000002, 2024-09-21T09:12:07.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001548546, 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 253 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:07.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008063+0000", 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.263e-06 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008070+0000", 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1369999999999996e-06 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008087+0000", 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6263999999999999e-05 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008096+0000", 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6670000000000008e-06 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008178+0000", 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1644999999999995e-05 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008240+0000", 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2453999999999995e-05 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008448+0000", 2024-09-21T09:12:07.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020722899999999999 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009447+0000", 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099947600000000001 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009547+0000", 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100268 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009582+0000", 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4459999999999999e-05 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009610+0000", 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8683e-05 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:709 6.1e e36/30 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:07.127 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.843135334999999, 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015262559999999999, 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243769+0000", 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9999999999999996e-07 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243776+0000", 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0999999999999998e-06 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243790+0000", 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3882e-05 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243800+0000", 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0083e-05 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243943+0000", 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014281799999999999 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243990+0000", 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7157000000000003e-05 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245247+0000", 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012564200000000001 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245295+0000", 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7895999999999997e-05 2024-09-21T09:12:07.131 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.820243326000003, 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023946290000000001, 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.132 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 721 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266663+0000", 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5289999999999998e-06 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266676+0000", 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.292e-05 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266705+0000", 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8816999999999999e-05 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266732+0000", 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7134000000000001e-05 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266844+0000", 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111848 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267038+0000", 2024-09-21T09:12:07.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019389 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267357+0000", 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000319172 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268435+0000", 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010780430000000001 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268984+0000", 2024-09-21T09:12:07.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054955599999999998 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269022+0000", 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7973999999999999e-05 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269055+0000", 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2746000000000001e-05 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.817269031999999, 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002147342, 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 723 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.138 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269636+0000", 2024-09-21T09:12:07.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4720000000000001e-06 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269645+0000", 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.32e-06 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269667+0000", 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2487999999999999e-05 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269678+0000", 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0794e-05 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269735+0000", 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269784+0000", 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8266999999999997e-05 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:07.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269905+0000", 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121012 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.270906+0000", 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00100125 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271576+0000", 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066977200000000001 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271666+0000", 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9952999999999997e-05 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271782+0000", 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116469 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:775 6.1e e36/30 6:7db93595:::obj_delete_at_hint.0000000066:head v 36'5, mlcod=36'3)", 2024-09-21T09:12:07.143 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.695457243999996, 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015332430000000001, 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391448+0000", 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7570000000000001e-06 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391462+0000", 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3256e-05 2024-09-21T09:12:07.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391491+0000", 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9753000000000001e-05 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391515+0000", 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3623999999999999e-05 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391667+0000", 2024-09-21T09:12:07.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152065 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391732+0000", 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5099999999999997e-05 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392906+0000", 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011735719999999999 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392980+0000", 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4116000000000007e-05 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:778 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'4, mlcod=36'2)", 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.688220047000002, 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015037570000000001, 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398686+0000", 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8369999999999999e-06 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398703+0000", 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7363e-05 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398731+0000", 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8367000000000001e-05 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398745+0000", 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.385e-05 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398923+0000", 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177818 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398963+0000", 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9867000000000003e-05 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400088+0000", 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011250380000000001 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400188+0000", 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9617000000000005e-05 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.152 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:780 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'5, mlcod=36'3)", 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.683374100000002, 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001427673, 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403531+0000", 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6729999999999999e-06 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403568+0000", 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6693000000000003e-05 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403597+0000", 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9130000000000001e-05 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403611+0000", 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3643e-05 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403781+0000", 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016968300000000001 2024-09-21T09:12:07.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403820+0000", 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9768999999999998e-05 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404868+0000", 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001047493 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404957+0000", 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9588999999999999e-05 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:814 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'7, mlcod=36'5)", 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.601405298000003, 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014758, 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485500+0000", 2024-09-21T09:12:07.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.843e-06 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485513+0000", 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2284e-05 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485542+0000", 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9102999999999999e-05 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485555+0000", 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.375e-05 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485660+0000", 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104849 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485719+0000", 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8842999999999999e-05 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486885+0000", 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011654250000000001 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486974+0000", 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9703000000000005e-05 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:816 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'8, mlcod=36'6)", 2024-09-21T09:12:07.161 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.597779060000001, 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016647159999999999, 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:07.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489127+0000", 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489142+0000", 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5400000000000002e-05 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489177+0000", 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4894000000000002e-05 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489196+0000", 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8873e-05 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489355+0000", 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015918799999999999 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489424+0000", 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8572999999999996e-05 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490705+0000", 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012817079999999999 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490789+0000", 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4019999999999999e-05 2024-09-21T09:12:07.165 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:844 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'12, mlcod=36'10)", 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.530600325000002, 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015352059999999999, 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556305+0000", 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.73e-06 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556317+0000", 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2233e-05 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556348+0000", 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0176e-05 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556361+0000", 2024-09-21T09:12:07.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3694e-05 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556511+0000", 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014973800000000001 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556567+0000", 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6273999999999997e-05 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557740+0000", 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001173065 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557839+0000", 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8295999999999995e-05 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:846 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'13, mlcod=36'11)", 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.526863534, 2024-09-21T09:12:07.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014368810000000001, 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:07.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560042+0000", 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6500000000000001e-06 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560056+0000", 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4233000000000001e-05 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560085+0000", 2024-09-21T09:12:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8767000000000001e-05 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560098+0000", 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3436e-05 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560242+0000", 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000143199 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560305+0000", 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3269999999999996e-05 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561354+0000", 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010487630000000001 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561477+0000", 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012356300000000001 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.174 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.371277151999998, 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028068680000000001, 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.175 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 910 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715630+0000", 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.92e-06 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715647+0000", 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715680+0000", 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3572999999999999e-05 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715696+0000", 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5777000000000002e-05 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715819+0000", 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000122972 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716044+0000", 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022481500000000001 2024-09-21T09:12:07.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716365+0000", 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032138400000000003 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.717426+0000", 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001061223 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718214+0000", 2024-09-21T09:12:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078753099999999995 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718304+0000", 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0426999999999993e-05 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718434+0000", 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012908900000000001 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.367320098999997, 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031243310000000002, 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 912 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.181 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719585+0000", 2024-09-21T09:12:07.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.72e-06 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719597+0000", 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1229999999999999e-05 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719621+0000", 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4073000000000001e-05 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719633+0000", 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.259e-05 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719761+0000", 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012745599999999999 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720000+0000", 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023914800000000001 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720482+0000", 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048253400000000001 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.721627+0000", 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001145002 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722556+0000", 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092825299999999998 2024-09-21T09:12:07.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722640+0000", 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4542999999999993e-05 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722708+0000", 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7781999999999996e-05 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.327165862000001, 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014824689999999999, 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759740+0000", 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7370000000000001e-06 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759752+0000", 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2483000000000001e-05 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759782+0000", 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9553e-05 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759798+0000", 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6042999999999999e-05 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759943+0000", 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760001+0000", 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8777000000000003e-05 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761134+0000", 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001132922 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761220+0000", 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6044999999999994e-05 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.190 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1020 6.10 e45/30 6:0fbdcb32:usage::usage.17:head v 45'5, mlcod=36'3)", 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.047626243, 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001677574, 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039281+0000", 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0939999999999999e-06 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039305+0000", 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3906000000000001e-05 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039349+0000", 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4064999999999999e-05 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039379+0000", 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9889000000000001e-05 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039517+0000", 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013895300000000001 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039574+0000", 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6162000000000002e-05 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040855+0000", 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001281821 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040955+0000", 2024-09-21T09:12:07.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9684000000000003e-05 2024-09-21T09:12:07.195 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.195 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.195 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.195 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.195 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.195 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:07.196 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:07.197 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:07.192+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:07.297 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:07.296+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:07.399 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:07.396+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:07.412 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:07.412 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:07.412 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:07.412 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:07.429 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:07.500 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:07.497+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:07.600 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:07.596+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:07.642 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:07.642 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:07.642 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:07.642 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:07.642 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:07.659 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:07.701 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:07.700+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:07.803 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:07.800+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:07.874 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:07.874 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:07.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:07.874 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:07.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 78.097937447999996, 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073206360000000002, 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:12:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 5 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772825+0000", 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7129999999999999e-06 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772843+0000", 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8033000000000002e-05 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772882+0000", 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9434000000000002e-05 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772902+0000", 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0075999999999999e-05 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773008+0000", 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105351 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773016+0000", 2024-09-21T09:12:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1419999999999993e-06 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776094+0000", 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030782549999999998 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776289+0000", 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019460899999999999 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776487+0000", 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000198142 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.778052+0000", 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001565812 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.779852+0000", 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001799171 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780015+0000", 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000162862 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780142+0000", 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012703599999999999 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 77.095315603000003, 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01128114, 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2024-09-21T09:12:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775446+0000", 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775478+0000", 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775525+0000", 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7734000000000001e-05 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775559+0000", 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4133e-05 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775753+0000", 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000193248 2024-09-21T09:12:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775773+0000", 2024-09-21T09:12:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0086999999999999e-05 2024-09-21T09:12:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783330+0000", 2024-09-21T09:12:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075572979999999996 2024-09-21T09:12:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783469+0000", 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138839 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783767+0000", 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029823499999999999 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.785719+0000", 2024-09-21T09:12:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00195207 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786427+0000", 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070740099999999997 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786600+0000", 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017295900000000001 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786724+0000", 2024-09-21T09:12:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012436599999999999 2024-09-21T09:12:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:12:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 65.029680279999994, 2024-09-21T09:12:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011832176, 2024-09-21T09:12:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:12:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 43 2024-09-21T09:12:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841082+0000", 2024-09-21T09:12:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9870000000000001e-06 2024-09-21T09:12:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841121+0000", 2024-09-21T09:12:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8593000000000001e-05 2024-09-21T09:12:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841153+0000", 2024-09-21T09:12:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2716000000000003e-05 2024-09-21T09:12:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841179+0000", 2024-09-21T09:12:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5190000000000001e-05 2024-09-21T09:12:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841332+0000", 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000153509 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841368+0000", 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6183000000000002e-05 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845655+0000", 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00428642 2024-09-21T09:12:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845676+0000", 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1687000000000001e-05 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852576+0000", 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0068992860000000001 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852910+0000", 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033460500000000003 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.957698026000003, 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0099467879999999998, 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 214 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913064+0000", 2024-09-21T09:12:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9439999999999998e-06 2024-09-21T09:12:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913079+0000", 2024-09-21T09:12:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4966e-05 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913119+0000", 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9297e-05 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913147+0000", 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8776e-05 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913293+0000", 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014535899999999999 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913303+0000", 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0243e-05 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920048+0000", 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067448569999999999 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920345+0000", 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000297454 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920742+0000", 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039676499999999999 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922048+0000", 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00130641 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922865+0000", 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081690500000000004 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922947+0000", 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1751999999999999e-05 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923007+0000", 2024-09-21T09:12:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0059999999999998e-05 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.927829488, 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033742799999999999, 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 220 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942931+0000", 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4030000000000001e-06 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942943+0000", 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942976+0000", 2024-09-21T09:12:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3120000000000001e-05 2024-09-21T09:12:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942991+0000", 2024-09-21T09:12:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5376999999999999e-05 2024-09-21T09:12:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943103+0000", 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011184900000000001 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943318+0000", 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021467900000000001 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943715+0000", 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039689700000000001 2024-09-21T09:12:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.945217+0000", 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001501973 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946150+0000", 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093294700000000005 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946234+0000", 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4425000000000006e-05 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946303+0000", 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9016999999999993e-05 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.909131334000001, 2024-09-21T09:12:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031516420000000001, 2024-09-21T09:12:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 225 2024-09-21T09:12:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961629+0000", 2024-09-21T09:12:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1730000000000002e-06 2024-09-21T09:12:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961640+0000", 2024-09-21T09:12:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0927000000000001e-05 2024-09-21T09:12:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961671+0000", 2024-09-21T09:12:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1032999999999999e-05 2024-09-21T09:12:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961686+0000", 2024-09-21T09:12:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5304000000000001e-05 2024-09-21T09:12:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961813+0000", 2024-09-21T09:12:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012683900000000001 2024-09-21T09:12:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962030+0000", 2024-09-21T09:12:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021637499999999999 2024-09-21T09:12:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962446+0000", 2024-09-21T09:12:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041634700000000002 2024-09-21T09:12:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.963645+0000", 2024-09-21T09:12:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011985279999999999 2024-09-21T09:12:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964623+0000", 2024-09-21T09:12:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000978673 2024-09-21T09:12:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964713+0000", 2024-09-21T09:12:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9660000000000006e-05 2024-09-21T09:12:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964779+0000", 2024-09-21T09:12:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5783000000000004e-05 2024-09-21T09:12:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:228 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.898820164, 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032433039999999998, 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 228 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971940+0000", 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1100000000000001e-06 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971951+0000", 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0556e-05 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971982+0000", 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1442999999999997e-05 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971998+0000", 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5673000000000001e-05 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972130+0000", 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000132213 2024-09-21T09:12:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972337+0000", 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020659899999999999 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972731+0000", 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039369699999999998 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.974129+0000", 2024-09-21T09:12:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013981029999999999 2024-09-21T09:12:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975031+0000", 2024-09-21T09:12:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090264399999999997 2024-09-21T09:12:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975116+0000", 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4616000000000004e-05 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975182+0000", 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5649999999999997e-05 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.884684974999999, 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030216219999999998, 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 232 2024-09-21T09:12:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986076+0000", 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3130000000000001e-06 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986087+0000", 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1387e-05 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986118+0000", 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986134+0000", 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.524e-05 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986241+0000", 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010744899999999999 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986461+0000", 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021971600000000001 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986879+0000", 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041845000000000001 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988536+0000", 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001657045 2024-09-21T09:12:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988933+0000", 2024-09-21T09:12:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695699999999997 2024-09-21T09:12:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989021+0000", 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7947000000000003e-05 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989095+0000", 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3812000000000004e-05 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.877760443, 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032333710000000001, 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 234 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993000+0000", 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993011+0000", 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0647e-05 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993040+0000", 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9456999999999999e-05 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993055+0000", 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.485e-05 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993166+0000", 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000110942 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993409+0000", 2024-09-21T09:12:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242871 2024-09-21T09:12:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993829+0000", 2024-09-21T09:12:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000420154 2024-09-21T09:12:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.995035+0000", 2024-09-21T09:12:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001206295 2024-09-21T09:12:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996079+0000", 2024-09-21T09:12:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00104407 2024-09-21T09:12:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996167+0000", 2024-09-21T09:12:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7440000000000003e-05 2024-09-21T09:12:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996231+0000", 2024-09-21T09:12:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4589000000000001e-05 2024-09-21T09:12:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.480231666000002, 2024-09-21T09:12:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029466929999999998, 2024-09-21T09:12:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 775 2024-09-21T09:12:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390530+0000", 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9270000000000001e-06 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390542+0000", 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2016e-05 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390574+0000", 2024-09-21T09:12:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2199999999999997e-05 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390589+0000", 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5339999999999999e-05 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390719+0000", 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012939599999999999 2024-09-21T09:12:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390928+0000", 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000209898 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391244+0000", 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031530799999999998 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392535+0000", 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001291008 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393288+0000", 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075327100000000002 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393404+0000", 2024-09-21T09:12:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011562599999999999 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393473+0000", 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9703000000000007e-05 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:784 6.8 6:1111b601:::obj_delete_at_hint.0000000069:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.457544321, 2024-09-21T09:12:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003135367, 2024-09-21T09:12:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 784 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413216+0000", 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.784e-06 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413225+0000", 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8580000000000006e-06 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413249+0000", 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4212000000000001e-05 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413260+0000", 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1514e-05 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413401+0000", 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014083699999999999 2024-09-21T09:12:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413625+0000", 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022383099999999999 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413942+0000", 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317375 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.415132+0000", 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001189072 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416200+0000", 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010679979999999999 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416282+0000", 2024-09-21T09:12:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2713999999999994e-05 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416349+0000", 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7172e-05 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.386201225999997, 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029415460000000002, 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 814 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484559+0000", 2024-09-21T09:12:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:12:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484570+0000", 2024-09-21T09:12:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.098e-05 2024-09-21T09:12:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484601+0000", 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1062999999999997e-05 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484616+0000", 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4735999999999999e-05 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484747+0000", 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000130729 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484965+0000", 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217982 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485271+0000", 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000306488 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486347+0000", 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010752030000000001 2024-09-21T09:12:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487293+0000", 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094605299999999998 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487379+0000", 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6558999999999996e-05 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487499+0000", 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011955000000000001 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.382375582999998, 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029122929999999998, 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 816 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488385+0000", 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8700000000000001e-06 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488395+0000", 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0723000000000001e-05 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488420+0000", 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.508e-05 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488433+0000", 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2317000000000001e-05 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488538+0000", 2024-09-21T09:12:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105475 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488669+0000", 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000131073 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488940+0000", 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027115100000000002 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490015+0000", 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010748159999999999 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491096+0000", 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001080733 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491179+0000", 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2942999999999995e-05 2024-09-21T09:12:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491295+0000", 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116112 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.336405972999998, 2024-09-21T09:12:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003172818, 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 835 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534355+0000", 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2840000000000001e-06 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534366+0000", 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1396000000000001e-05 2024-09-21T09:12:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534398+0000", 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1823999999999999e-05 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534413+0000", 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4919999999999999e-05 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534528+0000", 2024-09-21T09:12:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115209 2024-09-21T09:12:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534749+0000", 2024-09-21T09:12:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022136500000000001 2024-09-21T09:12:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.535063+0000", 2024-09-21T09:12:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031351399999999998 2024-09-21T09:12:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.536086+0000", 2024-09-21T09:12:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010234899999999999 2024-09-21T09:12:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537283+0000", 2024-09-21T09:12:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011962819999999999 2024-09-21T09:12:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537407+0000", 2024-09-21T09:12:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123819 2024-09-21T09:12:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537525+0000", 2024-09-21T09:12:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118715 2024-09-21T09:12:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.315401481000002, 2024-09-21T09:12:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030129000000000002, 2024-09-21T09:12:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 844 2024-09-21T09:12:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555359+0000", 2024-09-21T09:12:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:12:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555369+0000", 2024-09-21T09:12:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0207000000000001e-05 2024-09-21T09:12:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555398+0000", 2024-09-21T09:12:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8822999999999998e-05 2024-09-21T09:12:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555412+0000", 2024-09-21T09:12:07.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4443e-05 2024-09-21T09:12:07.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555537+0000", 2024-09-21T09:12:07.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012447900000000001 2024-09-21T09:12:07.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555756+0000", 2024-09-21T09:12:07.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021879899999999999 2024-09-21T09:12:07.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:07.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556069+0000", 2024-09-21T09:12:07.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031338399999999999 2024-09-21T09:12:07.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:07.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557174+0000", 2024-09-21T09:12:07.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011049860000000001 2024-09-21T09:12:07.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:07.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558209+0000", 2024-09-21T09:12:07.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034653 2024-09-21T09:12:07.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:07.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558297+0000", 2024-09-21T09:12:07.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8446e-05 2024-09-21T09:12:07.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:07.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558370+0000", 2024-09-21T09:12:07.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2700000000000005e-05 2024-09-21T09:12:07.991 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.991 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:07.991 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:07.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.992 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:864 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:07.992 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:07.992 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.268862980999998, 2024-09-21T09:12:07.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002853324, 2024-09-21T09:12:07.992 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:07.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:07.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:07.993 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:07.993 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:07.993 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:07.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 864 2024-09-21T09:12:07.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.993 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:07.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:07.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:07.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:07.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:07.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:07.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:07.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601897+0000", 2024-09-21T09:12:07.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.61e-06 2024-09-21T09:12:07.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:07.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601905+0000", 2024-09-21T09:12:07.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2470000000000008e-06 2024-09-21T09:12:07.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:07.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601930+0000", 2024-09-21T09:12:07.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4885999999999999e-05 2024-09-21T09:12:07.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:07.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601949+0000", 2024-09-21T09:12:07.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9006000000000001e-05 2024-09-21T09:12:07.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:07.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602078+0000", 2024-09-21T09:12:07.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012905600000000001 2024-09-21T09:12:07.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:07.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:07.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:07.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602220+0000", 2024-09-21T09:12:07.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141586 2024-09-21T09:12:08.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:08.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602489+0000", 2024-09-21T09:12:08.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026938199999999998 2024-09-21T09:12:08.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.603606+0000", 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011163880000000001 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604600+0000", 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099397700000000005 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:08.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604685+0000", 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5740000000000002e-05 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604749+0000", 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3446000000000002e-05 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.002 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.147860373999997, 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031274219999999999, 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 913 2024-09-21T09:12:08.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:08.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722901+0000", 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722912+0000", 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1693e-05 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722944+0000", 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.222e-05 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722959+0000", 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4902999999999999e-05 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723110+0000", 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015031500000000001 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723344+0000", 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000234799 2024-09-21T09:12:08.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723667+0000", 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032255100000000002 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.724725+0000", 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010575859999999999 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725873+0000", 2024-09-21T09:12:08.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001148579 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725961+0000", 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8063e-05 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.726025+0000", 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4156e-05 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.143752522, 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029665730000000001, 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 915 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.009 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:08.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727008+0000", 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7129999999999999e-06 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727016+0000", 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6600000000000001e-06 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727041+0000", 2024-09-21T09:12:08.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5253e-05 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727055+0000", 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3403e-05 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727227+0000", 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017192600000000001 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:08.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727363+0000", 2024-09-21T09:12:08.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013665199999999999 2024-09-21T09:12:08.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:08.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727627+0000", 2024-09-21T09:12:08.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000263565 2024-09-21T09:12:08.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:08.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.728717+0000", 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001090029 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729815+0000", 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010975099999999999 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729908+0000", 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3029000000000007e-05 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729972+0000", 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4832999999999994e-05 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.112415984999998, 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035043000000000001, 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:08.015 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 928 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:08.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758345+0000", 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4339999999999999e-06 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758356+0000", 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1423000000000001e-05 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758389+0000", 2024-09-21T09:12:08.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2336999999999999e-05 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758408+0000", 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9706000000000001e-05 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758579+0000", 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017064599999999999 2024-09-21T09:12:08.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758939+0000", 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036013000000000001 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759516+0000", 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057737999999999995 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760877+0000", 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013600769999999999 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761559+0000", 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068295900000000002 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761727+0000", 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016766900000000001 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761847+0000", 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119539 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4216.0:2 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.872332757999999, 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049270260000000001, 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4216", 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/896302906", 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:08.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998428+0000", 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998453+0000", 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5449e-05 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:08.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998478+0000", 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4769e-05 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998502+0000", 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3448999999999999e-05 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998630+0000", 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012872299999999999 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998640+0000", 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9329999999999996e-06 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003282+0000", 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004641816 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003353+0000", 2024-09-21T09:12:08.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0627e-05 2024-09-21T09:12:08.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.026 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:08.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:08.026 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:08.026 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:08.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:08.028 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:08.025+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:08.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T09:12:08.128 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:08.125+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:08.162 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:08.162 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:08.162 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:08.162 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:08.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:08.263 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:08.261+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:08.328 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:08.324+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:08.347 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:08.347 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:08.347 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:08.347 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:08.347 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:08.361 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:08.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:08.453 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:08.452+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:08.530 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:08.525+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:08.538 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:08.538 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:08.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.675604625999995, 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083044959999999998, 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.539 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 44 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857525+0000", 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2059999999999999e-06 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857541+0000", 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5826999999999999e-05 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857608+0000", 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7353000000000004e-05 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857632+0000", 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3595999999999999e-05 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857842+0000", 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021056800000000001 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857863+0000", 2024-09-21T09:12:08.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0917e-05 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865509+0000", 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076459040000000002 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865826+0000", 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031712500000000002 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.661599344999999, 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0108574, 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 206 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.544 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871530+0000", 2024-09-21T09:12:08.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871545+0000", 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4620000000000001e-05 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871584+0000", 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9582999999999997e-05 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871602+0000", 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8057e-05 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871776+0000", 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017372500000000001 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871792+0000", 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878149+0000", 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063566910000000003 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878502+0000", 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284800000000001 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.879223+0000", 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072110100000000003 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.881741+0000", 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025179310000000002 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882232+0000", 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00049132199999999998 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882325+0000", 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2816e-05 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882384+0000", 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9509999999999998e-05 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.650367168000002, 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032285479999999999, 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.550 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 207 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882761+0000", 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0729999999999999e-06 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882771+0000", 2024-09-21T09:12:08.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0287e-05 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882796+0000", 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4873000000000001e-05 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882811+0000", 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4752999999999999e-05 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882904+0000", 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2869999999999997e-05 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883081+0000", 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017743500000000001 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883433+0000", 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035207000000000001 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.884576+0000", 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001142405 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885843+0000", 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012676230000000001 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885921+0000", 2024-09-21T09:12:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7338999999999999e-05 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885988+0000", 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6820000000000001e-05 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.633963752, 2024-09-21T09:12:08.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033258939999999998, 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 210 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:08.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899165+0000", 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3199999999999998e-06 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899176+0000", 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1154e-05 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899209+0000", 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2580000000000003e-05 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899224+0000", 2024-09-21T09:12:08.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4976e-05 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899345+0000", 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121296 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899542+0000", 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019720499999999999 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:08.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899947+0000", 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040540299999999998 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.901475+0000", 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015280319999999999 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902217+0000", 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074172400000000003 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902369+0000", 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015137899999999999 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902488+0000", 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119825 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:08.562 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.581067670000003, 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037626880000000001, 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 222 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952061+0000", 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4700000000000001e-06 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952073+0000", 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.155e-05 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952103+0000", 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0716999999999997e-05 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952119+0000", 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5613000000000001e-05 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952271+0000", 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015167499999999999 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952654+0000", 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038366399999999998 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.953387+0000", 2024-09-21T09:12:08.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073280800000000005 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955064+0000", 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016773000000000001 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955552+0000", 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048774000000000002 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955707+0000", 2024-09-21T09:12:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154878 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955821+0000", 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114273 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.552077124, 2024-09-21T09:12:08.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030613469999999999, 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 230 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981052+0000", 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4169999999999999e-06 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981066+0000", 2024-09-21T09:12:08.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3933e-05 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981098+0000", 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2023999999999997e-05 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981114+0000", 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6453e-05 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981230+0000", 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116092 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981448+0000", 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021825499999999999 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981870+0000", 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0004214 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.983260+0000", 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013901429999999999 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.983949+0000", 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068917399999999997 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984038+0000", 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9322999999999998e-05 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984111+0000", 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2132999999999995e-05 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.52664171, 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032388619999999999, 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.574 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 238 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006487+0000", 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006497+0000", 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0457e-05 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006526+0000", 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8975999999999998e-05 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006547+0000", 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0613000000000001e-05 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006669+0000", 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121896 2024-09-21T09:12:08.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006881+0000", 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021207499999999999 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.007199+0000", 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031782099999999998 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.008434+0000", 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012349609999999999 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009576+0000", 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001141998 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009661+0000", 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5982000000000004e-05 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009723+0000", 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1940000000000007e-05 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:256 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.522429932999998, 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030661970000000001, 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.580 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 256 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010698+0000", 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5740000000000001e-06 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010707+0000", 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3530000000000001e-06 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010735+0000", 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7293000000000001e-05 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010759+0000", 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4054e-05 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010890+0000", 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131822 2024-09-21T09:12:08.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.011023+0000", 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132612 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.011351+0000", 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032816399999999998 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012826+0000", 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014745820000000001 2024-09-21T09:12:08.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013497+0000", 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00067147500000000004 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013654+0000", 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015681199999999999 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013763+0000", 2024-09-21T09:12:08.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010845600000000001 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:378 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.488098164, 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036030390000000002, 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.586 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 378 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:08.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045031+0000", 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9859999999999999e-06 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045069+0000", 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7876999999999997e-05 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045123+0000", 2024-09-21T09:12:08.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4202e-05 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045148+0000", 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4924000000000001e-05 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045310+0000", 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016157899999999999 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045542+0000", 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023267399999999999 2024-09-21T09:12:08.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045859+0000", 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000316872 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047142+0000", 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001283216 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048468+0000", 2024-09-21T09:12:08.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001325534 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048562+0000", 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4015e-05 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048631+0000", 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9159999999999995e-05 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:383 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.486082179, 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030650489999999998, 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 383 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.592 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047046+0000", 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.306e-06 2024-09-21T09:12:08.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047060+0000", 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3716999999999999e-05 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047090+0000", 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9456000000000001e-05 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047138+0000", 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.884e-05 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047236+0000", 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7141999999999999e-05 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047484+0000", 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024807200000000001 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047923+0000", 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043972599999999998 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049320+0000", 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001396883 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049881+0000", 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056092200000000005 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049991+0000", 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109709 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.050109+0000", 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118276 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:398 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:08.597 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.481642334, 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037105979999999998, 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 398 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:08.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051486+0000", 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0030000000000001e-06 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051497+0000", 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0957e-05 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051519+0000", 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2263e-05 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051531+0000", 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2306999999999999e-05 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052064+0000", 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00053253199999999995 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052392+0000", 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000327628 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052743+0000", 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035127699999999999 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053814+0000", 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010707049999999999 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055011+0000", 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001197814 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055126+0000", 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114262 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055195+0000", 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8850000000000007e-05 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:405 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.479317352000002, 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033493780000000001, 2024-09-21T09:12:08.603 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 405 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053811+0000", 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7999999999999999e-06 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053823+0000", 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1800000000000001e-05 2024-09-21T09:12:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053857+0000", 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.464e-05 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053875+0000", 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7479999999999999e-05 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054016+0000", 2024-09-21T09:12:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014128200000000001 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054142+0000", 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012590600000000001 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054426+0000", 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028461399999999998 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.056935+0000", 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025088799999999998 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057011+0000", 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6097e-05 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057091+0000", 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9098999999999996e-05 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057158+0000", 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7780000000000005e-05 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:566 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.398672335000001, 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003214822, 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.609 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 566 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134456+0000", 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1289999999999999e-06 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134467+0000", 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1396999999999999e-05 2024-09-21T09:12:08.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134499+0000", 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1111000000000001e-05 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134516+0000", 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7893999999999998e-05 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134669+0000", 2024-09-21T09:12:08.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015240100000000001 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.135038+0000", 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036941799999999999 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.135615+0000", 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057627500000000001 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137179+0000", 2024-09-21T09:12:08.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015641450000000001 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137473+0000", 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029436399999999998 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137562+0000", 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8566000000000006e-05 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137669+0000", 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107122 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:603 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.369405569999998, 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030919720000000001, 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.615 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 603 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:12:08.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163722+0000", 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.513e-06 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163730+0000", 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4930000000000001e-06 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163754+0000", 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3900000000000002e-05 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163775+0000", 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1500000000000001e-05 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163914+0000", 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013844899999999999 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.164143+0000", 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022904699999999999 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.164616+0000", 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047342400000000001 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166515+0000", 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001898903 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166641+0000", 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125573 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166721+0000", 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0513999999999995e-05 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166813+0000", 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1656000000000005e-05 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.620 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.039506842999998, 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031191460000000002, 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 817 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493622+0000", 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6800000000000002e-06 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493633+0000", 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0987e-05 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493665+0000", 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2356e-05 2024-09-21T09:12:08.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493680+0000", 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4647000000000001e-05 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493835+0000", 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015487500000000001 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.494066+0000", 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231432 2024-09-21T09:12:08.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.494380+0000", 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031386700000000001 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.495603+0000", 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012222940000000001 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496574+0000", 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00097185200000000005 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496662+0000", 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7836000000000004e-05 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496739+0000", 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6320000000000001e-05 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.626 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.982718814000002, 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030747119999999998, 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 841 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550410+0000", 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3360000000000002e-06 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550421+0000", 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1590000000000001e-05 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550454+0000", 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2206000000000003e-05 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550471+0000", 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7099999999999999e-05 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550621+0000", 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015060900000000001 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550830+0000", 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000208428 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.551146+0000", 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031587100000000001 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.552316+0000", 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011707810000000001 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553331+0000", 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010147890000000001 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553416+0000", 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4575999999999998e-05 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553482+0000", 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6426000000000004e-05 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.632 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.968901950999999, 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002967543, 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 847 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:12:08.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564226+0000", 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8560000000000001e-06 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564237+0000", 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0417e-05 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564269+0000", 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2116999999999998e-05 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564284+0000", 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4936000000000001e-05 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564454+0000", 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017048500000000001 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564661+0000", 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020732199999999999 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564967+0000", 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030554699999999998 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.566203+0000", 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012363039999999999 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567037+0000", 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00083360699999999999 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567123+0000", 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6428999999999995e-05 2024-09-21T09:12:08.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567192+0000", 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8522999999999994e-05 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.845735679000001, 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029426840000000001, 2024-09-21T09:12:08.638 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 898 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687393+0000", 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.554e-06 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687405+0000", 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2313000000000001e-05 2024-09-21T09:12:08.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687437+0000", 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1325999999999998e-05 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687452+0000", 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5449999999999999e-05 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687601+0000", 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149219 2024-09-21T09:12:08.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687842+0000", 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240418 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.688157+0000", 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031470800000000002 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.689278+0000", 2024-09-21T09:12:08.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001121768 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690187+0000", 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090817999999999997 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690267+0000", 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0284999999999994e-05 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690333+0000", 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6463000000000004e-05 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.822913520999997, 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031788189999999998, 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.644 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 907 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:12:08.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710215+0000", 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4770000000000002e-06 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710227+0000", 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1293e-05 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710258+0000", 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1585999999999999e-05 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710273+0000", 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5330000000000001e-05 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710423+0000", 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014969199999999999 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710650+0000", 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710993+0000", 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000342725 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.712231+0000", 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012387800000000001 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713240+0000", 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001008805 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713327+0000", 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6349999999999998e-05 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713392+0000", 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4953e-05 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.649 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.4935893, 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032957440000000002, 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:08.650 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1020 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:08.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039540+0000", 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1499999999999999e-06 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039558+0000", 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7549000000000001e-05 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039596+0000", 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8583e-05 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039615+0000", 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8805e-05 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039759+0000", 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143702 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040000+0000", 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024096600000000001 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040380+0000", 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038004199999999998 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.041780+0000", 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400625 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042670+0000", 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088968599999999999 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042760+0000", 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9602e-05 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042833+0000", 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3034000000000006e-05 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:08.655 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:08.656 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:08.657 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:08.657 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:08.658 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:08.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:08.658 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:08.657+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:08.670 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:08.670 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:08.700 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:08.700 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:08.732 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:08.758 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:08.753+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:08.762 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:08.762 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:08.794 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:08.794 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:08.826 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:08.827 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:08.833 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:08.833 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:08.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:08.892 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:08.889+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:08.959 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:08.953+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:09.012 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:09.013 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:09.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:09.059 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:09.056+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:09.088 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-09-21T09:12:09.161 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:09.160+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:09.205 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:09.205 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:09.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:09.261 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:09.260+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:09.346 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:09.346 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:09.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:09.362 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:09.360+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:09.463 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:09.460+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:09.488 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:09.488 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:09.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:09.565 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:09.561+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:09.630 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:09.630 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:09.645 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:09.666 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:09.664+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:09.767 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:09.765+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:09.815 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:09.815 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:09.829 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:09.872 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:09.869+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:09.970 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:09.968+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:09.999 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:10.000 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:10.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:10.071 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:10.068+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:10.143 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:10.143 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:10.158 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:10.205 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:10.204+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:10.273 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:10.272+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:10.330 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:10.330 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:10.347 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:10.375 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:10.369+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:10.475 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:10.473+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:10.561 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:10.576 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:10.572+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:10.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:10.678 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:10.673+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:10.778 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:10.777+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:10.795 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:10.795 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:10.813 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:10.850 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:10.909 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:10.908+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:10.982 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:10.980+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:10.992 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:10.992 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:11.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:11.067 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:11.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:11.081 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:11.077+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:11.099 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:11.099 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:11.117 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T09:12:11.128 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:11.128 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:11.161 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:11.182 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:11.180+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:11.188 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:11.189 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:11.195 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:11.196 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:11.210 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:11.215 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:11.216 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:11.236 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:11.271 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:11.283 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:11.281+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:11.349 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:11.349 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.449515964, 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011873984000000001, 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.350 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.351 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.351 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.351 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 87 2024-09-21T09:12:11.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.351 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:12:11.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898150+0000", 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898151+0000", 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9599999999999999e-07 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898264+0000", 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112509 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898277+0000", 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.38e-05 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898286+0000", 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7299999999999994e-06 2024-09-21T09:12:11.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906279+0000", 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079924090000000007 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906410+0000", 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013102900000000001 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.906618+0000", 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020801500000000001 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909645+0000", 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030275329999999998 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909823+0000", 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017825499999999999 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.909906+0000", 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2688999999999994e-05 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910024+0000", 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118319 2024-09-21T09:12:11.356 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.449363922000003, 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01257903, 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.357 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.358 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.358 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.358 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 88 2024-09-21T09:12:11.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.358 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:11.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:11.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898303+0000", 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.569999999999999e-07 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898310+0000", 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0360000000000003e-06 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898320+0000", 2024-09-21T09:12:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0373999999999999e-05 2024-09-21T09:12:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.898327+0000", 2024-09-21T09:12:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1960000000000002e-06 2024-09-21T09:12:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908138+0000", 2024-09-21T09:12:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.009810849 2024-09-21T09:12:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908334+0000", 2024-09-21T09:12:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000196059 2024-09-21T09:12:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.908540+0000", 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000205775 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910074+0000", 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001534363 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910609+0000", 2024-09-21T09:12:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053462599999999996 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910764+0000", 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015484599999999999 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:44.910882+0000", 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011794900000000001 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.365 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.365 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.365 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:11.365 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.273046718000003, 2024-09-21T09:12:11.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012244817999999999, 2024-09-21T09:12:11.365 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.365 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 110 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074620+0000", 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7100000000000002e-07 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074625+0000", 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3939999999999998e-06 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074676+0000", 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1369999999999998e-05 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074681+0000", 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7690000000000004e-06 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079388+0000", 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047075550000000004 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079454+0000", 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5639e-05 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079548+0000", 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4299e-05 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081984+0000", 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024359239999999999 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086803+0000", 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048185880000000004 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086835+0000", 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2487999999999998e-05 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086865+0000", 2024-09-21T09:12:11.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9320999999999999e-05 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.272975363, 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012339861000000001, 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.373 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.373 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.373 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.373 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.373 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 111 2024-09-21T09:12:11.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.373 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:11.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:11.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074691+0000", 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5900000000000003e-07 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074695+0000", 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4410000000000002e-06 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074707+0000", 2024-09-21T09:12:11.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2376e-05 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074711+0000", 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9879999999999998e-06 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.079878+0000", 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051667869999999999 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080012+0000", 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013358700000000001 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080288+0000", 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027684299999999998 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081987+0000", 2024-09-21T09:12:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016981450000000001 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086920+0000", 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049329780000000002 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.086966+0000", 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6718999999999998e-05 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.087031+0000", 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4638e-05 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.272944312999996, 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013449694999999999, 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 112 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074722+0000", 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5699999999999998e-07 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074789+0000", 2024-09-21T09:12:11.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6396000000000006e-05 2024-09-21T09:12:11.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074796+0000", 2024-09-21T09:12:11.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0190000000000001e-06 2024-09-21T09:12:11.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074802+0000", 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9290000000000003e-06 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080677+0000", 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058755839999999997 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080739+0000", 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1866999999999996e-05 2024-09-21T09:12:11.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.080833+0000", 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3572000000000005e-05 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083415+0000", 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025824870000000001 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088053+0000", 2024-09-21T09:12:11.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004637426 2024-09-21T09:12:11.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088105+0000", 2024-09-21T09:12:11.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1993000000000002e-05 2024-09-21T09:12:11.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088172+0000", 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7064999999999996e-05 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.272856215000004, 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013475117999999999, 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 113 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074810+0000", 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074811+0000", 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6800000000000001e-07 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074814+0000", 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9919999999999999e-06 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074820+0000", 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5060000000000001e-06 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074823+0000", 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3289999999999998e-06 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081613+0000", 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006789331 2024-09-21T09:12:11.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081666+0000", 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3482000000000001e-05 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.081745+0000", 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8454999999999993e-05 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083786+0000", 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020410850000000002 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088227+0000", 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044407819999999999 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088260+0000", 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3321000000000002e-05 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088285+0000", 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5466999999999999e-05 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.272745615000005, 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013454595, 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.392 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 114 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074921+0000", 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074922+0000", 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7100000000000001e-07 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074925+0000", 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8060000000000001e-06 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074933+0000", 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7929999999999998e-06 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.074937+0000", 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.749e-06 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082054+0000", 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071175259999999999 2024-09-21T09:12:11.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082199+0000", 2024-09-21T09:12:11.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014503199999999999 2024-09-21T09:12:11.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082445+0000", 2024-09-21T09:12:11.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245331 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083789+0000", 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001343943 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088319+0000", 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045298530000000004 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088350+0000", 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1408000000000002e-05 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088375+0000", 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5483e-05 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.399 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.272468257, 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013331543, 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 115 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075198+0000", 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075199+0000", 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1699999999999998e-07 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075281+0000", 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2151999999999995e-05 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075291+0000", 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0495e-05 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075298+0000", 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8920000000000003e-06 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082855+0000", 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075570790000000004 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082909+0000", 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3106000000000003e-05 2024-09-21T09:12:11.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.082988+0000", 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9515e-05 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085228+0000", 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002239736 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088425+0000", 2024-09-21T09:12:11.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003197044 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088470+0000", 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5281000000000002e-05 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088530+0000", 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9626000000000001e-05 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.272356759000004, 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013307090000000001, 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 116 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075310+0000", 2024-09-21T09:12:11.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.27e-07 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075314+0000", 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4249999999999998e-06 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075318+0000", 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7829999999999998e-06 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075321+0000", 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1370000000000002e-06 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083883+0000", 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0085611369999999999 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.083976+0000", 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3492000000000005e-05 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084091+0000", 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114993 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085233+0000", 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011417409999999999 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088565+0000", 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003332532 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088595+0000", 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9675e-05 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088617+0000", 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1747999999999999e-05 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.411 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.272339547000001, 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013638091, 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 117 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075327+0000", 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.53e-07 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075330+0000", 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.281e-06 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075336+0000", 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7339999999999996e-06 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.075340+0000", 2024-09-21T09:12:11.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4010000000000001e-06 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084504+0000", 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091640230000000003 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084560+0000", 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6595000000000003e-05 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.084644+0000", 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3326999999999997e-05 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.085387+0000", 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074348199999999995 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088913+0000", 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003525855 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088944+0000", 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1621000000000001e-05 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.088965+0000", 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0519000000000001e-05 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:132 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.417 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.763455696999998, 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013217052999999999, 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 132 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584211+0000", 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584212+0000", 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7700000000000003e-07 2024-09-21T09:12:11.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584218+0000", 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584229+0000", 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1046000000000001e-05 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584237+0000", 2024-09-21T09:12:11.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0800000000000006e-06 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590506+0000", 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062689440000000003 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.590742+0000", 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023612500000000001 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.591121+0000", 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037905099999999999 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593798+0000", 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026770079999999998 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597134+0000", 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033363009999999999 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597279+0000", 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144945 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597428+0000", 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014840599999999999 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.423 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:133 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.763284591000001, 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013710092, 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 133 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584382+0000", 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584383+0000", 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1960000000000001e-06 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584391+0000", 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7239999999999992e-06 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584407+0000", 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6138999999999999e-05 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584416+0000", 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5540000000000003e-06 2024-09-21T09:12:11.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592608+0000", 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081912370000000005 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592746+0000", 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138512 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.592970+0000", 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022379600000000001 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597628+0000", 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046579669999999998 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597829+0000", 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020085599999999999 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597967+0000", 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013828899999999999 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598092+0000", 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012482199999999999 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:11.429 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.763232674999998, 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013969944, 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 134 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:11.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584434+0000", 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1699999999999997e-07 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584594+0000", 2024-09-21T09:12:11.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015906899999999999 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584608+0000", 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.417e-05 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584617+0000", 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2960000000000004e-06 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.593907+0000", 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0092901630000000006 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594043+0000", 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013558600000000001 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.594285+0000", 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024269499999999999 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.597788+0000", 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035024119999999999 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598121+0000", 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033284100000000001 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598256+0000", 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000134816 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598404+0000", 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014817899999999999 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.763031522999995, 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015773928, 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 135 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584635+0000", 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584636+0000", 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8700000000000004e-07 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584642+0000", 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2099999999999998e-06 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584653+0000", 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536e-05 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584660+0000", 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.627e-06 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595480+0000", 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010820214999999999 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.595726+0000", 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000245682 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.596110+0000", 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038419799999999998 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600117+0000", 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004006618 2024-09-21T09:12:11.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600255+0000", 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013840599999999999 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600346+0000", 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0666000000000002e-05 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600409+0000", 2024-09-21T09:12:11.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2883000000000001e-05 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.762993760000001, 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020097924999999999, 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.441 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 136 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:11.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584673+0000", 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000004e-07 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584679+0000", 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6069999999999998e-06 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584694+0000", 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4579999999999999e-05 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584702+0000", 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0730000000000005e-06 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598512+0000", 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013810578 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.598748+0000", 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000236176 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.599125+0000", 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037634399999999997 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604492+0000", 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053673560000000002 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604613+0000", 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121039 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604703+0000", 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0399e-05 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604771+0000", 2024-09-21T09:12:11.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7119999999999994e-05 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.762952283999994, 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020579828000000001, 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 137 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584714+0000", 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584715+0000", 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000005e-07 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584888+0000", 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000173456 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584903+0000", 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.487e-05 2024-09-21T09:12:11.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584913+0000", 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9899999999999992e-06 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600531+0000", 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015617987999999999 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.600765+0000", 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023383900000000001 2024-09-21T09:12:11.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.601148+0000", 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038257100000000001 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.604980+0000", 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003832326 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605028+0000", 2024-09-21T09:12:11.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8059999999999997e-05 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605166+0000", 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000137959 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605294+0000", 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012808200000000001 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.762730542, 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024357648999999999, 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 138 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.453 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584936+0000", 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584937+0000", 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.54e-07 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584943+0000", 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6229999999999999e-06 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584959+0000", 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5489999999999999e-05 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584968+0000", 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.516e-06 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.602849+0000", 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017880314000000001 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603120+0000", 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027100799999999999 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.603521+0000", 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040112399999999999 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.608899+0000", 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053779300000000004 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609024+0000", 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125699 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609140+0000", 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115982 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609294+0000", 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015310899999999999 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.762682802, 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024897698999999999, 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 139 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584984+0000", 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7999999999999995e-07 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.584997+0000", 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2556e-05 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585013+0000", 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5800000000000001e-05 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585021+0000", 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3340000000000002e-06 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605435+0000", 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020414299 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605604+0000", 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000168615 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.605803+0000", 2024-09-21T09:12:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199256 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609392+0000", 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035888719999999999 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609598+0000", 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020643500000000001 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609747+0000", 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014889600000000001 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609881+0000", 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013395599999999999 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:11.464 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.762629865999997, 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025121831000000001, 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 140 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585037+0000", 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5400000000000001e-07 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585185+0000", 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014761900000000001 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585199+0000", 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4450000000000001e-05 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585209+0000", 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2099999999999999e-06 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606615+0000", 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021406261999999999 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.606858+0000", 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024295499999999999 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.607232+0000", 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037427700000000001 2024-09-21T09:12:11.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609554+0000", 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023222210000000002 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.609917+0000", 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036226800000000001 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610051+0000", 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013447599999999999 2024-09-21T09:12:11.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610158+0000", 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107439 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4210.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.762441413999994, 2024-09-21T09:12:11.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.027901532, 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4210", 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/2411346251", 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 141 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585225+0000", 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585226+0000", 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5999999999999991e-07 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585238+0000", 2024-09-21T09:12:11.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1717e-05 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585248+0000", 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0776e-05 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.585256+0000", 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8140000000000001e-06 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610278+0000", 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.025021297000000001 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610421+0000", 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014358900000000001 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.610631+0000", 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021016900000000001 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612016+0000", 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001385037 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612841+0000", 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082419399999999999 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.612997+0000", 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000156186 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:45.613127+0000", 2024-09-21T09:12:11.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012979300000000001 2024-09-21T09:12:11.476 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.476 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.476 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.476 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.476 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.476 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:11.477 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:11.478 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:11.473+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:11.578 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:11.576+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:11.601 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:11.602 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:11.602 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:11.602 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:11.616 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:11.701 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:11.700+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:11.779 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:11.779 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:11.780 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:11.780 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:11.780 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:11.780 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:11.776+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:11.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:11.881 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:11.880+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:11.968 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:11.968 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:11.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:11.968 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4358.0:40 5.1c 5:3fce9a59:::zonegroup_info.6661b8ba-4ecc-4129-afb2-8d0efd9659c2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.079307114000002, 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028118549999999998, 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4358", 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3756932968", 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 40 2024-09-21T09:12:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885826+0000", 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4899999999999999e-06 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885835+0000", 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5299999999999996e-06 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885857+0000", 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1679999999999999e-05 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885871+0000", 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4146e-05 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885969+0000", 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8212000000000001e-05 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886181+0000", 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021209000000000001 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886450+0000", 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026841000000000001 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.887864+0000", 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001414722 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888500+0000", 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063535399999999998 2024-09-21T09:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888562+0000", 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2176999999999998e-05 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888637+0000", 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5043999999999995e-05 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:214 6.1c e36/30 6:3e426232:gc::gc.9:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.044113429000006, 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015590160000000001, 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.13e-07 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921028+0000", 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9639999999999992e-06 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921060+0000", 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1822000000000001e-05 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921076+0000", 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6252999999999998e-05 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921213+0000", 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013652299999999999 2024-09-21T09:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921250+0000", 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7685999999999998e-05 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922504+0000", 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001253185 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922578+0000", 2024-09-21T09:12:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4070000000000001e-05 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.033924939000002, 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036169079999999998, 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 217 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931210+0000", 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6529999999999998e-06 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931223+0000", 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3667e-05 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931257+0000", 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3742999999999999e-05 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931273+0000", 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5366000000000002e-05 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931414+0000", 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136300000000001 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931673+0000", 2024-09-21T09:12:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025924500000000002 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.932066+0000", 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0003927 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.933852+0000", 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017863180000000001 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934605+0000", 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075312800000000004 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934696+0000", 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0328999999999995e-05 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934824+0000", 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128396 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:229 6.1b e36/30 6:db9d130d:gc::gc.24:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.988477981999999, 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015706159999999999, 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976655+0000", 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8699999999999995e-07 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976661+0000", 2024-09-21T09:12:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7599999999999997e-06 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976686+0000", 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4396000000000002e-05 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976699+0000", 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3336000000000001e-05 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976836+0000", 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013669299999999999 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976871+0000", 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4913000000000003e-05 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978136+0000", 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001264851 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978225+0000", 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9179999999999997e-05 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.960746610000001, 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001626368, 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 237 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004389+0000", 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5099999999999999e-06 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004408+0000", 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9154e-05 2024-09-21T09:12:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004453+0000", 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4385999999999998e-05 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004475+0000", 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2853e-05 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004585+0000", 2024-09-21T09:12:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000109546 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004656+0000", 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0988999999999994e-05 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004818+0000", 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016166600000000001 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005536+0000", 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071806799999999998 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005917+0000", 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038119100000000002 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005956+0000", 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9255999999999998e-05 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.006012+0000", 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5748999999999998e-05 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:253 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.957070211000001, 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001548546, 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 253 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008063+0000", 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.263e-06 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008070+0000", 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1369999999999996e-06 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008087+0000", 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6263999999999999e-05 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008096+0000", 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6670000000000008e-06 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008178+0000", 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1644999999999995e-05 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008240+0000", 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2453999999999995e-05 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008448+0000", 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020722899999999999 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009447+0000", 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099947600000000001 2024-09-21T09:12:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009547+0000", 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100268 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009582+0000", 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4459999999999999e-05 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009610+0000", 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8683e-05 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:709 6.1e e36/30 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.721363621999998, 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015262559999999999, 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243769+0000", 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9999999999999996e-07 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243776+0000", 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0999999999999998e-06 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243790+0000", 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3882e-05 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243800+0000", 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0083e-05 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243943+0000", 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014281799999999999 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243990+0000", 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7157000000000003e-05 2024-09-21T09:12:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245247+0000", 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012564200000000001 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245295+0000", 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7895999999999997e-05 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.698471613000002, 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023946290000000001, 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 721 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266663+0000", 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5289999999999998e-06 2024-09-21T09:12:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266676+0000", 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.292e-05 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266705+0000", 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8816999999999999e-05 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266732+0000", 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7134000000000001e-05 2024-09-21T09:12:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266844+0000", 2024-09-21T09:12:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111848 2024-09-21T09:12:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267038+0000", 2024-09-21T09:12:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019389 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267357+0000", 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000319172 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268435+0000", 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010780430000000001 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268984+0000", 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054955599999999998 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269022+0000", 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7973999999999999e-05 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269055+0000", 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2746000000000001e-05 2024-09-21T09:12:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.695497318999998, 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002147342, 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 723 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269636+0000", 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4720000000000001e-06 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269645+0000", 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.32e-06 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269667+0000", 2024-09-21T09:12:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2487999999999999e-05 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269678+0000", 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0794e-05 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269735+0000", 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269784+0000", 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8266999999999997e-05 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269905+0000", 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121012 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.270906+0000", 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00100125 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271576+0000", 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066977200000000001 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271666+0000", 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9952999999999997e-05 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271782+0000", 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116469 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:775 6.1e e36/30 6:7db93595:::obj_delete_at_hint.0000000066:head v 36'5, mlcod=36'3)", 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.573685531000002, 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015332430000000001, 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391448+0000", 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7570000000000001e-06 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391462+0000", 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3256e-05 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391491+0000", 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9753000000000001e-05 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391515+0000", 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3623999999999999e-05 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391667+0000", 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152065 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391732+0000", 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5099999999999997e-05 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392906+0000", 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011735719999999999 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392980+0000", 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4116000000000007e-05 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:778 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'4, mlcod=36'2)", 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.566448334, 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015037570000000001, 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398686+0000", 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8369999999999999e-06 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398703+0000", 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7363e-05 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398731+0000", 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8367000000000001e-05 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398745+0000", 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.385e-05 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398923+0000", 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177818 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398963+0000", 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9867000000000003e-05 2024-09-21T09:12:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400088+0000", 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011250380000000001 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400188+0000", 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9617000000000005e-05 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:780 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'5, mlcod=36'3)", 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.561602387000001, 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001427673, 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403530+0000", 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403531+0000", 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6729999999999999e-06 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403568+0000", 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6693000000000003e-05 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403597+0000", 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9130000000000001e-05 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403611+0000", 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3643e-05 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403781+0000", 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016968300000000001 2024-09-21T09:12:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.403820+0000", 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9768999999999998e-05 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404868+0000", 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001047493 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.404957+0000", 2024-09-21T09:12:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9588999999999999e-05 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:814 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'7, mlcod=36'5)", 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.479633585000002, 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014758, 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485500+0000", 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.843e-06 2024-09-21T09:12:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485513+0000", 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2284e-05 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485542+0000", 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9102999999999999e-05 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485555+0000", 2024-09-21T09:12:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.375e-05 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485660+0000", 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104849 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485719+0000", 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8842999999999999e-05 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486885+0000", 2024-09-21T09:12:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011654250000000001 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486974+0000", 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9703000000000005e-05 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:816 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'8, mlcod=36'6)", 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.476007346999999, 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016647159999999999, 2024-09-21T09:12:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489127+0000", 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489142+0000", 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5400000000000002e-05 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489177+0000", 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4894000000000002e-05 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489196+0000", 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8873e-05 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489355+0000", 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015918799999999999 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489424+0000", 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8572999999999996e-05 2024-09-21T09:12:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490705+0000", 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012817079999999999 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490789+0000", 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4019999999999999e-05 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:844 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'12, mlcod=36'10)", 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.408828612000001, 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015352059999999999, 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556305+0000", 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.73e-06 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556317+0000", 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2233e-05 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556348+0000", 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0176e-05 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556361+0000", 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3694e-05 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556511+0000", 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014973800000000001 2024-09-21T09:12:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556567+0000", 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6273999999999997e-05 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557740+0000", 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001173065 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557839+0000", 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8295999999999995e-05 2024-09-21T09:12:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:846 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'13, mlcod=36'11)", 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.405091820999999, 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014368810000000001, 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560042+0000", 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6500000000000001e-06 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560056+0000", 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4233000000000001e-05 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560085+0000", 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8767000000000001e-05 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560098+0000", 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3436e-05 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560242+0000", 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000143199 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560305+0000", 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3269999999999996e-05 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561354+0000", 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010487630000000001 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561477+0000", 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012356300000000001 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.249505439000004, 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028068680000000001, 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 910 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715630+0000", 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.92e-06 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715647+0000", 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715680+0000", 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3572999999999999e-05 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715696+0000", 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5777000000000002e-05 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715819+0000", 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000122972 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716044+0000", 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022481500000000001 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716365+0000", 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032138400000000003 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.717426+0000", 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001061223 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718214+0000", 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078753099999999995 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718304+0000", 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0426999999999993e-05 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718434+0000", 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012908900000000001 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.245548386000003, 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031243310000000002, 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 912 2024-09-21T09:12:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719585+0000", 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.72e-06 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719597+0000", 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1229999999999999e-05 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719621+0000", 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4073000000000001e-05 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719633+0000", 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.259e-05 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719761+0000", 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012745599999999999 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720000+0000", 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023914800000000001 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720482+0000", 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048253400000000001 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.721627+0000", 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001145002 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722556+0000", 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092825299999999998 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722640+0000", 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4542999999999993e-05 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722708+0000", 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7781999999999996e-05 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-21T09:12:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.205394149, 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014824689999999999, 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759740+0000", 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7370000000000001e-06 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759752+0000", 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2483000000000001e-05 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759782+0000", 2024-09-21T09:12:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9553e-05 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759798+0000", 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6042999999999999e-05 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759943+0000", 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760001+0000", 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8777000000000003e-05 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761134+0000", 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001132922 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761220+0000", 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6044999999999994e-05 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1020 6.10 e45/30 6:0fbdcb32:usage::usage.17:head v 45'5, mlcod=36'3)", 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.925854530000002, 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001677574, 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039281+0000", 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0939999999999999e-06 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039305+0000", 2024-09-21T09:12:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3906000000000001e-05 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039349+0000", 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4064999999999999e-05 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039379+0000", 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9889000000000001e-05 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039517+0000", 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013895300000000001 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039574+0000", 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6162000000000002e-05 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040855+0000", 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001281821 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040955+0000", 2024-09-21T09:12:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9684000000000003e-05 2024-09-21T09:12:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.068 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:12.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:12.070 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:12.068+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:12.104 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-09-21T09:12:12.170 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:12.165+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:12.222 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:12.222 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:12.222 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:12.222 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:12.234 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:12.271 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:12.269+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:12.347 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:12.347 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:12.347 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:12.347 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:12.347 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:12.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:12.409 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:12.408+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:12.473 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:12.468+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:12.483 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:12.483 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:12.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-21T09:12:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 82.706232728000003, 2024-09-21T09:12:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073206360000000002, 2024-09-21T09:12:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:12:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:12:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 5 2024-09-21T09:12:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772825+0000", 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7129999999999999e-06 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772843+0000", 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8033000000000002e-05 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772882+0000", 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9434000000000002e-05 2024-09-21T09:12:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772902+0000", 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0075999999999999e-05 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773008+0000", 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105351 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773016+0000", 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1419999999999993e-06 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776094+0000", 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030782549999999998 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776289+0000", 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019460899999999999 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776487+0000", 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000198142 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.778052+0000", 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001565812 2024-09-21T09:12:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.779852+0000", 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001799171 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780015+0000", 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000162862 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780142+0000", 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012703599999999999 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.703610882999996, 2024-09-21T09:12:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01128114, 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775446+0000", 2024-09-21T09:12:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:12:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775478+0000", 2024-09-21T09:12:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2024-09-21T09:12:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775525+0000", 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7734000000000001e-05 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775559+0000", 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4133e-05 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775753+0000", 2024-09-21T09:12:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000193248 2024-09-21T09:12:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775773+0000", 2024-09-21T09:12:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0086999999999999e-05 2024-09-21T09:12:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783330+0000", 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075572979999999996 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783469+0000", 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138839 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783767+0000", 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029823499999999999 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.785719+0000", 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00195207 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786427+0000", 2024-09-21T09:12:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070740099999999997 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786600+0000", 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017295900000000001 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786724+0000", 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012436599999999999 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:12:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 69.637975560000001, 2024-09-21T09:12:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011832176, 2024-09-21T09:12:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:12:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 43 2024-09-21T09:12:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841082+0000", 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9870000000000001e-06 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841121+0000", 2024-09-21T09:12:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8593000000000001e-05 2024-09-21T09:12:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841153+0000", 2024-09-21T09:12:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2716000000000003e-05 2024-09-21T09:12:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841179+0000", 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5190000000000001e-05 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841332+0000", 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000153509 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841368+0000", 2024-09-21T09:12:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6183000000000002e-05 2024-09-21T09:12:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845655+0000", 2024-09-21T09:12:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00428642 2024-09-21T09:12:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2024-09-21T09:12:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845676+0000", 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1687000000000001e-05 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852576+0000", 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0068992860000000001 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852910+0000", 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033460500000000003 2024-09-21T09:12:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.565993305999996, 2024-09-21T09:12:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0099467879999999998, 2024-09-21T09:12:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 214 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913064+0000", 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9439999999999998e-06 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913079+0000", 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4966e-05 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913119+0000", 2024-09-21T09:12:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9297e-05 2024-09-21T09:12:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913147+0000", 2024-09-21T09:12:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8776e-05 2024-09-21T09:12:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913293+0000", 2024-09-21T09:12:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014535899999999999 2024-09-21T09:12:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913303+0000", 2024-09-21T09:12:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0243e-05 2024-09-21T09:12:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920048+0000", 2024-09-21T09:12:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067448569999999999 2024-09-21T09:12:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920345+0000", 2024-09-21T09:12:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000297454 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920742+0000", 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039676499999999999 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922048+0000", 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00130641 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922865+0000", 2024-09-21T09:12:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081690500000000004 2024-09-21T09:12:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922947+0000", 2024-09-21T09:12:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1751999999999999e-05 2024-09-21T09:12:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923007+0000", 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0059999999999998e-05 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.536124767999993, 2024-09-21T09:12:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033742799999999999, 2024-09-21T09:12:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 220 2024-09-21T09:12:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942931+0000", 2024-09-21T09:12:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4030000000000001e-06 2024-09-21T09:12:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942943+0000", 2024-09-21T09:12:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2024-09-21T09:12:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942976+0000", 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3120000000000001e-05 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942991+0000", 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5376999999999999e-05 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943103+0000", 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011184900000000001 2024-09-21T09:12:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943318+0000", 2024-09-21T09:12:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021467900000000001 2024-09-21T09:12:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943715+0000", 2024-09-21T09:12:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039689700000000001 2024-09-21T09:12:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.945217+0000", 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001501973 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946150+0000", 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093294700000000005 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946234+0000", 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4425000000000006e-05 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946303+0000", 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9016999999999993e-05 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.517426614000001, 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031516420000000001, 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 225 2024-09-21T09:12:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:12.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961629+0000", 2024-09-21T09:12:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1730000000000002e-06 2024-09-21T09:12:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961640+0000", 2024-09-21T09:12:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0927000000000001e-05 2024-09-21T09:12:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961671+0000", 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1032999999999999e-05 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961686+0000", 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5304000000000001e-05 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961813+0000", 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012683900000000001 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962030+0000", 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021637499999999999 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962446+0000", 2024-09-21T09:12:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041634700000000002 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.963645+0000", 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011985279999999999 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964623+0000", 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000978673 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964713+0000", 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9660000000000006e-05 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964779+0000", 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5783000000000004e-05 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:228 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.507115443999993, 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032433039999999998, 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 228 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971940+0000", 2024-09-21T09:12:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1100000000000001e-06 2024-09-21T09:12:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971951+0000", 2024-09-21T09:12:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0556e-05 2024-09-21T09:12:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971982+0000", 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1442999999999997e-05 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971998+0000", 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5673000000000001e-05 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972130+0000", 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000132213 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972337+0000", 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020659899999999999 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972731+0000", 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039369699999999998 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.974129+0000", 2024-09-21T09:12:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013981029999999999 2024-09-21T09:12:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975031+0000", 2024-09-21T09:12:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090264399999999997 2024-09-21T09:12:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975116+0000", 2024-09-21T09:12:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4616000000000004e-05 2024-09-21T09:12:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975182+0000", 2024-09-21T09:12:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5649999999999997e-05 2024-09-21T09:12:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.492980255000006, 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030216219999999998, 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 232 2024-09-21T09:12:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986076+0000", 2024-09-21T09:12:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3130000000000001e-06 2024-09-21T09:12:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986087+0000", 2024-09-21T09:12:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1387e-05 2024-09-21T09:12:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986118+0000", 2024-09-21T09:12:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:12:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986134+0000", 2024-09-21T09:12:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.524e-05 2024-09-21T09:12:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986241+0000", 2024-09-21T09:12:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010744899999999999 2024-09-21T09:12:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986461+0000", 2024-09-21T09:12:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021971600000000001 2024-09-21T09:12:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986879+0000", 2024-09-21T09:12:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041845000000000001 2024-09-21T09:12:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988536+0000", 2024-09-21T09:12:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001657045 2024-09-21T09:12:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988933+0000", 2024-09-21T09:12:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695699999999997 2024-09-21T09:12:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989021+0000", 2024-09-21T09:12:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7947000000000003e-05 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989095+0000", 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3812000000000004e-05 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.486055723000007, 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032333710000000001, 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 234 2024-09-21T09:12:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993000+0000", 2024-09-21T09:12:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:12:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993011+0000", 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0647e-05 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993040+0000", 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9456999999999999e-05 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993055+0000", 2024-09-21T09:12:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.485e-05 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993166+0000", 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000110942 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993409+0000", 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242871 2024-09-21T09:12:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993829+0000", 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000420154 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.995035+0000", 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001206295 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996079+0000", 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00104407 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996167+0000", 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7440000000000003e-05 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996231+0000", 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4589000000000001e-05 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.088526946000002, 2024-09-21T09:12:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029466929999999998, 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 775 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390530+0000", 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9270000000000001e-06 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390542+0000", 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2016e-05 2024-09-21T09:12:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390574+0000", 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2199999999999997e-05 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390589+0000", 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5339999999999999e-05 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390719+0000", 2024-09-21T09:12:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012939599999999999 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390928+0000", 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000209898 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391244+0000", 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031530799999999998 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392535+0000", 2024-09-21T09:12:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001291008 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393288+0000", 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075327100000000002 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393404+0000", 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011562599999999999 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393473+0000", 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9703000000000007e-05 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:784 6.8 6:1111b601:::obj_delete_at_hint.0000000069:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.065839600999993, 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003135367, 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 784 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413216+0000", 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.784e-06 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413225+0000", 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8580000000000006e-06 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413249+0000", 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4212000000000001e-05 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413260+0000", 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1514e-05 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413401+0000", 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014083699999999999 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413625+0000", 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022383099999999999 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413942+0000", 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317375 2024-09-21T09:12:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.415132+0000", 2024-09-21T09:12:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001189072 2024-09-21T09:12:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416200+0000", 2024-09-21T09:12:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010679979999999999 2024-09-21T09:12:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416282+0000", 2024-09-21T09:12:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2713999999999994e-05 2024-09-21T09:12:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416349+0000", 2024-09-21T09:12:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7172e-05 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.994496505999997, 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029415460000000002, 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 814 2024-09-21T09:12:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484559+0000", 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484570+0000", 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.098e-05 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484601+0000", 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1062999999999997e-05 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484616+0000", 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4735999999999999e-05 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484747+0000", 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000130729 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484965+0000", 2024-09-21T09:12:12.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217982 2024-09-21T09:12:12.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:12.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485271+0000", 2024-09-21T09:12:12.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000306488 2024-09-21T09:12:12.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486347+0000", 2024-09-21T09:12:12.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010752030000000001 2024-09-21T09:12:12.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487293+0000", 2024-09-21T09:12:12.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094605299999999998 2024-09-21T09:12:12.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487379+0000", 2024-09-21T09:12:12.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6558999999999996e-05 2024-09-21T09:12:12.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487499+0000", 2024-09-21T09:12:12.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011955000000000001 2024-09-21T09:12:12.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.578 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.578 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.578 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:12.578 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.990670862999998, 2024-09-21T09:12:12.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029122929999999998, 2024-09-21T09:12:12.578 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.579 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.579 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.579 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 816 2024-09-21T09:12:12.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.580 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:12.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:12.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488385+0000", 2024-09-21T09:12:12.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8700000000000001e-06 2024-09-21T09:12:12.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488395+0000", 2024-09-21T09:12:12.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0723000000000001e-05 2024-09-21T09:12:12.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488420+0000", 2024-09-21T09:12:12.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.508e-05 2024-09-21T09:12:12.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488433+0000", 2024-09-21T09:12:12.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2317000000000001e-05 2024-09-21T09:12:12.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488538+0000", 2024-09-21T09:12:12.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105475 2024-09-21T09:12:12.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488669+0000", 2024-09-21T09:12:12.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000131073 2024-09-21T09:12:12.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488940+0000", 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027115100000000002 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490015+0000", 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010748159999999999 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491096+0000", 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001080733 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491179+0000", 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2942999999999995e-05 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491295+0000", 2024-09-21T09:12:12.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116112 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.944701252999998, 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003172818, 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.587 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 835 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534355+0000", 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2840000000000001e-06 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534366+0000", 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1396000000000001e-05 2024-09-21T09:12:12.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534398+0000", 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1823999999999999e-05 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534413+0000", 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4919999999999999e-05 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534528+0000", 2024-09-21T09:12:12.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115209 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534749+0000", 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022136500000000001 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.535063+0000", 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031351399999999998 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.536086+0000", 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010234899999999999 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537283+0000", 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011962819999999999 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537407+0000", 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123819 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537525+0000", 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118715 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.923696761000002, 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030129000000000002, 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 844 2024-09-21T09:12:12.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555359+0000", 2024-09-21T09:12:12.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:12:12.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555369+0000", 2024-09-21T09:12:12.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0207000000000001e-05 2024-09-21T09:12:12.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555398+0000", 2024-09-21T09:12:12.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8822999999999998e-05 2024-09-21T09:12:12.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555412+0000", 2024-09-21T09:12:12.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4443e-05 2024-09-21T09:12:12.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555537+0000", 2024-09-21T09:12:12.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012447900000000001 2024-09-21T09:12:12.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555756+0000", 2024-09-21T09:12:12.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021879899999999999 2024-09-21T09:12:12.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556069+0000", 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031338399999999999 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557174+0000", 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011049860000000001 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558209+0000", 2024-09-21T09:12:12.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034653 2024-09-21T09:12:12.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558297+0000", 2024-09-21T09:12:12.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8446e-05 2024-09-21T09:12:12.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558370+0000", 2024-09-21T09:12:12.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2700000000000005e-05 2024-09-21T09:12:12.601 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.601 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.601 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.602 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:864 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.602 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:12.602 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.877158260999998, 2024-09-21T09:12:12.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002853324, 2024-09-21T09:12:12.602 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.602 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.602 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.602 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.603 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.603 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 864 2024-09-21T09:12:12.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.603 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:12.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:12.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601897+0000", 2024-09-21T09:12:12.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.61e-06 2024-09-21T09:12:12.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601905+0000", 2024-09-21T09:12:12.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2470000000000008e-06 2024-09-21T09:12:12.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601930+0000", 2024-09-21T09:12:12.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4885999999999999e-05 2024-09-21T09:12:12.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601949+0000", 2024-09-21T09:12:12.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9006000000000001e-05 2024-09-21T09:12:12.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602078+0000", 2024-09-21T09:12:12.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012905600000000001 2024-09-21T09:12:12.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602220+0000", 2024-09-21T09:12:12.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141586 2024-09-21T09:12:12.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:12.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602489+0000", 2024-09-21T09:12:12.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026938199999999998 2024-09-21T09:12:12.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.603606+0000", 2024-09-21T09:12:12.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011163880000000001 2024-09-21T09:12:12.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604600+0000", 2024-09-21T09:12:12.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099397700000000005 2024-09-21T09:12:12.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604685+0000", 2024-09-21T09:12:12.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5740000000000002e-05 2024-09-21T09:12:12.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604749+0000", 2024-09-21T09:12:12.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3446000000000002e-05 2024-09-21T09:12:12.611 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.611 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.756155653999997, 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031274219999999999, 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.612 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.613 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.613 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 913 2024-09-21T09:12:12.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.613 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:12.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:12.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722901+0000", 2024-09-21T09:12:12.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:12:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722912+0000", 2024-09-21T09:12:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1693e-05 2024-09-21T09:12:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722944+0000", 2024-09-21T09:12:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.222e-05 2024-09-21T09:12:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722959+0000", 2024-09-21T09:12:12.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4902999999999999e-05 2024-09-21T09:12:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723110+0000", 2024-09-21T09:12:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015031500000000001 2024-09-21T09:12:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723344+0000", 2024-09-21T09:12:12.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000234799 2024-09-21T09:12:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723667+0000", 2024-09-21T09:12:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032255100000000002 2024-09-21T09:12:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.724725+0000", 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010575859999999999 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725873+0000", 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001148579 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725961+0000", 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8063e-05 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.726025+0000", 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4156e-05 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:12.623 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.752047802, 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029665730000000001, 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 915 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727008+0000", 2024-09-21T09:12:12.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7129999999999999e-06 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727016+0000", 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6600000000000001e-06 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727041+0000", 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5253e-05 2024-09-21T09:12:12.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727055+0000", 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3403e-05 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727227+0000", 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017192600000000001 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727363+0000", 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013665199999999999 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727627+0000", 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000263565 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.728717+0000", 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001090029 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729815+0000", 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010975099999999999 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729908+0000", 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3029000000000007e-05 2024-09-21T09:12:12.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729972+0000", 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4832999999999994e-05 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:12.630 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.720711264999998, 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035043000000000001, 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 928 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.631 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758345+0000", 2024-09-21T09:12:12.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4339999999999999e-06 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758356+0000", 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1423000000000001e-05 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758389+0000", 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2336999999999999e-05 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758408+0000", 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9706000000000001e-05 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758579+0000", 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017064599999999999 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:12.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758939+0000", 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036013000000000001 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759516+0000", 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057737999999999995 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760877+0000", 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013600769999999999 2024-09-21T09:12:12.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761559+0000", 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068295900000000002 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761727+0000", 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016766900000000001 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761847+0000", 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119539 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4216.0:2 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.480628037999999, 2024-09-21T09:12:12.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049270260000000001, 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4216", 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/896302906", 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:12.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:12.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:12.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:12.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:12.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:12.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998428+0000", 2024-09-21T09:12:12.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:12:12.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:12.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998453+0000", 2024-09-21T09:12:12.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5449e-05 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998478+0000", 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4769e-05 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998502+0000", 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3448999999999999e-05 2024-09-21T09:12:12.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998630+0000", 2024-09-21T09:12:12.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012872299999999999 2024-09-21T09:12:12.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:12.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998640+0000", 2024-09-21T09:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9329999999999996e-06 2024-09-21T09:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003282+0000", 2024-09-21T09:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004641816 2024-09-21T09:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003353+0000", 2024-09-21T09:12:12.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0627e-05 2024-09-21T09:12:12.644 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.644 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.644 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.644 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:12.644 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:12.644 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:12.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:12.646 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:12.641+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:12.747 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:12.741+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:12.781 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:12.782 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:12.782 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:12.782 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:12.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:12.883 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:12.881+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:12.949 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:12.948+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:12.961 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:12.961 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:12.962 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:12.962 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:12.976 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:13.068 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:13.065+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:13.151 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:13.148+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 70.295502732000003, 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083044959999999998, 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-21T09:12:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 44 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857525+0000", 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2059999999999999e-06 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857541+0000", 2024-09-21T09:12:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5826999999999999e-05 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857608+0000", 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7353000000000004e-05 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857632+0000", 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3595999999999999e-05 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857842+0000", 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021056800000000001 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857863+0000", 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0917e-05 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865509+0000", 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076459040000000002 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865826+0000", 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031712500000000002 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.281497451000007, 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0108574, 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 206 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871530+0000", 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871545+0000", 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4620000000000001e-05 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871584+0000", 2024-09-21T09:12:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9582999999999997e-05 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871602+0000", 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8057e-05 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871776+0000", 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017372500000000001 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871792+0000", 2024-09-21T09:12:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878149+0000", 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063566910000000003 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878502+0000", 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284800000000001 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.879223+0000", 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072110100000000003 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.881741+0000", 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025179310000000002 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882232+0000", 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00049132199999999998 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882325+0000", 2024-09-21T09:12:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2816e-05 2024-09-21T09:12:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882384+0000", 2024-09-21T09:12:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9509999999999998e-05 2024-09-21T09:12:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.270265273999996, 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032285479999999999, 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 207 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882761+0000", 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0729999999999999e-06 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882771+0000", 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0287e-05 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882796+0000", 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4873000000000001e-05 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882811+0000", 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4752999999999999e-05 2024-09-21T09:12:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882904+0000", 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2869999999999997e-05 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883081+0000", 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017743500000000001 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883433+0000", 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035207000000000001 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.884576+0000", 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001142405 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885843+0000", 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012676230000000001 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885921+0000", 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7338999999999999e-05 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885988+0000", 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6820000000000001e-05 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.175 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.253861857999993, 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033258939999999998, 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 210 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:13.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899165+0000", 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3199999999999998e-06 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899176+0000", 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1154e-05 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899209+0000", 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2580000000000003e-05 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899224+0000", 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4976e-05 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899345+0000", 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121296 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899542+0000", 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019720499999999999 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899947+0000", 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040540299999999998 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.901475+0000", 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015280319999999999 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902217+0000", 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074172400000000003 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902369+0000", 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015137899999999999 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902488+0000", 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119825 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.200965776000004, 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037626880000000001, 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 222 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952061+0000", 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4700000000000001e-06 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952073+0000", 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.155e-05 2024-09-21T09:12:13.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952103+0000", 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0716999999999997e-05 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952119+0000", 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5613000000000001e-05 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952271+0000", 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015167499999999999 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952654+0000", 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038366399999999998 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.953387+0000", 2024-09-21T09:12:13.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073280800000000005 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955064+0000", 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016773000000000001 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955552+0000", 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048774000000000002 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955707+0000", 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154878 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955821+0000", 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114273 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.187 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.171975230000001, 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030613469999999999, 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 230 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.188 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981052+0000", 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4169999999999999e-06 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981066+0000", 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3933e-05 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981098+0000", 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2023999999999997e-05 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981114+0000", 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6453e-05 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981230+0000", 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116092 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981448+0000", 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021825499999999999 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981870+0000", 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0004214 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.983260+0000", 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013901429999999999 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.983949+0000", 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068917399999999997 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984038+0000", 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9322999999999998e-05 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984111+0000", 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2132999999999995e-05 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.193 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.146539816000001, 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032388619999999999, 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 238 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006487+0000", 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:12:13.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006497+0000", 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0457e-05 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006526+0000", 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8975999999999998e-05 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006547+0000", 2024-09-21T09:12:13.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0613000000000001e-05 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006669+0000", 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121896 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006881+0000", 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021207499999999999 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.007199+0000", 2024-09-21T09:12:13.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031782099999999998 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.008434+0000", 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012349609999999999 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009576+0000", 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001141998 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009661+0000", 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5982000000000004e-05 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009723+0000", 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1940000000000007e-05 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:256 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:12:13.199 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.142328039000006, 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030661970000000001, 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 256 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010698+0000", 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5740000000000001e-06 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010707+0000", 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3530000000000001e-06 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010735+0000", 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7293000000000001e-05 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010759+0000", 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4054e-05 2024-09-21T09:12:13.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010890+0000", 2024-09-21T09:12:13.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131822 2024-09-21T09:12:13.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.011023+0000", 2024-09-21T09:12:13.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132612 2024-09-21T09:12:13.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.011351+0000", 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032816399999999998 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012826+0000", 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014745820000000001 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013497+0000", 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00067147500000000004 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013654+0000", 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015681199999999999 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013763+0000", 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010845600000000001 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.205 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:378 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.107996270000001, 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036030390000000002, 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.206 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 378 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045031+0000", 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9859999999999999e-06 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045069+0000", 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7876999999999997e-05 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045123+0000", 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4202e-05 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045148+0000", 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4924000000000001e-05 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045310+0000", 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016157899999999999 2024-09-21T09:12:13.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045542+0000", 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023267399999999999 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045859+0000", 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000316872 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047142+0000", 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001283216 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048468+0000", 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001325534 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048562+0000", 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4015e-05 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048631+0000", 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9159999999999995e-05 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:383 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.105980285000001, 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030650489999999998, 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.212 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 383 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:12:13.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047046+0000", 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.306e-06 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047060+0000", 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3716999999999999e-05 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047090+0000", 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9456000000000001e-05 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047138+0000", 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.884e-05 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047236+0000", 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7141999999999999e-05 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047484+0000", 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024807200000000001 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047923+0000", 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043972599999999998 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049320+0000", 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001396883 2024-09-21T09:12:13.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049881+0000", 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056092200000000005 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049991+0000", 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109709 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.050109+0000", 2024-09-21T09:12:13.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118276 2024-09-21T09:12:13.218 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.218 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.218 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.218 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:398 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.218 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:13.218 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.101540439999994, 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037105979999999998, 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 398 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051486+0000", 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0030000000000001e-06 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051497+0000", 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0957e-05 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051519+0000", 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2263e-05 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051531+0000", 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2306999999999999e-05 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052064+0000", 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00053253199999999995 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052392+0000", 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000327628 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052743+0000", 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035127699999999999 2024-09-21T09:12:13.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053814+0000", 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010707049999999999 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055011+0000", 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001197814 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055126+0000", 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114262 2024-09-21T09:12:13.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055195+0000", 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8850000000000007e-05 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:405 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.099215458000003, 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033493780000000001, 2024-09-21T09:12:13.224 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 405 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053811+0000", 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7999999999999999e-06 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053823+0000", 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1800000000000001e-05 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053857+0000", 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.464e-05 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053875+0000", 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7479999999999999e-05 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054016+0000", 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014128200000000001 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054142+0000", 2024-09-21T09:12:13.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012590600000000001 2024-09-21T09:12:13.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:13.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054426+0000", 2024-09-21T09:12:13.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028461399999999998 2024-09-21T09:12:13.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.056935+0000", 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025088799999999998 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057011+0000", 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6097e-05 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057091+0000", 2024-09-21T09:12:13.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9098999999999996e-05 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057158+0000", 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7780000000000005e-05 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:566 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.018570440999994, 2024-09-21T09:12:13.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003214822, 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 566 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134456+0000", 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1289999999999999e-06 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134467+0000", 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1396999999999999e-05 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134499+0000", 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1111000000000001e-05 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134516+0000", 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7893999999999998e-05 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134669+0000", 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015240100000000001 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.135038+0000", 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036941799999999999 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.135615+0000", 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057627500000000001 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137179+0000", 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015641450000000001 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137473+0000", 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029436399999999998 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137562+0000", 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8566000000000006e-05 2024-09-21T09:12:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137669+0000", 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107122 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:603 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 64.989303676000006, 2024-09-21T09:12:13.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030919720000000001, 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 603 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:12:13.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163722+0000", 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.513e-06 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163730+0000", 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4930000000000001e-06 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163754+0000", 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3900000000000002e-05 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163775+0000", 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1500000000000001e-05 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163914+0000", 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013844899999999999 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.164143+0000", 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022904699999999999 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.164616+0000", 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047342400000000001 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166515+0000", 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001898903 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166641+0000", 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125573 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166721+0000", 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0513999999999995e-05 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166813+0000", 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1656000000000005e-05 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 64.659404949000006, 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031191460000000002, 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 817 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493622+0000", 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6800000000000002e-06 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493633+0000", 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0987e-05 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493665+0000", 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2356e-05 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493680+0000", 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4647000000000001e-05 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493835+0000", 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015487500000000001 2024-09-21T09:12:13.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.494066+0000", 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231432 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.494380+0000", 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031386700000000001 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.495603+0000", 2024-09-21T09:12:13.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012222940000000001 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496574+0000", 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00097185200000000005 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496662+0000", 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7836000000000004e-05 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496739+0000", 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6320000000000001e-05 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 64.602616920000003, 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030747119999999998, 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.248 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 841 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550410+0000", 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3360000000000002e-06 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550421+0000", 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1590000000000001e-05 2024-09-21T09:12:13.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550454+0000", 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2206000000000003e-05 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550471+0000", 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7099999999999999e-05 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550621+0000", 2024-09-21T09:12:13.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015060900000000001 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550830+0000", 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000208428 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.551146+0000", 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031587100000000001 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.552316+0000", 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011707810000000001 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553331+0000", 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010147890000000001 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553416+0000", 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4575999999999998e-05 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553482+0000", 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6426000000000004e-05 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 64.588800057, 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002967543, 2024-09-21T09:12:13.254 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 847 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564224+0000", 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564226+0000", 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8560000000000001e-06 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564237+0000", 2024-09-21T09:12:13.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0417e-05 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564269+0000", 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2116999999999998e-05 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564284+0000", 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4936000000000001e-05 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564454+0000", 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017048500000000001 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564661+0000", 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020732199999999999 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.564967+0000", 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030554699999999998 2024-09-21T09:12:13.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.566203+0000", 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012363039999999999 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567037+0000", 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00083360699999999999 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567123+0000", 2024-09-21T09:12:13.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6428999999999995e-05 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.567192+0000", 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8522999999999994e-05 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:12:13.260 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 64.465633784999994, 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029426840000000001, 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 898 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:12:13.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687391+0000", 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687393+0000", 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.554e-06 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687405+0000", 2024-09-21T09:12:13.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2313000000000001e-05 2024-09-21T09:12:13.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687437+0000", 2024-09-21T09:12:13.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1325999999999998e-05 2024-09-21T09:12:13.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687452+0000", 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5449999999999999e-05 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687601+0000", 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149219 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.687842+0000", 2024-09-21T09:12:13.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240418 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.688157+0000", 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031470800000000002 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.689278+0000", 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001121768 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690187+0000", 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090817999999999997 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690267+0000", 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0284999999999994e-05 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.690333+0000", 2024-09-21T09:12:13.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6463000000000004e-05 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 64.442811626999998, 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031788189999999998, 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.267 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 907 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:12:13.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710215+0000", 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4770000000000002e-06 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710227+0000", 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1293e-05 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710258+0000", 2024-09-21T09:12:13.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1585999999999999e-05 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710273+0000", 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5330000000000001e-05 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710423+0000", 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014969199999999999 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710650+0000", 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710993+0000", 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000342725 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.712231+0000", 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012387800000000001 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713240+0000", 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001008805 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713327+0000", 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6349999999999998e-05 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713392+0000", 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4953e-05 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.272 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 35.113487405999997, 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032957440000000002, 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1020 2024-09-21T09:12:13.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039540+0000", 2024-09-21T09:12:13.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1499999999999999e-06 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039558+0000", 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7549000000000001e-05 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039596+0000", 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8583e-05 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039615+0000", 2024-09-21T09:12:13.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8805e-05 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039759+0000", 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143702 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040000+0000", 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024096600000000001 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:13.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040380+0000", 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038004199999999998 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.041780+0000", 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400625 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042670+0000", 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088968599999999999 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:13.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042760+0000", 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9602e-05 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042833+0000", 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3034000000000006e-05 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:13.278 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:13.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:13.280 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:13.276+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:13.300 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:13.361 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 95% (12265/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-21T09:12:13.380 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:13.376+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:13.436 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:13.452 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:13.453 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:13.456 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:13.456 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:13.469 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:13.469 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:13.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:13.485 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:13.485 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:13.505 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:13.516 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:13.513+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:13.521 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:13.540 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:13.540 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:13.559 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:13.582 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:13.577+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:13.599 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:13.599 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:13.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:13.683 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:13.680+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:13.783 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:13.783 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:13.784 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:13.780+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:13.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:13.885 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:13.881+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:13.917 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:13.917 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:13.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:13.986 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:13.984+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '4e45e6b490e6cbe082cdf155fea780438ec53fc7'. 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T09:12:14.052 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-21T09:12:14.053 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T09:12:14.053 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-21T09:12:14.053 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T09:12:14.053 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T09:12:14.053 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T09:12:14.053 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 4e45e6b490e Merge pull request #59907 from zdover23/wip-doc-2024-09-21-backport-59904-to-squid 2024-09-21T09:12:14.060 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T09:12:14.101 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:14.100+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:14.102 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:14.102 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:14.106 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T09:12:14.109 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T09:12:14.109 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T09:12:14.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:14.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T09:12:14.187 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:14.184+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:14.244 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:14.244 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:14.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:14.288 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:14.284+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:14.385 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:14.385 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:14.390 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:14.385+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:14.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:14.490 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:14.488+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:14.572 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:14.572 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:14.586 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:14.632 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:14.629+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:14.692 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:14.689+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:14.713 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:14.713 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:14.729 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:14.793 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:14.793+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:14.861 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:14.862 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:14.877 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T09:12:14.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:14.929 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:14.928+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:14.962 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T09:12:14.995 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:14.989+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:15.001 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:15.001 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:15.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:15.028 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T09:12:15.030 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T09:12:15.030 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T09:12:15.074 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T09:12:15.077 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T09:12:15.077 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T09:12:15.082 INFO:tasks.workunit:Running workunits matching rgw/s3_user_quota.pl on client.0... 2024-09-21T09:12:15.084 INFO:tasks.workunit:Running workunit rgw/s3_user_quota.pl... 2024-09-21T09:12:15.084 DEBUG:teuthology.orchestra.run.smithi007:workunit test rgw/s3_user_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4e45e6b490e6cbe082cdf155fea780438ec53fc7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_user_quota.pl 2024-09-21T09:12:15.096 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:15.093+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:15.115 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-09-21T09:12:15.150 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:15.150 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:15.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:15.213 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:15.211+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:15.298 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:15.295+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:15.330 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:15.330 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:15.345 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:15.400 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:15.397+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:15.501 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:15.495+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:15.509 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:15.510 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:15.525 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:15.576 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:15.617 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:15.615+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:15.697 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:15.697 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:15.702 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:15.701+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:15.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:15.721 INFO:tasks.workunit.client.0.smithi007.stdout:Bucket Created: buck_2024_08_21_09_12_15 2024-09-21T09:12:15.769 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:15.769 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:15.789 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:15.789 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:15.803 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:15.797+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:15.809 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:15.809 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:15.832 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:15.832 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:15.844 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:15.844 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:15.844 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:15.864 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:15.867 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:15.891 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:15.896 INFO:tasks.workunit.client.0.smithi007.stderr:1+0 records in 2024-09-21T09:12:15.897 INFO:tasks.workunit.client.0.smithi007.stderr:1+0 records out 2024-09-21T09:12:15.897 INFO:tasks.workunit.client.0.smithi007.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00874311 s, 1.2 GB/s 2024-09-21T09:12:15.904 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:15.901+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:15.912 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:15.932 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:15.990 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:15.990 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:15.990 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:15.990 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:15.990 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:16.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:16.005 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:16.001+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:16.100 INFO:tasks.workunit.client.0.smithi007.stdout:quota enabled for the user usr1 2024-09-21T09:12:16.100 INFO:tasks.workunit.client.0.smithi007.stdout:adding file to bucket buck_2024_08_21_09_12_15: 10Mb. 2024-09-21T09:12:16.100 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:16.100 INFO:tasks.workunit.client.0.smithi007.stdout:Test case: PASSED - quota set for user: usr1 with max_objects=0 passed 2024-09-21T09:12:16.100 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:16.106 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:16.101+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:16.166 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:16.166 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4358.0:40 5.1c 5:3fce9a59:::zonegroup_info.6661b8ba-4ecc-4129-afb2-8d0efd9659c2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 75.278919013000007, 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028118549999999998, 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4358", 2024-09-21T09:12:16.167 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3756932968", 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 40 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:16.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885826+0000", 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4899999999999999e-06 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885835+0000", 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5299999999999996e-06 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885857+0000", 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1679999999999999e-05 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885871+0000", 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4146e-05 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885969+0000", 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8212000000000001e-05 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886181+0000", 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021209000000000001 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886450+0000", 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026841000000000001 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.887864+0000", 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001414722 2024-09-21T09:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888500+0000", 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063535399999999998 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888562+0000", 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2176999999999998e-05 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888637+0000", 2024-09-21T09:12:16.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5043999999999995e-05 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:214 6.1c e36/30 6:3e426232:gc::gc.9:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.243725327999996, 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015590160000000001, 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921019+0000", 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.13e-07 2024-09-21T09:12:16.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921028+0000", 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9639999999999992e-06 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921060+0000", 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1822000000000001e-05 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921076+0000", 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6252999999999998e-05 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921213+0000", 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013652299999999999 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.921250+0000", 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7685999999999998e-05 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922504+0000", 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001253185 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922578+0000", 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4070000000000001e-05 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.233536838000006, 2024-09-21T09:12:16.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036169079999999998, 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 217 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931210+0000", 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6529999999999998e-06 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931223+0000", 2024-09-21T09:12:16.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3667e-05 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931257+0000", 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3742999999999999e-05 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931273+0000", 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5366000000000002e-05 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931414+0000", 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136300000000001 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931673+0000", 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025924500000000002 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.932066+0000", 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0003927 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.933852+0000", 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017863180000000001 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934605+0000", 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075312800000000004 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934696+0000", 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0328999999999995e-05 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934824+0000", 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128396 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:229 6.1b e36/30 6:db9d130d:gc::gc.24:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.188089880999996, 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015706159999999999, 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.183 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976655+0000", 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8699999999999995e-07 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976661+0000", 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7599999999999997e-06 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976686+0000", 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4396000000000002e-05 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976699+0000", 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3336000000000001e-05 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976836+0000", 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013669299999999999 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976871+0000", 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4913000000000003e-05 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978136+0000", 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001264851 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978225+0000", 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9179999999999997e-05 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.187 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.160358509000005, 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001626368, 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 237 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004389+0000", 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5099999999999999e-06 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004408+0000", 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9154e-05 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004453+0000", 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4385999999999998e-05 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004475+0000", 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2853e-05 2024-09-21T09:12:16.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004585+0000", 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000109546 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004656+0000", 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0988999999999994e-05 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004818+0000", 2024-09-21T09:12:16.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016166600000000001 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005536+0000", 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071806799999999998 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005917+0000", 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038119100000000002 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005956+0000", 2024-09-21T09:12:16.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9255999999999998e-05 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.006012+0000", 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5748999999999998e-05 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:253 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.156682110000006, 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001548546, 2024-09-21T09:12:16.193 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 253 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008062+0000", 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008063+0000", 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.263e-06 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008070+0000", 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1369999999999996e-06 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008087+0000", 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6263999999999999e-05 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008096+0000", 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6670000000000008e-06 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008178+0000", 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1644999999999995e-05 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008240+0000", 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2453999999999995e-05 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.008448+0000", 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020722899999999999 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009447+0000", 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099947600000000001 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009547+0000", 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100268 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009582+0000", 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4459999999999999e-05 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.009610+0000", 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8683e-05 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:709 6.1e e36/30 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.920975521000003, 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015262559999999999, 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243768+0000", 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243769+0000", 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9999999999999996e-07 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243776+0000", 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0999999999999998e-06 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243790+0000", 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3882e-05 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243800+0000", 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0083e-05 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243943+0000", 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014281799999999999 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.243990+0000", 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7157000000000003e-05 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245247+0000", 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012564200000000001 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.245295+0000", 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7895999999999997e-05 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.203 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.898083511999999, 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023946290000000001, 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 721 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266663+0000", 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5289999999999998e-06 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266676+0000", 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.292e-05 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266705+0000", 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8816999999999999e-05 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266732+0000", 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7134000000000001e-05 2024-09-21T09:12:16.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266844+0000", 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111848 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267038+0000", 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019389 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267357+0000", 2024-09-21T09:12:16.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000319172 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268435+0000", 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010780430000000001 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268984+0000", 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054955599999999998 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269022+0000", 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7973999999999999e-05 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269055+0000", 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2746000000000001e-05 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.895109218000002, 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002147342, 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 723 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269636+0000", 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4720000000000001e-06 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269645+0000", 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.32e-06 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269667+0000", 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2487999999999999e-05 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269678+0000", 2024-09-21T09:12:16.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0794e-05 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269735+0000", 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269784+0000", 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8266999999999997e-05 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269905+0000", 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121012 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.270906+0000", 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00100125 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271576+0000", 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066977200000000001 2024-09-21T09:12:16.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271666+0000", 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9952999999999997e-05 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271782+0000", 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116469 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:775 6.1e e36/30 6:7db93595:::obj_delete_at_hint.0000000066:head v 36'5, mlcod=36'3)", 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.77329743, 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015332430000000001, 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391447+0000", 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391448+0000", 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7570000000000001e-06 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391462+0000", 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3256e-05 2024-09-21T09:12:16.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391491+0000", 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9753000000000001e-05 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391515+0000", 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3623999999999999e-05 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391667+0000", 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152065 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391732+0000", 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5099999999999997e-05 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392906+0000", 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011735719999999999 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392980+0000", 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4116000000000007e-05 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:778 6.1b e36/30 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 36'4, mlcod=36'2)", 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.766060233000005, 2024-09-21T09:12:16.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015037570000000001, 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398684+0000", 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398686+0000", 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8369999999999999e-06 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398703+0000", 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7363e-05 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398731+0000", 2024-09-21T09:12:16.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8367000000000001e-05 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398745+0000", 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.385e-05 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398923+0000", 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177818 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.398963+0000", 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9867000000000003e-05 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400088+0000", 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011250380000000001 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.400188+0000", 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9617000000000005e-05 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.224 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:814 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'7, mlcod=36'5)", 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.679245484000006, 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014758, 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485499+0000", 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485500+0000", 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.843e-06 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485513+0000", 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2284e-05 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485542+0000", 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9102999999999999e-05 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485555+0000", 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.375e-05 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485660+0000", 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104849 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485719+0000", 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8842999999999999e-05 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486885+0000", 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011654250000000001 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486974+0000", 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9703000000000005e-05 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:816 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'8, mlcod=36'6)", 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.675619245999997, 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016647159999999999, 2024-09-21T09:12:16.229 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489127+0000", 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489142+0000", 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5400000000000002e-05 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489177+0000", 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4894000000000002e-05 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489196+0000", 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8873e-05 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489355+0000", 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015918799999999999 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489424+0000", 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8572999999999996e-05 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490705+0000", 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012817079999999999 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490789+0000", 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4019999999999999e-05 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.233 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:844 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'12, mlcod=36'10)", 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.608440510999998, 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015352059999999999, 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556303+0000", 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556305+0000", 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.73e-06 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556317+0000", 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2233e-05 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556348+0000", 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0176e-05 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556361+0000", 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3694e-05 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556511+0000", 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014973800000000001 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556567+0000", 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6273999999999997e-05 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557740+0000", 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001173065 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557839+0000", 2024-09-21T09:12:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8295999999999995e-05 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:846 6.1c e36/30 6:38283b28:::obj_delete_at_hint.0000000089:head v 36'13, mlcod=36'11)", 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.604703720000003, 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014368810000000001, 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560040+0000", 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560042+0000", 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6500000000000001e-06 2024-09-21T09:12:16.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560056+0000", 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4233000000000001e-05 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560085+0000", 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8767000000000001e-05 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560098+0000", 2024-09-21T09:12:16.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3436e-05 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560242+0000", 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000143199 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.560305+0000", 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3269999999999996e-05 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561354+0000", 2024-09-21T09:12:16.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010487630000000001 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.561477+0000", 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012356300000000001 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.449117337999994, 2024-09-21T09:12:16.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028068680000000001, 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 910 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715630+0000", 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.92e-06 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715647+0000", 2024-09-21T09:12:16.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715680+0000", 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3572999999999999e-05 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715696+0000", 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5777000000000002e-05 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715819+0000", 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000122972 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716044+0000", 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022481500000000001 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716365+0000", 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032138400000000003 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.717426+0000", 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001061223 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718214+0000", 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078753099999999995 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718304+0000", 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0426999999999993e-05 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718434+0000", 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012908900000000001 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.445160285, 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031243310000000002, 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 912 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719585+0000", 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.72e-06 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719597+0000", 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1229999999999999e-05 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719621+0000", 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4073000000000001e-05 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719633+0000", 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.259e-05 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719761+0000", 2024-09-21T09:12:16.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012745599999999999 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720000+0000", 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023914800000000001 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720482+0000", 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048253400000000001 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.721627+0000", 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001145002 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722556+0000", 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092825299999999998 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722640+0000", 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4542999999999993e-05 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722708+0000", 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7781999999999996e-05 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.405006048000004, 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014824689999999999, 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759738+0000", 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759740+0000", 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7370000000000001e-06 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759752+0000", 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2483000000000001e-05 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759782+0000", 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9553e-05 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759798+0000", 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6042999999999999e-05 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759943+0000", 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760001+0000", 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8777000000000003e-05 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761134+0000", 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001132922 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761220+0000", 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6044999999999994e-05 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.258 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1020 6.10 e45/30 6:0fbdcb32:usage::usage.17:head v 45'5, mlcod=36'3)", 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.125466428999999, 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001677574, 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039281+0000", 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0939999999999999e-06 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039305+0000", 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3906000000000001e-05 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039349+0000", 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4064999999999999e-05 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039379+0000", 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9889000000000001e-05 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039517+0000", 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013895300000000001 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039574+0000", 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6162000000000002e-05 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040855+0000", 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001281821 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040955+0000", 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9684000000000003e-05 2024-09-21T09:12:16.262 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4845.0:63 8.4 8:225317ff:users.uid::usr1:head [delete,create,call version.check_conds in=18b,call version.set in=10b,writefull 0~383] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:15.849782+0000", 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.314961822, 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015212170000000001, 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4845", 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3294665119", 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 63 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.849782+0000", 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.849782+0000", 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.849783+0000", 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2999999999999999e-07 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.849788+0000", 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5809999999999998e-06 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.849798+0000", 2024-09-21T09:12:16.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.008e-05 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.849803+0000", 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2800000000000003e-06 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.849849+0000", 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5982999999999997e-05 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.849943+0000", 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4184000000000005e-05 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.850182+0000", 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000238574 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.850811+0000", 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062951299999999995 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.851192+0000", 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038121999999999999 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.851256+0000", 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3317000000000004e-05 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:15.851303+0000", 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7654999999999997e-05 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.268 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.269 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.269 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:16.269 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T09:12:16.269 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T09:12:16.269 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-21T09:12:16.270 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T09:12:16.270 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T09:12:16.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-21T09:12:16.271 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:16.272 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:16.267+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:16.351 INFO:tasks.workunit.client.0.smithi007.stdout:user usr1 deleted 2024-09-21T09:12:16.371 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:16.365+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:16.410 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T09:12:16.410 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:16.434 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:16.435 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:16.435 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:16.435 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:16.448 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:16.472 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:16.469+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:16.514 INFO:tasks.workunit.client.0.smithi007.stdout:Bucket Created: buck_2024_08_21_09_12_16 2024-09-21T09:12:16.573 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:16.567+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:16.604 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:16.604 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:16.604 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:16.605 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:16.605 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:16.619 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:16.702 INFO:tasks.workunit.client.0.smithi007.stderr:1+0 records in 2024-09-21T09:12:16.702 INFO:tasks.workunit.client.0.smithi007.stderr:1+0 records out 2024-09-21T09:12:16.702 INFO:tasks.workunit.client.0.smithi007.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0287079 s, 365 MB/s 2024-09-21T09:12:16.702 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:16.699+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:16.775 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:16.769+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:16.780 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:16.780 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:16.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:16.781 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:16.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.781 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-21T09:12:16.781 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:16.781 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 87.005490644999995, 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073206360000000002, 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 5 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:16.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772825+0000", 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7129999999999999e-06 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772843+0000", 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8033000000000002e-05 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772882+0000", 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9434000000000002e-05 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772902+0000", 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0075999999999999e-05 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773008+0000", 2024-09-21T09:12:16.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105351 2024-09-21T09:12:16.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:16.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773016+0000", 2024-09-21T09:12:16.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1419999999999993e-06 2024-09-21T09:12:16.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776094+0000", 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030782549999999998 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776289+0000", 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019460899999999999 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776487+0000", 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000198142 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.778052+0000", 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001565812 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.779852+0000", 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001799171 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780015+0000", 2024-09-21T09:12:16.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000162862 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780142+0000", 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012703599999999999 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.002868800000002, 2024-09-21T09:12:16.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01128114, 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775446+0000", 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775478+0000", 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775525+0000", 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7734000000000001e-05 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775559+0000", 2024-09-21T09:12:16.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4133e-05 2024-09-21T09:12:16.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775753+0000", 2024-09-21T09:12:16.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000193248 2024-09-21T09:12:16.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:16.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775773+0000", 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0086999999999999e-05 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783330+0000", 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075572979999999996 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783469+0000", 2024-09-21T09:12:16.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138839 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783767+0000", 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029823499999999999 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.785719+0000", 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00195207 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786427+0000", 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070740099999999997 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786600+0000", 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017295900000000001 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786724+0000", 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012436599999999999 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 73.937233477000007, 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011832176, 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.796 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 43 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841082+0000", 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9870000000000001e-06 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841121+0000", 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8593000000000001e-05 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841153+0000", 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2716000000000003e-05 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841179+0000", 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5190000000000001e-05 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841332+0000", 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000153509 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841368+0000", 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6183000000000002e-05 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845655+0000", 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00428642 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845676+0000", 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1687000000000001e-05 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852576+0000", 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0068992860000000001 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852910+0000", 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033460500000000003 2024-09-21T09:12:16.801 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.865251223000001, 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0099467879999999998, 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.802 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 214 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913064+0000", 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9439999999999998e-06 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913079+0000", 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4966e-05 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913119+0000", 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9297e-05 2024-09-21T09:12:16.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913147+0000", 2024-09-21T09:12:16.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8776e-05 2024-09-21T09:12:16.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913293+0000", 2024-09-21T09:12:16.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014535899999999999 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913303+0000", 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0243e-05 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920048+0000", 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067448569999999999 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920345+0000", 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000297454 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920742+0000", 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039676499999999999 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922048+0000", 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00130641 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922865+0000", 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081690500000000004 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922947+0000", 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1751999999999999e-05 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923007+0000", 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0059999999999998e-05 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.835382684999999, 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033742799999999999, 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 220 2024-09-21T09:12:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942931+0000", 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4030000000000001e-06 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942943+0000", 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942976+0000", 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3120000000000001e-05 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942991+0000", 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5376999999999999e-05 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943103+0000", 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011184900000000001 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943318+0000", 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021467900000000001 2024-09-21T09:12:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943715+0000", 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039689700000000001 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.945217+0000", 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001501973 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946150+0000", 2024-09-21T09:12:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093294700000000005 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946234+0000", 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4425000000000006e-05 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946303+0000", 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9016999999999993e-05 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.816684531000007, 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031516420000000001, 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 225 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961629+0000", 2024-09-21T09:12:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1730000000000002e-06 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961640+0000", 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0927000000000001e-05 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961671+0000", 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1032999999999999e-05 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961686+0000", 2024-09-21T09:12:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5304000000000001e-05 2024-09-21T09:12:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961813+0000", 2024-09-21T09:12:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012683900000000001 2024-09-21T09:12:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962030+0000", 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021637499999999999 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962446+0000", 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041634700000000002 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.963645+0000", 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011985279999999999 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964623+0000", 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000978673 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964713+0000", 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9660000000000006e-05 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964779+0000", 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5783000000000004e-05 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:228 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.806373360999999, 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032433039999999998, 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 228 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971940+0000", 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1100000000000001e-06 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971951+0000", 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0556e-05 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971982+0000", 2024-09-21T09:12:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1442999999999997e-05 2024-09-21T09:12:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971998+0000", 2024-09-21T09:12:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5673000000000001e-05 2024-09-21T09:12:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972130+0000", 2024-09-21T09:12:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000132213 2024-09-21T09:12:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972337+0000", 2024-09-21T09:12:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020659899999999999 2024-09-21T09:12:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972731+0000", 2024-09-21T09:12:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039369699999999998 2024-09-21T09:12:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.974129+0000", 2024-09-21T09:12:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013981029999999999 2024-09-21T09:12:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975031+0000", 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090264399999999997 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975116+0000", 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4616000000000004e-05 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975182+0000", 2024-09-21T09:12:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5649999999999997e-05 2024-09-21T09:12:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.792238171999998, 2024-09-21T09:12:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030216219999999998, 2024-09-21T09:12:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 232 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986076+0000", 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3130000000000001e-06 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986087+0000", 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1387e-05 2024-09-21T09:12:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986118+0000", 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986134+0000", 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.524e-05 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986241+0000", 2024-09-21T09:12:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010744899999999999 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986461+0000", 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021971600000000001 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986879+0000", 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041845000000000001 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988536+0000", 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001657045 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988933+0000", 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695699999999997 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989021+0000", 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7947000000000003e-05 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989095+0000", 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3812000000000004e-05 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.785313639999998, 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032333710000000001, 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 234 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993000+0000", 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993011+0000", 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0647e-05 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993040+0000", 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9456999999999999e-05 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993055+0000", 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.485e-05 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993166+0000", 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000110942 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993409+0000", 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242871 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993829+0000", 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000420154 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.995035+0000", 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001206295 2024-09-21T09:12:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996079+0000", 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00104407 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996167+0000", 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7440000000000003e-05 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996231+0000", 2024-09-21T09:12:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4589000000000001e-05 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.387784862999993, 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029466929999999998, 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 775 2024-09-21T09:12:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390530+0000", 2024-09-21T09:12:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9270000000000001e-06 2024-09-21T09:12:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390542+0000", 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2016e-05 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390574+0000", 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2199999999999997e-05 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390589+0000", 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5339999999999999e-05 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390719+0000", 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012939599999999999 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390928+0000", 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000209898 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391244+0000", 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031530799999999998 2024-09-21T09:12:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392535+0000", 2024-09-21T09:12:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001291008 2024-09-21T09:12:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393288+0000", 2024-09-21T09:12:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075327100000000002 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393404+0000", 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011562599999999999 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393473+0000", 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9703000000000007e-05 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:784 6.8 6:1111b601:::obj_delete_at_hint.0000000069:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.365097517999999, 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003135367, 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 784 2024-09-21T09:12:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413216+0000", 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.784e-06 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413225+0000", 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8580000000000006e-06 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413249+0000", 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4212000000000001e-05 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413260+0000", 2024-09-21T09:12:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1514e-05 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413401+0000", 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014083699999999999 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413625+0000", 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022383099999999999 2024-09-21T09:12:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413942+0000", 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317375 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.415132+0000", 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001189072 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416200+0000", 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010679979999999999 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416282+0000", 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2713999999999994e-05 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416349+0000", 2024-09-21T09:12:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7172e-05 2024-09-21T09:12:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.293754422999996, 2024-09-21T09:12:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029415460000000002, 2024-09-21T09:12:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 814 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484559+0000", 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484570+0000", 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.098e-05 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484601+0000", 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1062999999999997e-05 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484616+0000", 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4735999999999999e-05 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484747+0000", 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000130729 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484965+0000", 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217982 2024-09-21T09:12:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485271+0000", 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000306488 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486347+0000", 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010752030000000001 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487293+0000", 2024-09-21T09:12:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094605299999999998 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487379+0000", 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6558999999999996e-05 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487499+0000", 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011955000000000001 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.289928779999997, 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029122929999999998, 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 816 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488383+0000", 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488385+0000", 2024-09-21T09:12:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8700000000000001e-06 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488395+0000", 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0723000000000001e-05 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488420+0000", 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.508e-05 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488433+0000", 2024-09-21T09:12:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2317000000000001e-05 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488538+0000", 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105475 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488669+0000", 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000131073 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.488940+0000", 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027115100000000002 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490015+0000", 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010748159999999999 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491096+0000", 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001080733 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491179+0000", 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2942999999999995e-05 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.491295+0000", 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116112 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.243959169999997, 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003172818, 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 835 2024-09-21T09:12:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534355+0000", 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2840000000000001e-06 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534366+0000", 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1396000000000001e-05 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534398+0000", 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1823999999999999e-05 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534413+0000", 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4919999999999999e-05 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534528+0000", 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115209 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534749+0000", 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022136500000000001 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.535063+0000", 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031351399999999998 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.536086+0000", 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010234899999999999 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537283+0000", 2024-09-21T09:12:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011962819999999999 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537407+0000", 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123819 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537525+0000", 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118715 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.222954677999994, 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030129000000000002, 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 844 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555359+0000", 2024-09-21T09:12:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555369+0000", 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0207000000000001e-05 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555398+0000", 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8822999999999998e-05 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555412+0000", 2024-09-21T09:12:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4443e-05 2024-09-21T09:12:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555537+0000", 2024-09-21T09:12:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012447900000000001 2024-09-21T09:12:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555756+0000", 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021879899999999999 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556069+0000", 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031338399999999999 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557174+0000", 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011049860000000001 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558209+0000", 2024-09-21T09:12:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034653 2024-09-21T09:12:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558297+0000", 2024-09-21T09:12:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8446e-05 2024-09-21T09:12:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558370+0000", 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2700000000000005e-05 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:864 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.176416177999997, 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002853324, 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 864 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601895+0000", 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601897+0000", 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.61e-06 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601905+0000", 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2470000000000008e-06 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601930+0000", 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4885999999999999e-05 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.601949+0000", 2024-09-21T09:12:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9006000000000001e-05 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602078+0000", 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012905600000000001 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602220+0000", 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141586 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.602489+0000", 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026938199999999998 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.603606+0000", 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011163880000000001 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604600+0000", 2024-09-21T09:12:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00099397700000000005 2024-09-21T09:12:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604685+0000", 2024-09-21T09:12:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5740000000000002e-05 2024-09-21T09:12:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.604749+0000", 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3446000000000002e-05 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.055413571000003, 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031274219999999999, 2024-09-21T09:12:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 913 2024-09-21T09:12:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722901+0000", 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722912+0000", 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1693e-05 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722944+0000", 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.222e-05 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722959+0000", 2024-09-21T09:12:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4902999999999999e-05 2024-09-21T09:12:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723110+0000", 2024-09-21T09:12:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015031500000000001 2024-09-21T09:12:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723344+0000", 2024-09-21T09:12:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000234799 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723667+0000", 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032255100000000002 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.724725+0000", 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010575859999999999 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725873+0000", 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001148579 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725961+0000", 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8063e-05 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.726025+0000", 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4156e-05 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.051305718999998, 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029665730000000001, 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 915 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727008+0000", 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7129999999999999e-06 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727016+0000", 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6600000000000001e-06 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727041+0000", 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5253e-05 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727055+0000", 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3403e-05 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727227+0000", 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017192600000000001 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727363+0000", 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013665199999999999 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727627+0000", 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000263565 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.728717+0000", 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001090029 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729815+0000", 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010975099999999999 2024-09-21T09:12:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729908+0000", 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3029000000000007e-05 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729972+0000", 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4832999999999994e-05 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.019969181999997, 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035043000000000001, 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 928 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758345+0000", 2024-09-21T09:12:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4339999999999999e-06 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758356+0000", 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1423000000000001e-05 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758389+0000", 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2336999999999999e-05 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758408+0000", 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9706000000000001e-05 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758579+0000", 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017064599999999999 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758939+0000", 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036013000000000001 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759516+0000", 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057737999999999995 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760877+0000", 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013600769999999999 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761559+0000", 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068295900000000002 2024-09-21T09:12:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761727+0000", 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016766900000000001 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761847+0000", 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119539 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4216.0:2 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.779885954999997, 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049270260000000001, 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4216", 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/896302906", 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998428+0000", 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:12:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998453+0000", 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5449e-05 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998478+0000", 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4769e-05 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998502+0000", 2024-09-21T09:12:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3448999999999999e-05 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998630+0000", 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012872299999999999 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998640+0000", 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9329999999999996e-06 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003282+0000", 2024-09-21T09:12:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004641816 2024-09-21T09:12:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003353+0000", 2024-09-21T09:12:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0627e-05 2024-09-21T09:12:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.910 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.910 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.910 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:16.910 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:16.910 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:16.912 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:16.912 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:16.907+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:16.957 INFO:tasks.workunit.client.0.smithi007.stdout:quota enabled for the user usr2 2024-09-21T09:12:16.957 INFO:tasks.workunit.client.0.smithi007.stdout:adding file to bucket buck_2024_08_21_09_12_16: 10Mb. 2024-09-21T09:12:16.957 INFO:tasks.workunit.client.0.smithi007.stdout:upload file successful 2024-09-21T09:12:16.957 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:16.957 INFO:tasks.workunit.client.0.smithi007.stdout:Test case: PASSED - quota set for user: usr2 with max_objects=1 passed 2024-09-21T09:12:16.957 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:17.012 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:17.009+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:17.045 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:17.045 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:17.045 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:17.045 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:17.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:17.114 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:17.111+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:17.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T09:12:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:user usr2 deleted 2024-09-21T09:12:17.216 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:17.211+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:17.240 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:17.240 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:17.240 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:17.240 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:17.240 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:17.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:17.317 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:17.313+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:Bucket Created: buck_2024_08_21_09_12_17 2024-09-21T09:12:17.402 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:17.402 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:17.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:17.402 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:17.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 74.543090813999996, 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083044959999999998, 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 44 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857525+0000", 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2059999999999999e-06 2024-09-21T09:12:17.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857541+0000", 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5826999999999999e-05 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857608+0000", 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7353000000000004e-05 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857632+0000", 2024-09-21T09:12:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3595999999999999e-05 2024-09-21T09:12:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857842+0000", 2024-09-21T09:12:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021056800000000001 2024-09-21T09:12:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-21T09:12:17.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857863+0000", 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0917e-05 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865509+0000", 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076459040000000002 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865826+0000", 2024-09-21T09:12:17.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031712500000000002 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.529085533, 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0108574, 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 206 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871530+0000", 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871545+0000", 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4620000000000001e-05 2024-09-21T09:12:17.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871584+0000", 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9582999999999997e-05 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871602+0000", 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8057e-05 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871776+0000", 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017372500000000001 2024-09-21T09:12:17.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871792+0000", 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878149+0000", 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063566910000000003 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878502+0000", 2024-09-21T09:12:17.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284800000000001 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.879223+0000", 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072110100000000003 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.881741+0000", 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025179310000000002 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882232+0000", 2024-09-21T09:12:17.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00049132199999999998 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882325+0000", 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2816e-05 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882384+0000", 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9509999999999998e-05 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.517853356000003, 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032285479999999999, 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.415 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 207 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882761+0000", 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0729999999999999e-06 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882771+0000", 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0287e-05 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882796+0000", 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4873000000000001e-05 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882811+0000", 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4752999999999999e-05 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882904+0000", 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2869999999999997e-05 2024-09-21T09:12:17.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883081+0000", 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017743500000000001 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883433+0000", 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035207000000000001 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.884576+0000", 2024-09-21T09:12:17.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001142405 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885843+0000", 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012676230000000001 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885921+0000", 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7338999999999999e-05 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885988+0000", 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6820000000000001e-05 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.501449940000001, 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033258939999999998, 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.421 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 210 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899165+0000", 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3199999999999998e-06 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899176+0000", 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1154e-05 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899209+0000", 2024-09-21T09:12:17.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2580000000000003e-05 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899224+0000", 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4976e-05 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899345+0000", 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121296 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899542+0000", 2024-09-21T09:12:17.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019720499999999999 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899947+0000", 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040540299999999998 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.901475+0000", 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015280319999999999 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902217+0000", 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074172400000000003 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902369+0000", 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015137899999999999 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902488+0000", 2024-09-21T09:12:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119825 2024-09-21T09:12:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.448553857999997, 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037626880000000001, 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 222 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952061+0000", 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4700000000000001e-06 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952073+0000", 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.155e-05 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952103+0000", 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0716999999999997e-05 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952119+0000", 2024-09-21T09:12:17.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5613000000000001e-05 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952271+0000", 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015167499999999999 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952654+0000", 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038366399999999998 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:17.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.953387+0000", 2024-09-21T09:12:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073280800000000005 2024-09-21T09:12:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955064+0000", 2024-09-21T09:12:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016773000000000001 2024-09-21T09:12:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955552+0000", 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048774000000000002 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955707+0000", 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154878 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955821+0000", 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114273 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.433 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:12:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.419563311999994, 2024-09-21T09:12:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030613469999999999, 2024-09-21T09:12:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 230 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981049+0000", 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981052+0000", 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4169999999999999e-06 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981066+0000", 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3933e-05 2024-09-21T09:12:17.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981098+0000", 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2023999999999997e-05 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981114+0000", 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6453e-05 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981230+0000", 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116092 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981448+0000", 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021825499999999999 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.981870+0000", 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0004214 2024-09-21T09:12:17.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.983260+0000", 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013901429999999999 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.983949+0000", 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068917399999999997 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984038+0000", 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9322999999999998e-05 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.984111+0000", 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2132999999999995e-05 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:17.440 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.394127897999994, 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032388619999999999, 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 238 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006487+0000", 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006497+0000", 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0457e-05 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006526+0000", 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8975999999999998e-05 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006547+0000", 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0613000000000001e-05 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006669+0000", 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121896 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006881+0000", 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021207499999999999 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:17.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.007199+0000", 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031782099999999998 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.008434+0000", 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012349609999999999 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009576+0000", 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001141998 2024-09-21T09:12:17.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009661+0000", 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5982000000000004e-05 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009723+0000", 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1940000000000007e-05 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:256 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.389916120999999, 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030661970000000001, 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 256 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010696+0000", 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010698+0000", 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5740000000000001e-06 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010707+0000", 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3530000000000001e-06 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010735+0000", 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7293000000000001e-05 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010759+0000", 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4054e-05 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.010890+0000", 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131822 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.011023+0000", 2024-09-21T09:12:17.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132612 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.011351+0000", 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032816399999999998 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.012826+0000", 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014745820000000001 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013497+0000", 2024-09-21T09:12:17.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00067147500000000004 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013654+0000", 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015681199999999999 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013763+0000", 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010845600000000001 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.452 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:378 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.355584351999994, 2024-09-21T09:12:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036030390000000002, 2024-09-21T09:12:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.453 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 378 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045031+0000", 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9859999999999999e-06 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045069+0000", 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7876999999999997e-05 2024-09-21T09:12:17.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045123+0000", 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4202e-05 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045148+0000", 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4924000000000001e-05 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045310+0000", 2024-09-21T09:12:17.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016157899999999999 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045542+0000", 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023267399999999999 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045859+0000", 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000316872 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047142+0000", 2024-09-21T09:12:17.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001283216 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048468+0000", 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001325534 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048562+0000", 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4015e-05 2024-09-21T09:12:17.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048631+0000", 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9159999999999995e-05 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:383 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.353568366999994, 2024-09-21T09:12:17.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030650489999999998, 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 383 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047044+0000", 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047046+0000", 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.306e-06 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047060+0000", 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3716999999999999e-05 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047090+0000", 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9456000000000001e-05 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047138+0000", 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.884e-05 2024-09-21T09:12:17.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047236+0000", 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7141999999999999e-05 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047484+0000", 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024807200000000001 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047923+0000", 2024-09-21T09:12:17.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043972599999999998 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049320+0000", 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001396883 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049881+0000", 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056092200000000005 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.049991+0000", 2024-09-21T09:12:17.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109709 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.050109+0000", 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118276 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:398 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.349128522000001, 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037105979999999998, 2024-09-21T09:12:17.465 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 398 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051486+0000", 2024-09-21T09:12:17.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0030000000000001e-06 2024-09-21T09:12:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051497+0000", 2024-09-21T09:12:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0957e-05 2024-09-21T09:12:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051519+0000", 2024-09-21T09:12:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2263e-05 2024-09-21T09:12:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051531+0000", 2024-09-21T09:12:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2306999999999999e-05 2024-09-21T09:12:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052064+0000", 2024-09-21T09:12:17.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00053253199999999995 2024-09-21T09:12:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052392+0000", 2024-09-21T09:12:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000327628 2024-09-21T09:12:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052743+0000", 2024-09-21T09:12:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035127699999999999 2024-09-21T09:12:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053814+0000", 2024-09-21T09:12:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010707049999999999 2024-09-21T09:12:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055011+0000", 2024-09-21T09:12:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001197814 2024-09-21T09:12:17.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055126+0000", 2024-09-21T09:12:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114262 2024-09-21T09:12:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055195+0000", 2024-09-21T09:12:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8850000000000007e-05 2024-09-21T09:12:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:405 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.346803539999996, 2024-09-21T09:12:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033493780000000001, 2024-09-21T09:12:17.476 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 405 2024-09-21T09:12:17.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053811+0000", 2024-09-21T09:12:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7999999999999999e-06 2024-09-21T09:12:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053823+0000", 2024-09-21T09:12:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1800000000000001e-05 2024-09-21T09:12:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053857+0000", 2024-09-21T09:12:17.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.464e-05 2024-09-21T09:12:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053875+0000", 2024-09-21T09:12:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7479999999999999e-05 2024-09-21T09:12:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054016+0000", 2024-09-21T09:12:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014128200000000001 2024-09-21T09:12:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054142+0000", 2024-09-21T09:12:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012590600000000001 2024-09-21T09:12:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054426+0000", 2024-09-21T09:12:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028461399999999998 2024-09-21T09:12:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.056935+0000", 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025088799999999998 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057011+0000", 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6097e-05 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057091+0000", 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9098999999999996e-05 2024-09-21T09:12:17.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057158+0000", 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7780000000000005e-05 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:566 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.266158523000001, 2024-09-21T09:12:17.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003214822, 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 566 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:12:17.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134454+0000", 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134456+0000", 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1289999999999999e-06 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134467+0000", 2024-09-21T09:12:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1396999999999999e-05 2024-09-21T09:12:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134499+0000", 2024-09-21T09:12:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1111000000000001e-05 2024-09-21T09:12:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134516+0000", 2024-09-21T09:12:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7893999999999998e-05 2024-09-21T09:12:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.134669+0000", 2024-09-21T09:12:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015240100000000001 2024-09-21T09:12:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.135038+0000", 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036941799999999999 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.135615+0000", 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057627500000000001 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137179+0000", 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015641450000000001 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137473+0000", 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029436399999999998 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137562+0000", 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8566000000000006e-05 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.137669+0000", 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107122 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.492 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:603 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.236891757999999, 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030919720000000001, 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.493 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 603 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163721+0000", 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163722+0000", 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.513e-06 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163730+0000", 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4930000000000001e-06 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163754+0000", 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3900000000000002e-05 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163775+0000", 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1500000000000001e-05 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.163914+0000", 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013844899999999999 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.164143+0000", 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022904699999999999 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.164616+0000", 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047342400000000001 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166515+0000", 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001898903 2024-09-21T09:12:17.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166641+0000", 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125573 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166721+0000", 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0513999999999995e-05 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.166813+0000", 2024-09-21T09:12:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1656000000000005e-05 2024-09-21T09:12:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:12:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.906993030999999, 2024-09-21T09:12:17.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031191460000000002, 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 817 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493619+0000", 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493622+0000", 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6800000000000002e-06 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493633+0000", 2024-09-21T09:12:17.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0987e-05 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493665+0000", 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2356e-05 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493680+0000", 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4647000000000001e-05 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.493835+0000", 2024-09-21T09:12:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015487500000000001 2024-09-21T09:12:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.494066+0000", 2024-09-21T09:12:17.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231432 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.494380+0000", 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031386700000000001 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.495603+0000", 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012222940000000001 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496574+0000", 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00097185200000000005 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496662+0000", 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7836000000000004e-05 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.496739+0000", 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6320000000000001e-05 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.850205001999996, 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030747119999999998, 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.506 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 841 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550407+0000", 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550410+0000", 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3360000000000002e-06 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550421+0000", 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1590000000000001e-05 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550454+0000", 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2206000000000003e-05 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550471+0000", 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7099999999999999e-05 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550621+0000", 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015060900000000001 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.550830+0000", 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000208428 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.551146+0000", 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031587100000000001 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.552316+0000", 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011707810000000001 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553331+0000", 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010147890000000001 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553416+0000", 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4575999999999998e-05 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.553482+0000", 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6426000000000004e-05 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.690399709000005, 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031788189999999998, 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 907 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710213+0000", 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710215+0000", 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4770000000000002e-06 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710227+0000", 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1293e-05 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710258+0000", 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1585999999999999e-05 2024-09-21T09:12:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710273+0000", 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5330000000000001e-05 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710423+0000", 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014969199999999999 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710650+0000", 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-21T09:12:17.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.710993+0000", 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000342725 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.712231+0000", 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012387800000000001 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713240+0000", 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001008805 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713327+0000", 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6349999999999998e-05 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.713392+0000", 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4953e-05 2024-09-21T09:12:17.517 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.361075487999997, 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032957440000000002, 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.518 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1020 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:17.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039540+0000", 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1499999999999999e-06 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039558+0000", 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7549000000000001e-05 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039596+0000", 2024-09-21T09:12:17.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8583e-05 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039615+0000", 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8805e-05 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039759+0000", 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143702 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040000+0000", 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024096600000000001 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040380+0000", 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038004199999999998 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.041780+0000", 2024-09-21T09:12:17.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400625 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042670+0000", 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088968599999999999 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042760+0000", 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9602e-05 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042833+0000", 2024-09-21T09:12:17.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3034000000000006e-05 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4691.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:16.223056+0000", 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.1775560110000001, 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030622230000000002, 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.524 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4691", 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/3556030469", 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 63 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.223056+0000", 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.223056+0000", 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.223059+0000", 2024-09-21T09:12:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4370000000000001e-06 2024-09-21T09:12:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.223069+0000", 2024-09-21T09:12:17.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0403e-05 2024-09-21T09:12:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.223100+0000", 2024-09-21T09:12:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0496000000000001e-05 2024-09-21T09:12:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.223116+0000", 2024-09-21T09:12:17.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5945000000000001e-05 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.223269+0000", 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015304899999999999 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.223548+0000", 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027956200000000002 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.226119+0000", 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025703309999999999 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1182 4.29 4:958da29d:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.3.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:17.313953+0000", 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.086659612999999996, 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032343979999999999, 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:17.529 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1182 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313953+0000", 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313953+0000", 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313955+0000", 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0609999999999998e-06 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313963+0000", 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4149999999999999e-06 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313984+0000", 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0299e-05 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313992+0000", 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0390000000000005e-06 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.314093+0000", 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101739 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.314298+0000", 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000204153 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.314491+0000", 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000193162 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:17.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.315912+0000", 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014216249999999999 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.317088+0000", 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001175408 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.317141+0000", 2024-09-21T09:12:17.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3637999999999997e-05 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.317187+0000", 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5859000000000003e-05 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:17.535 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:17.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:17.537 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:17.531+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:17.549 INFO:tasks.workunit.client.0.smithi007.stderr:1+0 records in 2024-09-21T09:12:17.549 INFO:tasks.workunit.client.0.smithi007.stderr:1+0 records out 2024-09-21T09:12:17.549 INFO:tasks.workunit.client.0.smithi007.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.079624 s, 132 MB/s 2024-09-21T09:12:17.638 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:17.633+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:17.713 INFO:tasks.workunit.client.0.smithi007.stdout:quota enabled for the user usr1 2024-09-21T09:12:17.713 INFO:tasks.workunit.client.0.smithi007.stdout:adding file to bucket buck_2024_08_21_09_12_17: 10Mb. 2024-09-21T09:12:17.713 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:17.713 INFO:tasks.workunit.client.0.smithi007.stdout:Test case: PASSED - quota set for user: usr1 with max_size=0 passed 2024-09-21T09:12:17.714 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:17.722 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:17.722 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:17.722 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:17.722 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:17.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:17.738 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:17.735+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:17.839 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:17.833+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:17.913 INFO:tasks.workunit.client.0.smithi007.stdout:user usr1 deleted 2024-09-21T09:12:17.922 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:17.923 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:17.923 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:17.923 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:17.923 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:17.937 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:17.939 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:17.935+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:17.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:18.040 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:18.035+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:18.056 INFO:tasks.workunit.client.0.smithi007.stdout:Bucket Created: buck_2024_08_21_09_12_18 2024-09-21T09:12:18.100 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:18.107 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:105 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'67, mlcod=18'64)", 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.077285+0000", 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.029116395000003, 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044933220000000001, 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077285+0000", 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077285+0000", 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077287+0000", 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-06 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077298+0000", 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1678999999999999e-05 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077320+0000", 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1846999999999999e-05 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077343+0000", 2024-09-21T09:12:18.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3056000000000001e-05 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077475+0000", 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013190599999999999 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.077533+0000", 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7763000000000002e-05 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081682+0000", 2024-09-21T09:12:18.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041487779999999997 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081778+0000", 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6606000000000003e-05 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:106 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'68, mlcod=18'64)", 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.078473+0000", 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.027928337999995, 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054399260000000003, 2024-09-21T09:12:18.112 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078473+0000", 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078473+0000", 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078475+0000", 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.917e-06 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078532+0000", 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7065999999999999e-05 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078562+0000", 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9960000000000001e-05 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078576+0000", 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4117000000000001e-05 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078706+0000", 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129825 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.078757+0000", 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1409999999999997e-05 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083837+0000", 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050797009999999998 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083913+0000", 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.593e-05 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:107 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'69, mlcod=18'64)", 2024-09-21T09:12:18.116 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.079055+0000", 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.027346828999995, 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049846589999999998, 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079055+0000", 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079055+0000", 2024-09-21T09:12:18.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079056+0000", 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079065+0000", 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7539999999999995e-06 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079083+0000", 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8675999999999999e-05 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079095+0000", 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1192999999999999e-05 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080121+0000", 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010260919999999999 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080169+0000", 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8622999999999998e-05 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083920+0000", 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037501890000000001 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084039+0000", 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119672 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.120 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:108 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'70, mlcod=18'64)", 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.079893+0000", 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.026508276000001, 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060657009999999997, 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079893+0000", 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079893+0000", 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079895+0000", 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7999999999999999e-06 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079907+0000", 2024-09-21T09:12:18.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1804000000000001e-05 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079936+0000", 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8952999999999999e-05 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.079949+0000", 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3137e-05 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080782+0000", 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000833146 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080837+0000", 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4676999999999998e-05 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085875+0000", 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050385079999999997 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085959+0000", 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3676000000000003e-05 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:109 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'71, mlcod=18'65)", 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.080883+0000", 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.025518429000002, 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051320599999999999, 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080883+0000", 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080883+0000", 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080885+0000", 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8300000000000001e-06 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080949+0000", 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4325000000000005e-05 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080971+0000", 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2044000000000001e-05 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.080986+0000", 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5033e-05 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081896+0000", 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090971300000000004 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081933+0000", 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7013e-05 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085964+0000", 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040313859999999997 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086015+0000", 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0716e-05 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:110 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'72, mlcod=18'65)", 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.081561+0000", 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.024840458, 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068081039999999997, 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081561+0000", 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081561+0000", 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081563+0000", 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081574+0000", 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1783000000000001e-05 2024-09-21T09:12:18.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081648+0000", 2024-09-21T09:12:18.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3219999999999994e-05 2024-09-21T09:12:18.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.081662+0000", 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4476e-05 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083047+0000", 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001385159 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083101+0000", 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3477000000000003e-05 2024-09-21T09:12:18.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088271+0000", 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051698569999999999 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088369+0000", 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8371999999999999e-05 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:111 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'73, mlcod=18'65)", 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.082289+0000", 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.024112457000001, 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061528659999999999, 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082289+0000", 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082289+0000", 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082291+0000", 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.243e-06 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082303+0000", 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2217e-05 2024-09-21T09:12:18.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082338+0000", 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4650000000000002e-05 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082357+0000", 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8830000000000001e-05 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084154+0000", 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001796843 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084208+0000", 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3878999999999997e-05 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088378+0000", 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041704339999999998 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088442+0000", 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3769999999999994e-05 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:112 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'65)", 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.082917+0000", 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.023484722000006, 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066998520000000001, 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.140 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082917+0000", 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082917+0000", 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.082919+0000", 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.95e-06 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083051+0000", 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132509 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083073+0000", 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1763000000000002e-05 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083088+0000", 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4759999999999999e-05 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084918+0000", 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018304829999999999 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084951+0000", 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2772999999999999e-05 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089556+0000", 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046048310000000002 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089616+0000", 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0782999999999997e-05 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:113 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'66)", 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.083741+0000", 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.022660470999995, 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005920687, 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083741+0000", 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083741+0000", 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083743+0000", 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7230000000000001e-06 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083757+0000", 2024-09-21T09:12:18.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.438e-05 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083785+0000", 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8073e-05 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.083801+0000", 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6217000000000001e-05 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086120+0000", 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023185749999999998 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086175+0000", 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4666000000000001e-05 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089619+0000", 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034447100000000001 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089662+0000", 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2342999999999998e-05 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:114 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'66)", 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.084454+0000", 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.021947006000005, 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052759850000000004, 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.149 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084454+0000", 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084454+0000", 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084456+0000", 2024-09-21T09:12:18.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8700000000000001e-06 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084468+0000", 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2179e-05 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084502+0000", 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3433000000000003e-05 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.084523+0000", 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0930000000000001e-05 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086844+0000", 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023216589999999998 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086884+0000", 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9526000000000001e-05 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089663+0000", 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027793819999999999 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089730+0000", 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7006000000000002e-05 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:115 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'66)", 2024-09-21T09:12:18.153 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.085022+0000", 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.021379757999995, 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047624859999999998, 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085022+0000", 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085022+0000", 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085027+0000", 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4129999999999997e-06 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085079+0000", 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1826999999999997e-05 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085103+0000", 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4029999999999999e-05 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.085115+0000", 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1695999999999999e-05 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.087411+0000", 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002296846 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.087453+0000", 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1205999999999998e-05 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089739+0000", 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002286546 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089784+0000", 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4922000000000001e-05 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.157 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:116 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'68)", 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.086116+0000", 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.020285516000001, 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038724229999999998, 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086116+0000", 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086116+0000", 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086117+0000", 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.313e-06 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086150+0000", 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2639999999999999e-05 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086174+0000", 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3975999999999999e-05 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086195+0000", 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1157000000000001e-05 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088527+0000", 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023322120000000002 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.088562+0000", 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5132999999999997e-05 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089854+0000", 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012916469999999999 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089988+0000", 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013434499999999999 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:117 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'68)", 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:45.086625+0000", 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 93.01977685, 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039355589999999999, 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.162 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086625+0000", 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086625+0000", 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086626+0000", 2024-09-21T09:12:18.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086638+0000", 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2313000000000001e-05 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086671+0000", 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2626000000000002e-05 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.086700+0000", 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9462999999999999e-05 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089210+0000", 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025098540000000002 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.089249+0000", 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8452999999999999e-05 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.090456+0000", 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012076540000000001 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:45.090560+0000", 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103699 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:154 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'108, mlcod=18'105)", 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:46.380168+0000", 2024-09-21T09:12:18.166 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.726233712999999, 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037211079999999999, 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380168+0000", 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380168+0000", 2024-09-21T09:12:18.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380169+0000", 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5300000000000002e-07 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380181+0000", 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2357e-05 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380201+0000", 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9847000000000002e-05 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380213+0000", 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2556e-05 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380491+0000", 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000277512 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.380541+0000", 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9778999999999999e-05 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383827+0000", 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032865479999999998 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383889+0000", 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1556000000000005e-05 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.170 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:156 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'110, mlcod=18'105)", 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:46.381673+0000", 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.724728404000004, 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044253549999999997, 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381673+0000", 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381673+0000", 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381674+0000", 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381690+0000", 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5339e-05 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381715+0000", 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5562999999999999e-05 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.381727+0000", 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.185e-05 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382518+0000", 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00079086399999999996 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382567+0000", 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9404000000000003e-05 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386033+0000", 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034651830000000002 2024-09-21T09:12:18.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386098+0000", 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5691999999999994e-05 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4210.0:157 1.0 e18/17 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'111, mlcod=18'105)", 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:10:46.382226+0000", 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.724175419000005, 2024-09-21T09:12:18.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039245130000000001, 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382226+0000", 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382226+0000", 2024-09-21T09:12:18.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382227+0000", 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.33e-06 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382245+0000", 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7620000000000001e-05 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382270+0000", 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.548e-05 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.382291+0000", 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0789999999999999e-05 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383190+0000", 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00089835000000000002 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.383222+0000", 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2923000000000003e-05 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386101+0000", 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028787700000000001 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:10:46.386150+0000", 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9249999999999998e-05 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:273 6.f 6:f1983ba0:::obj_delete_at_hint.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.013982+0000", 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 70.092418886999994, 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040761240000000004, 2024-09-21T09:12:18.180 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 273 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013982+0000", 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013982+0000", 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013985+0000", 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4159999999999998e-06 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.013998+0000", 2024-09-21T09:12:18.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2763e-05 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014030+0000", 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2756000000000003e-05 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014051+0000", 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0947000000000001e-05 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014204+0000", 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000152709 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.014557+0000", 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000353347 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.015067+0000", 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00050914899999999997 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:18.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.017078+0000", 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020112250000000002 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.017896+0000", 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00081820700000000005 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.017991+0000", 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4993000000000003e-05 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.018059+0000", 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7612000000000003e-05 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.383916+0000", 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.722484976000004, 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037879570000000002, 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.186 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 772 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383916+0000", 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383916+0000", 2024-09-21T09:12:18.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383919+0000", 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2139999999999999e-06 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383930+0000", 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1189000000000001e-05 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383961+0000", 2024-09-21T09:12:18.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1612999999999997e-05 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.383978+0000", 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.694e-05 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.384133+0000", 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154189 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.384535+0000", 2024-09-21T09:12:18.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040250399999999998 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.385123+0000", 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00058813099999999998 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.386381+0000", 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001258194 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.387430+0000", 2024-09-21T09:12:18.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010481550000000001 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.387587+0000", 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015717899999999999 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.387704+0000", 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000117649 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1163 3.17 3:eb0740dd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.1948345090000001, 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019360854, 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1163 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.192 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911569+0000", 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6460000000000002e-06 2024-09-21T09:12:18.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917121+0000", 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005551846 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917164+0000", 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2916e-05 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917183+0000", 2024-09-21T09:12:18.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8508999999999998e-05 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917318+0000", 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013504200000000001 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917572+0000", 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025395300000000001 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917798+0000", 2024-09-21T09:12:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022648300000000001 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.929367+0000", 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011568729999999999 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930809+0000", 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014424730000000001 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930883+0000", 2024-09-21T09:12:18.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3910000000000002e-05 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930928+0000", 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4345999999999999e-05 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.5031.0:148 4.b 4:d199411d:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.3.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:17.873624+0000", 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.23277763100000001, 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037232620000000002, 2024-09-21T09:12:18.197 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.5031", 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/3254238464", 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 148 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873624+0000", 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873624+0000", 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873625+0000", 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.277e-06 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873631+0000", 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9120000000000003e-06 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873652+0000", 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0763000000000001e-05 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873667+0000", 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5143000000000001e-05 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873844+0000", 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017766799999999999 2024-09-21T09:12:18.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.874045+0000", 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020053700000000001 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.874383+0000", 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000338377 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.876895+0000", 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025117690000000001 2024-09-21T09:12:18.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.877279+0000", 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038391599999999999 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.877310+0000", 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1284000000000001e-05 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.877347+0000", 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6616000000000003e-05 2024-09-21T09:12:18.202 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.203 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:18.203 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:18.203 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:18.204 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:18.204 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:18.204 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-09-21T09:12:18.205 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:18.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:18.207 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:18.207 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:18.208 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:18.208 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:18.199+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:18.228 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:18.228 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:18.246 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:18.246 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:18.313 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:18.311+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:18.330 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:18.330 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:18.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:18.406 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:18.403+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:18.470 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:18.470 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:18.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:18.532 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:18.529+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:18.608 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:18.603+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:18.612 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:18.612 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:18.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:18.712 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:18.709+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:18.796 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:18.796 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:18.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:18.811 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:18.807+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:18.832 INFO:tasks.workunit.client.0.smithi007.stderr:100+0 records in 2024-09-21T09:12:18.832 INFO:tasks.workunit.client.0.smithi007.stderr:100+0 records out 2024-09-21T09:12:18.833 INFO:tasks.workunit.client.0.smithi007.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.613304 s, 1.7 GB/s 2024-09-21T09:12:18.911 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:18.909+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:18.990 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:18.990 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:19.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:19.048 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:19.045+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:19.113 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:19.111+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:19.177 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:19.177 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:19.191 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:19.237 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:19.235+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:19.307 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:19.307 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:19.314 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:19.311+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:19.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:19.416 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:19.413+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:19.485 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:19.485 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:19.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:19.545 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:19.543+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:19.617 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:19.617 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:19.618 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:19.613+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:19.630 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:19.719 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:19.717+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:19.792 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:19.792 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:19.806 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:19.820 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:19.817+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:19.920 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:19.917+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:19.924 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:19.924 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:19.937 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:20.021 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:20.019+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:20.058 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:20.058 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:20.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:20.122 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:20.117+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:20.208 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T09:12:20.223 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:20.221+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:20.242 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:20.243 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:20.257 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:20.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:20.345 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:20.343+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:20.416 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:20.416 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:20.424 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:20.421+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:20.431 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:20.440 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:20.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:20.476 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:20.494 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:20.515 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:20.515 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:20.525 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:20.523+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:20.535 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:20.536 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:20.555 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:20.555 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:20.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:20.555 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:20.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4358.0:40 5.1c 5:3fce9a59:::zonegroup_info.6661b8ba-4ecc-4129-afb2-8d0efd9659c2:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 79.666728805999995, 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028118549999999998, 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4358", 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3756932968", 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 40 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885825+0000", 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885826+0000", 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4899999999999999e-06 2024-09-21T09:12:20.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885835+0000", 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5299999999999996e-06 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885857+0000", 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1679999999999999e-05 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885871+0000", 2024-09-21T09:12:20.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4146e-05 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.885969+0000", 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8212000000000001e-05 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886181+0000", 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021209000000000001 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.886450+0000", 2024-09-21T09:12:20.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026841000000000001 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.887864+0000", 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001414722 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888500+0000", 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063535399999999998 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888562+0000", 2024-09-21T09:12:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2176999999999998e-05 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:00.888637+0000", 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5043999999999995e-05 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.621346630999994, 2024-09-21T09:12:20.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036169079999999998, 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 217 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931207+0000", 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931210+0000", 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6529999999999998e-06 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931223+0000", 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3667e-05 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931257+0000", 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3742999999999999e-05 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931273+0000", 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5366000000000002e-05 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931414+0000", 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136300000000001 2024-09-21T09:12:20.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.931673+0000", 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025924500000000002 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.932066+0000", 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0003927 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.933852+0000", 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017863180000000001 2024-09-21T09:12:20.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934605+0000", 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075312800000000004 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934696+0000", 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0328999999999995e-05 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.934824+0000", 2024-09-21T09:12:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128396 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:229 6.1b e36/30 6:db9d130d:gc::gc.24:head v 36'1, mlcod=0'0)", 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.575899673999999, 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015706159999999999, 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976654+0000", 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976655+0000", 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8699999999999995e-07 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976661+0000", 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7599999999999997e-06 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976686+0000", 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4396000000000002e-05 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976699+0000", 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3336000000000001e-05 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976836+0000", 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013669299999999999 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.976871+0000", 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4913000000000003e-05 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978136+0000", 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001264851 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.978225+0000", 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9179999999999997e-05 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:237 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.548168301999993, 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001626368, 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 237 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004385+0000", 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004389+0000", 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5099999999999999e-06 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004408+0000", 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9154e-05 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004453+0000", 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4385999999999998e-05 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004475+0000", 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2853e-05 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004585+0000", 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000109546 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004656+0000", 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0988999999999994e-05 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.004818+0000", 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016166600000000001 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005536+0000", 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071806799999999998 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005917+0000", 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038119100000000002 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.005956+0000", 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9255999999999998e-05 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.006012+0000", 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5748999999999998e-05 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.285893305000002, 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023946290000000001, 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 721 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266660+0000", 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266663+0000", 2024-09-21T09:12:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5289999999999998e-06 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266676+0000", 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.292e-05 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266705+0000", 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8816999999999999e-05 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266732+0000", 2024-09-21T09:12:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7134000000000001e-05 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.266844+0000", 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111848 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267038+0000", 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019389 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.267357+0000", 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000319172 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268435+0000", 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010780430000000001 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.268984+0000", 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054955599999999998 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269022+0000", 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7973999999999999e-05 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269055+0000", 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2746000000000001e-05 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.282919011000004, 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002147342, 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 723 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269635+0000", 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269636+0000", 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4720000000000001e-06 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269645+0000", 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.32e-06 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269667+0000", 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2487999999999999e-05 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269678+0000", 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0794e-05 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269735+0000", 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269784+0000", 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8266999999999997e-05 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.269905+0000", 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000121012 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.270906+0000", 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00100125 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271576+0000", 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066977200000000001 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271666+0000", 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9952999999999997e-05 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.271782+0000", 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000116469 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:816 6.1e e36/30 6:7a480f67:::obj_delete_at_hint.0000000079:head v 36'8, mlcod=36'6)", 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.063429038999999, 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016647159999999999, 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489125+0000", 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489127+0000", 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0600000000000002e-06 2024-09-21T09:12:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489142+0000", 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5400000000000002e-05 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489177+0000", 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4894000000000002e-05 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489196+0000", 2024-09-21T09:12:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8873e-05 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489355+0000", 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015918799999999999 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.489424+0000", 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8572999999999996e-05 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490705+0000", 2024-09-21T09:12:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012817079999999999 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.490789+0000", 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4019999999999999e-05 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.836927130999996, 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028068680000000001, 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 910 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715627+0000", 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715630+0000", 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.92e-06 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715647+0000", 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7156999999999999e-05 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715680+0000", 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3572999999999999e-05 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715696+0000", 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5777000000000002e-05 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.715819+0000", 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000122972 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716044+0000", 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022481500000000001 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.716365+0000", 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032138400000000003 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.717426+0000", 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001061223 2024-09-21T09:12:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718214+0000", 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078753099999999995 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718304+0000", 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0426999999999993e-05 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.718434+0000", 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012908900000000001 2024-09-21T09:12:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.832970078000002, 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031243310000000002, 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 912 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719584+0000", 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719585+0000", 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.72e-06 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719597+0000", 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1229999999999999e-05 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719621+0000", 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4073000000000001e-05 2024-09-21T09:12:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719633+0000", 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.259e-05 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.719761+0000", 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012745599999999999 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720000+0000", 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023914800000000001 2024-09-21T09:12:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.720482+0000", 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048253400000000001 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.721627+0000", 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001145002 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722556+0000", 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092825299999999998 2024-09-21T09:12:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722640+0000", 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4542999999999993e-05 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722708+0000", 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7781999999999996e-05 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1020 6.10 e45/30 6:0fbdcb32:usage::usage.17:head v 45'5, mlcod=36'3)", 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.513276222000002, 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001677574, 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039278+0000", 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039281+0000", 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0939999999999999e-06 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039305+0000", 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3906000000000001e-05 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039349+0000", 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4064999999999999e-05 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039379+0000", 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9889000000000001e-05 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039517+0000", 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013895300000000001 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.039574+0000", 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6162000000000002e-05 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040855+0000", 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001281821 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:38.040955+0000", 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9684000000000003e-05 2024-09-21T09:12:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4691.0:132 8.2 8:417e18ea:root::buck_2024_08_21_09_12_15:head [call version.check_conds in=18b,call version.set in=10b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:16.304219+0000", 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2483346879999999, 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019402919999999999, 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4691", 2024-09-21T09:12:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3556030469", 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 132 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.304219+0000", 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.304219+0000", 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.304220+0000", 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3e-07 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.304223+0000", 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2349999999999999e-06 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.304232+0000", 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7229999999999993e-06 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.304236+0000", 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1219999999999997e-06 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.304270+0000", 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4090000000000001e-05 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.304320+0000", 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9855000000000003e-05 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.304426+0000", 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106724 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.304834+0000", 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040718900000000002 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.306103+0000", 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001269603 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.306136+0000", 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2641999999999997e-05 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.306159+0000", 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3479e-05 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4691.0:144 4.1b 4:da60585b:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.1.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:16.309325+0000", 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2432285790000002, 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028833090000000001, 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4691", 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3556030469", 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 144 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.309325+0000", 2024-09-21T09:12:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.309325+0000", 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.309326+0000", 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4099999999999998e-07 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.309340+0000", 2024-09-21T09:12:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4314000000000001e-05 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.309355+0000", 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5265e-05 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.309363+0000", 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.309437+0000", 2024-09-21T09:12:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3639000000000004e-05 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.309507+0000", 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0036000000000005e-05 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.309606+0000", 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9109000000000003e-05 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.310682+0000", 2024-09-21T09:12:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001075756 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.312108+0000", 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014261639999999999 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.312166+0000", 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7907e-05 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.312209+0000", 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2545e-05 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1142 4.13 4:c8319c18:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:16.500746+0000", 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.0518081690000001, 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002052758, 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1142 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500746+0000", 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500746+0000", 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500749+0000", 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0400000000000001e-06 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500762+0000", 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3196999999999999e-05 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500791+0000", 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8873999999999998e-05 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500804+0000", 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3337e-05 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500885+0000", 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1284000000000003e-05 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.501016+0000", 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000130684 2024-09-21T09:12:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.501173+0000", 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000156496 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.502253+0000", 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010808059999999999 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.502696+0000", 2024-09-21T09:12:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044270600000000001 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.502755+0000", 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9339999999999998e-05 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.502798+0000", 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2994000000000002e-05 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1143 4.1b 4:d9cf3e86:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:16.500837+0000", 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.0517171249999997, 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038681980000000002, 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1143 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500837+0000", 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500837+0000", 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500837+0000", 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6499999999999999e-07 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500841+0000", 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9609999999999999e-06 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500854+0000", 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2737e-05 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.500864+0000", 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6190000000000006e-06 2024-09-21T09:12:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.501569+0000", 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070574899999999998 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.501724+0000", 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015464999999999999 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.501876+0000", 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015239 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.502448+0000", 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057199200000000001 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.504648+0000", 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021998180000000001 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.504681+0000", 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2907000000000002e-05 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.504705+0000", 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3810000000000001e-05 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1164 3.30 e58/24 3:0f3a885b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_2:head v 58'1, mlcod=0'0)", 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:16.916998+0000", 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.6355561930000002, 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051820909999999998, 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.916998+0000", 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.916998+0000", 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.916999+0000", 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.404e-06 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.918091+0000", 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00109208 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.918115+0000", 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4385000000000001e-05 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.918125+0000", 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4420000000000004e-06 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.918194+0000", 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9252999999999996e-05 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.918211+0000", 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6402999999999999e-05 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.922134+0000", 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039233219999999999 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.922180+0000", 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5802e-05 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4757.0:140 4.13 4:c8319c18:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:17.136355+0000", 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.416199121, 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021440209999999999, 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4757", 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/2200609583", 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 140 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136355+0000", 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136355+0000", 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136355+0000", 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4e-07 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136360+0000", 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4739999999999999e-06 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136377+0000", 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7303e-05 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136386+0000", 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2309999999999996e-06 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136444+0000", 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8631000000000002e-05 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136514+0000", 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0230999999999999e-05 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136611+0000", 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6854000000000005e-05 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.137792+0000", 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011806399999999999 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.138413+0000", 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000621453 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.138474+0000", 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0470000000000002e-05 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.138499+0000", 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4893999999999999e-05 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4757.0:141 4.1b 4:d9cf3e86:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:17.136404+0000", 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.4161501200000002, 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002551644, 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4757", 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/2200609583", 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 141 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136404+0000", 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136404+0000", 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136404+0000", 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.58e-07 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136407+0000", 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8480000000000001e-06 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136417+0000", 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0052e-05 2024-09-21T09:12:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136425+0000", 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.729e-06 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136493+0000", 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7972999999999994e-05 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136534+0000", 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0930999999999998e-05 2024-09-21T09:12:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.136592+0000", 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8628999999999997e-05 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.137523+0000", 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093095799999999996 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.138900+0000", 2024-09-21T09:12:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013768610000000001 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.138932+0000", 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2181000000000002e-05 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.138955+0000", 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3023999999999998e-05 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1186 4.a 4:53ae049d:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.3.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:17.313539+0000", 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.2390147819999999, 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001649097, 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1186 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.313539+0000", 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.313539+0000", 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.313541+0000", 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8759999999999999e-06 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.313549+0000", 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8220000000000007e-06 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.313582+0000", 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2858999999999998e-05 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.313593+0000", 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1044e-05 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.313658+0000", 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5837e-05 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.313797+0000", 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013880399999999999 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.313959+0000", 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016195200000000001 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.314753+0000", 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079427199999999995 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.315096+0000", 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034241300000000002 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.315144+0000", 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7905000000000003e-05 2024-09-21T09:12:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:17.315188+0000", 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4313000000000001e-05 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1219 4.e 4:7321d742:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:18.047015+0000", 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5055385980000002, 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002026557, 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1219 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047015+0000", 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047015+0000", 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047016+0000", 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.057e-06 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047022+0000", 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7980000000000002e-06 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047039+0000", 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7136e-05 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047047+0000", 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7400000000000004e-06 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047141+0000", 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3695000000000003e-05 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047324+0000", 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018289200000000001 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047530+0000", 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020604099999999999 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.048821+0000", 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001291653 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.048936+0000", 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114419 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.049000+0000", 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3886999999999993e-05 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.049042+0000", 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2239e-05 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1223 4.3e 4:7fa1d805:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:18.047100+0000", 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5054542560000002, 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024752490000000001, 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1223 2024-09-21T09:12:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047100+0000", 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047100+0000", 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047100+0000", 2024-09-21T09:12:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2399999999999997e-07 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047106+0000", 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8780000000000003e-06 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047128+0000", 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2048e-05 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047139+0000", 2024-09-21T09:12:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288999999999999e-05 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047194+0000", 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5108999999999997e-05 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047308+0000", 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114419 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.047448+0000", 2024-09-21T09:12:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000139901 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.048582+0000", 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011339259999999999 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.049452+0000", 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000870454 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.049532+0000", 2024-09-21T09:12:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9266999999999998e-05 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:18.049575+0000", 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3133999999999997e-05 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:20.662 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:20.663 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:20.663 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:20.664 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:20.664 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:20.665 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:20.665 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:20.661+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:20.764 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:20.759+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:20.823 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:20.823 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:20.823 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:20.823 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:20.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:20.877 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:20.875+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:20.966 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:20.961+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:21.001 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:21.001 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:21.001 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:21.001 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:21.001 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:21.023 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:21.067 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:21.061+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-09-21T09:12:21.168 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:21.165+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:21.181 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 91.406724467999993, 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073206360000000002, 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 5 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772821+0000", 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772825+0000", 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7129999999999999e-06 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772843+0000", 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8033000000000002e-05 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772882+0000", 2024-09-21T09:12:21.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9434000000000002e-05 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.772902+0000", 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0075999999999999e-05 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773008+0000", 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105351 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.773016+0000", 2024-09-21T09:12:21.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1419999999999993e-06 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776094+0000", 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030782549999999998 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776289+0000", 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019460899999999999 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:21.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.776487+0000", 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000198142 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.778052+0000", 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001565812 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.779852+0000", 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001799171 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780015+0000", 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000162862 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:49.780142+0000", 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012703599999999999 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4214.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-21T09:12:21.188 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 90.404102623, 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01128114, 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4214", 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1342532872", 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:21.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775443+0000", 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775446+0000", 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775478+0000", 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775525+0000", 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7734000000000001e-05 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775559+0000", 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4133e-05 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775753+0000", 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000193248 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.775773+0000", 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0086999999999999e-05 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783330+0000", 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075572979999999996 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783469+0000", 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138839 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.783767+0000", 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029823499999999999 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.785719+0000", 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00195207 2024-09-21T09:12:21.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786427+0000", 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070740099999999997 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786600+0000", 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017295900000000001 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:10:50.786724+0000", 2024-09-21T09:12:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012436599999999999 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 78.338467300000005, 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011832176, 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:12:21.195 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 43 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841078+0000", 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841082+0000", 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9870000000000001e-06 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841121+0000", 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8593000000000001e-05 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841153+0000", 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2716000000000003e-05 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841179+0000", 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5190000000000001e-05 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841332+0000", 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000153509 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.841368+0000", 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6183000000000002e-05 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845655+0000", 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00428642 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.845676+0000", 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1687000000000001e-05 2024-09-21T09:12:21.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852576+0000", 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0068992860000000001 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:02.852910+0000", 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033460500000000003 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.200 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 73.266485046, 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0099467879999999998, 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 214 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913060+0000", 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913064+0000", 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9439999999999998e-06 2024-09-21T09:12:21.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913079+0000", 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4966e-05 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913119+0000", 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9297e-05 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913147+0000", 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8776e-05 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913293+0000", 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014535899999999999 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.913303+0000", 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0243e-05 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920048+0000", 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067448569999999999 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920345+0000", 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000297454 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.920742+0000", 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039676499999999999 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922048+0000", 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00130641 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922865+0000", 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081690500000000004 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.922947+0000", 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1751999999999999e-05 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.923007+0000", 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0059999999999998e-05 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 73.236616507999997, 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033742799999999999, 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.207 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.208 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.208 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.208 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.208 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 220 2024-09-21T09:12:21.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.208 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942929+0000", 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942931+0000", 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4030000000000001e-06 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942943+0000", 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942976+0000", 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3120000000000001e-05 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.942991+0000", 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5376999999999999e-05 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943103+0000", 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011184900000000001 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943318+0000", 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021467900000000001 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.943715+0000", 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039689700000000001 2024-09-21T09:12:21.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.945217+0000", 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001501973 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946150+0000", 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093294700000000005 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946234+0000", 2024-09-21T09:12:21.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4425000000000006e-05 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.946303+0000", 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9016999999999993e-05 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 73.217918354000005, 2024-09-21T09:12:21.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031516420000000001, 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 225 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961627+0000", 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961629+0000", 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1730000000000002e-06 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961640+0000", 2024-09-21T09:12:21.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0927000000000001e-05 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961671+0000", 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1032999999999999e-05 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961686+0000", 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5304000000000001e-05 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.961813+0000", 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012683900000000001 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962030+0000", 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021637499999999999 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.962446+0000", 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041634700000000002 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.963645+0000", 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011985279999999999 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964623+0000", 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000978673 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964713+0000", 2024-09-21T09:12:21.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9660000000000006e-05 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.964779+0000", 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5783000000000004e-05 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:228 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 73.207607183999997, 2024-09-21T09:12:21.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032433039999999998, 2024-09-21T09:12:21.220 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.220 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.220 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.220 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.220 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.220 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 228 2024-09-21T09:12:21.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.220 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971938+0000", 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971940+0000", 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1100000000000001e-06 2024-09-21T09:12:21.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971951+0000", 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0556e-05 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971982+0000", 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1442999999999997e-05 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.971998+0000", 2024-09-21T09:12:21.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5673000000000001e-05 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972130+0000", 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000132213 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972337+0000", 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020659899999999999 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:21.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.972731+0000", 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039369699999999998 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.974129+0000", 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013981029999999999 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975031+0000", 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090264399999999997 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975116+0000", 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4616000000000004e-05 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.975182+0000", 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5649999999999997e-05 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.225 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 73.193471994999996, 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030216219999999998, 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 232 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986073+0000", 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986076+0000", 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3130000000000001e-06 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986087+0000", 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1387e-05 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986118+0000", 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1306000000000001e-05 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986134+0000", 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.524e-05 2024-09-21T09:12:21.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986241+0000", 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010744899999999999 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986461+0000", 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021971600000000001 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:21.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.986879+0000", 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041845000000000001 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988536+0000", 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001657045 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.988933+0000", 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695699999999997 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989021+0000", 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7947000000000003e-05 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.989095+0000", 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3812000000000004e-05 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.231 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:21.232 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 73.186547462999997, 2024-09-21T09:12:21.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032333710000000001, 2024-09-21T09:12:21.232 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.232 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.233 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.233 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.233 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.233 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.233 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 234 2024-09-21T09:12:21.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.992998+0000", 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993000+0000", 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0559999999999999e-06 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993011+0000", 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0647e-05 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993040+0000", 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9456999999999999e-05 2024-09-21T09:12:21.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993055+0000", 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.485e-05 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993166+0000", 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000110942 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993409+0000", 2024-09-21T09:12:21.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242871 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.993829+0000", 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000420154 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.995035+0000", 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001206295 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996079+0000", 2024-09-21T09:12:21.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00104407 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996167+0000", 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7440000000000003e-05 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:07.996231+0000", 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4589000000000001e-05 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.238 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.789018686000006, 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029466929999999998, 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 775 2024-09-21T09:12:21.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390527+0000", 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390530+0000", 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9270000000000001e-06 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390542+0000", 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2016e-05 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390574+0000", 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2199999999999997e-05 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390589+0000", 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5339999999999999e-05 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390719+0000", 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012939599999999999 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.390928+0000", 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000209898 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.391244+0000", 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031530799999999998 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.392535+0000", 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001291008 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393288+0000", 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075327100000000002 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393404+0000", 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011562599999999999 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.393473+0000", 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9703000000000007e-05 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.244 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:784 6.8 6:1111b601:::obj_delete_at_hint.0000000069:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.766331340999997, 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003135367, 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 784 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413214+0000", 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413216+0000", 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.784e-06 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413225+0000", 2024-09-21T09:12:21.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8580000000000006e-06 2024-09-21T09:12:21.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413249+0000", 2024-09-21T09:12:21.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4212000000000001e-05 2024-09-21T09:12:21.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413260+0000", 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1514e-05 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413401+0000", 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014083699999999999 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413625+0000", 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022383099999999999 2024-09-21T09:12:21.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.413942+0000", 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317375 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.415132+0000", 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001189072 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416200+0000", 2024-09-21T09:12:21.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010679979999999999 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416282+0000", 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2713999999999994e-05 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.416349+0000", 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7172e-05 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.694988245999994, 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029415460000000002, 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 814 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484557+0000", 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484559+0000", 2024-09-21T09:12:21.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484570+0000", 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.098e-05 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484601+0000", 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1062999999999997e-05 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484616+0000", 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4735999999999999e-05 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484747+0000", 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000130729 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.484965+0000", 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217982 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.485271+0000", 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000306488 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.486347+0000", 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010752030000000001 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487293+0000", 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094605299999999998 2024-09-21T09:12:21.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487379+0000", 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6558999999999996e-05 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.487499+0000", 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011955000000000001 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.645192992999995, 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003172818, 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 835 2024-09-21T09:12:21.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534352+0000", 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534355+0000", 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2840000000000001e-06 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534366+0000", 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1396000000000001e-05 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534398+0000", 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1823999999999999e-05 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534413+0000", 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4919999999999999e-05 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534528+0000", 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000115209 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.534749+0000", 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022136500000000001 2024-09-21T09:12:21.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.535063+0000", 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031351399999999998 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.536086+0000", 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010234899999999999 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537283+0000", 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011962819999999999 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537407+0000", 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123819 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.537525+0000", 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118715 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.262 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.624188501000006, 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030129000000000002, 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.263 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 844 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555357+0000", 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555359+0000", 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9800000000000001e-06 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555369+0000", 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0207000000000001e-05 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555398+0000", 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8822999999999998e-05 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555412+0000", 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4443e-05 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555537+0000", 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012447900000000001 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.555756+0000", 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021879899999999999 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.556069+0000", 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031338399999999999 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.557174+0000", 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011049860000000001 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558209+0000", 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034653 2024-09-21T09:12:21.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558297+0000", 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8446e-05 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.558370+0000", 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2700000000000005e-05 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.456647394000001, 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031274219999999999, 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 913 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722898+0000", 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722901+0000", 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5569999999999998e-06 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722912+0000", 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1693e-05 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722944+0000", 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.222e-05 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.722959+0000", 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4902999999999999e-05 2024-09-21T09:12:21.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723110+0000", 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015031500000000001 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723344+0000", 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000234799 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:21.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.723667+0000", 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032255100000000002 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.724725+0000", 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010575859999999999 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725873+0000", 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001148579 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.725961+0000", 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8063e-05 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.726025+0000", 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4156e-05 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.274 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.452539541999997, 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029665730000000001, 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 915 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:21.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727006+0000", 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727008+0000", 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7129999999999999e-06 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727016+0000", 2024-09-21T09:12:21.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6600000000000001e-06 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727041+0000", 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5253e-05 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727055+0000", 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3403e-05 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727227+0000", 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017192600000000001 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727363+0000", 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013665199999999999 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.727627+0000", 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000263565 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.728717+0000", 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001090029 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729815+0000", 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010975099999999999 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729908+0000", 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3029000000000007e-05 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.729972+0000", 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4832999999999994e-05 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.421203004999995, 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0035043000000000001, 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.280 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 928 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758342+0000", 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758345+0000", 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4339999999999999e-06 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758356+0000", 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1423000000000001e-05 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758389+0000", 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2336999999999999e-05 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758408+0000", 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9706000000000001e-05 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758579+0000", 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017064599999999999 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.758939+0000", 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036013000000000001 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.759516+0000", 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057737999999999995 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.760877+0000", 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013600769999999999 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761559+0000", 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068295900000000002 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761727+0000", 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016766900000000001 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:08.761847+0000", 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119539 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4216.0:2 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.181119778000003, 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049270260000000001, 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4216", 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.50:0/896302906", 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.286 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998426+0000", 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998428+0000", 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.26e-06 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998453+0000", 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5449e-05 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998478+0000", 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4769e-05 2024-09-21T09:12:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998502+0000", 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3448999999999999e-05 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998630+0000", 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012872299999999999 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:32.998640+0000", 2024-09-21T09:12:21.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9329999999999996e-06 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003282+0000", 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004641816 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:11:33.003353+0000", 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0627e-05 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1164 3.30 3:0f3a885b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:16.915597+0000", 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2639483770000002, 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070263560000000001, 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1164 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.291 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.915597+0000", 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.915597+0000", 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.915599+0000", 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.905e-06 2024-09-21T09:12:21.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.916583+0000", 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098445299999999993 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.916604+0000", 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0645e-05 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.916617+0000", 2024-09-21T09:12:21.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3042e-05 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.916686+0000", 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8782000000000007e-05 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.916800+0000", 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000114621 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.916897+0000", 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6099000000000003e-05 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.920291+0000", 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033947439999999999 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.922527+0000", 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022358999999999999 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.922567+0000", 2024-09-21T09:12:21.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9842999999999998e-05 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.922623+0000", 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6322e-05 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1163 3.17 e58/24 3:eb0740dd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_1:head v 58'1, mlcod=0'0)", 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:16.917586+0000", 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2619591569999997, 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091424739999999994, 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:21.296 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.917586+0000", 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.917586+0000", 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.917587+0000", 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6200000000000006e-07 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.922392+0000", 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004804689 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.922405+0000", 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3203e-05 2024-09-21T09:12:21.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.922413+0000", 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8790000000000003e-06 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.922464+0000", 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1013000000000001e-05 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:21.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.922481+0000", 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.658e-05 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.926692+0000", 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004211785 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:16.926729+0000", 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6362999999999997e-05 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:21.301 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:21.301 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:21.302 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:21.303 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:21.297+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:21.403 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:21.399+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:21.451 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:21.451 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:21.451 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:21.451 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:21.466 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:21.504 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:21.499+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:21.605 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:21.601+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:21.610 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:21.610 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:21.610 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:21.610 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:21.610 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:21.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:21.706 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:21.703+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:21.807 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:21.801+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:21.810 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:21.810 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 78.949028502000004, 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083044959999999998, 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.811 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 44 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857522+0000", 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857525+0000", 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2059999999999999e-06 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857541+0000", 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5826999999999999e-05 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857608+0000", 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7353000000000004e-05 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857632+0000", 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3595999999999999e-05 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857842+0000", 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021056800000000001 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.857863+0000", 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0917e-05 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865509+0000", 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076459040000000002 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:02.865826+0000", 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031712500000000002 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.815 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 73.935023220999994, 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0108574, 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 206 2024-09-21T09:12:21.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871527+0000", 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871530+0000", 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871545+0000", 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4620000000000001e-05 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871584+0000", 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9582999999999997e-05 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871602+0000", 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8057e-05 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871776+0000", 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017372500000000001 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.871792+0000", 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5973000000000001e-05 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878149+0000", 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063566910000000003 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.878502+0000", 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035284800000000001 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.879223+0000", 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072110100000000003 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.881741+0000", 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025179310000000002 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882232+0000", 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00049132199999999998 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882325+0000", 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2816e-05 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882384+0000", 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9509999999999998e-05 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 73.923791043999998, 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032285479999999999, 2024-09-21T09:12:21.822 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 207 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882759+0000", 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882761+0000", 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0729999999999999e-06 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882771+0000", 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0287e-05 2024-09-21T09:12:21.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882796+0000", 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4873000000000001e-05 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882811+0000", 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4752999999999999e-05 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.882904+0000", 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2869999999999997e-05 2024-09-21T09:12:21.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883081+0000", 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017743500000000001 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.883433+0000", 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035207000000000001 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.884576+0000", 2024-09-21T09:12:21.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001142405 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885843+0000", 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012676230000000001 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885921+0000", 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7338999999999999e-05 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.885988+0000", 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6820000000000001e-05 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 73.907387627999995, 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033258939999999998, 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.828 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 210 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899163+0000", 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899165+0000", 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3199999999999998e-06 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899176+0000", 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1154e-05 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899209+0000", 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2580000000000003e-05 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899224+0000", 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4976e-05 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899345+0000", 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121296 2024-09-21T09:12:21.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899542+0000", 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019720499999999999 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.899947+0000", 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040540299999999998 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.901475+0000", 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015280319999999999 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902217+0000", 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074172400000000003 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902369+0000", 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015137899999999999 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.902488+0000", 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119825 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 73.854491546000006, 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037626880000000001, 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 222 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952059+0000", 2024-09-21T09:12:21.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952061+0000", 2024-09-21T09:12:21.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4700000000000001e-06 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952073+0000", 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.155e-05 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952103+0000", 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0716999999999997e-05 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952119+0000", 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5613000000000001e-05 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952271+0000", 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015167499999999999 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.952654+0000", 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038366399999999998 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.953387+0000", 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073280800000000005 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955064+0000", 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016773000000000001 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955552+0000", 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048774000000000002 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955707+0000", 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154878 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:07.955821+0000", 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114273 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.840 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 73.800065586000002, 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032388619999999999, 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 238 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006485+0000", 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006487+0000", 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006497+0000", 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0457e-05 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006526+0000", 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8975999999999998e-05 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006547+0000", 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0613000000000001e-05 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006669+0000", 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121896 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.006881+0000", 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021207499999999999 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:21.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.007199+0000", 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031782099999999998 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.008434+0000", 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012349609999999999 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009576+0000", 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001141998 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009661+0000", 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5982000000000004e-05 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.009723+0000", 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1940000000000007e-05 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.846 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:378 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 73.761522040000003, 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036030390000000002, 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 378 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045028+0000", 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045031+0000", 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9859999999999999e-06 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045069+0000", 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7876999999999997e-05 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045123+0000", 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4202e-05 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045148+0000", 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4924000000000001e-05 2024-09-21T09:12:21.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045310+0000", 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016157899999999999 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045542+0000", 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023267399999999999 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.045859+0000", 2024-09-21T09:12:21.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000316872 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.047142+0000", 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001283216 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048468+0000", 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001325534 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048562+0000", 2024-09-21T09:12:21.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4015e-05 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.048631+0000", 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9159999999999995e-05 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:398 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:21.852 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 73.755066209999995, 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037105979999999998, 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 398 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:21.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051484+0000", 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051486+0000", 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0030000000000001e-06 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051497+0000", 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0957e-05 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051519+0000", 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2263e-05 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.051531+0000", 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2306999999999999e-05 2024-09-21T09:12:21.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052064+0000", 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00053253199999999995 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052392+0000", 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000327628 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:21.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.052743+0000", 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035127699999999999 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053814+0000", 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010707049999999999 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055011+0000", 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001197814 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055126+0000", 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114262 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.055195+0000", 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8850000000000007e-05 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:405 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 73.752741228000005, 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033493780000000001, 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 405 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.859 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053809+0000", 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053811+0000", 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7999999999999999e-06 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053823+0000", 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1800000000000001e-05 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053857+0000", 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.464e-05 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.053875+0000", 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7479999999999999e-05 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054016+0000", 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014128200000000001 2024-09-21T09:12:21.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054142+0000", 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012590600000000001 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.054426+0000", 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028461399999999998 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.056935+0000", 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025088799999999998 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057011+0000", 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6097e-05 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057091+0000", 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9098999999999996e-05 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:08.057158+0000", 2024-09-21T09:12:21.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7780000000000005e-05 2024-09-21T09:12:21.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.865 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.865 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T09:12:21.865 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.767013175999999, 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032957440000000002, 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1020 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039537+0000", 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039540+0000", 2024-09-21T09:12:21.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1499999999999999e-06 2024-09-21T09:12:21.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039558+0000", 2024-09-21T09:12:21.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7549000000000001e-05 2024-09-21T09:12:21.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039596+0000", 2024-09-21T09:12:21.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8583e-05 2024-09-21T09:12:21.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039615+0000", 2024-09-21T09:12:21.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8805e-05 2024-09-21T09:12:21.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.039759+0000", 2024-09-21T09:12:21.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143702 2024-09-21T09:12:21.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040000+0000", 2024-09-21T09:12:21.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024096600000000001 2024-09-21T09:12:21.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.040380+0000", 2024-09-21T09:12:21.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038004199999999998 2024-09-21T09:12:21.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.041780+0000", 2024-09-21T09:12:21.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400625 2024-09-21T09:12:21.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042670+0000", 2024-09-21T09:12:21.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088968599999999999 2024-09-21T09:12:21.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042760+0000", 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9602e-05 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:11:38.042833+0000", 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3034000000000006e-05 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.873 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1182 4.29 4:958da29d:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.3.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:17.313953+0000", 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.492597301, 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032343979999999999, 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1182 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313953+0000", 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313953+0000", 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313955+0000", 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0609999999999998e-06 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313963+0000", 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4149999999999999e-06 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313984+0000", 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0299e-05 2024-09-21T09:12:21.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.313992+0000", 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0390000000000005e-06 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.314093+0000", 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101739 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.314298+0000", 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000204153 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.314491+0000", 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000193162 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.315912+0000", 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014216249999999999 2024-09-21T09:12:21.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.317088+0000", 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001175408 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.317141+0000", 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3637999999999997e-05 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.317187+0000", 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5859000000000003e-05 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.5031.0:138 4.29 4:958da29d:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.3.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:17.873418+0000", 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.9331318079999997, 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033688730000000001, 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.880 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.5031", 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/3254238464", 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 138 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873418+0000", 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873418+0000", 2024-09-21T09:12:21.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873420+0000", 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.691e-06 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873428+0000", 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3999999999999992e-06 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873450+0000", 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1563999999999999e-05 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873461+0000", 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1347e-05 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873549+0000", 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7751999999999996e-05 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873619+0000", 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0178000000000005e-05 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873715+0000", 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5631000000000006e-05 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.876624+0000", 2024-09-21T09:12:21.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002909422 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.876703+0000", 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8250000000000005e-05 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.876757+0000", 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4419999999999997e-05 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.876787+0000", 2024-09-21T09:12:21.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0218000000000001e-05 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.5031.0:140 4.3b 4:dd85f7a5:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.3.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:17.873489+0000", 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.9330612870000001, 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033865990000000001, 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.886 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.5031", 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/3254238464", 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 140 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873489+0000", 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873489+0000", 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873490+0000", 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873494+0000", 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3019999999999996e-06 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873513+0000", 2024-09-21T09:12:21.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9329000000000001e-05 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873523+0000", 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3009999999999995e-06 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873651+0000", 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012812899999999999 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873746+0000", 2024-09-21T09:12:21.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4986000000000002e-05 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873877+0000", 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013090000000000001 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.875280+0000", 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014036630000000001 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.876637+0000", 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013570120000000001 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.876766+0000", 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000128546 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.876875+0000", 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0001097 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.5031.0:143 4.3b 4:dda77d1c:::.dir.2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.3.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:17.873546+0000", 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.9330044200000001, 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035449000000000001, 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.5031", 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/3254238464", 2024-09-21T09:12:21.892 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 143 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873546+0000", 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873546+0000", 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873546+0000", 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3e-07 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873550+0000", 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9840000000000003e-06 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873561+0000", 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0361e-05 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.873568+0000", 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1239999999999999e-06 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.874595+0000", 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001026789 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.874693+0000", 2024-09-21T09:12:21.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8403e-05 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.874814+0000", 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120835 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.875973+0000", 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011593619999999999 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.876887+0000", 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00091401099999999995 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.876999+0000", 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111263 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:17.877091+0000", 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2038000000000002e-05 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.897 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1265 3.3a e60/24 3:5cfa63b7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_22:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.57626192700000001, 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025518386000000001, 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230289+0000", 2024-09-21T09:12:21.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1399999999999996e-07 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239530+0000", 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092409199999999997 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239574+0000", 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4301999999999997e-05 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239594+0000", 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9559999999999999e-05 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239779+0000", 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018548800000000001 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239846+0000", 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6897999999999995e-05 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255678+0000", 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015831548000000001 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255807+0000", 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000128856 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1267 3.9 e60/24 3:931159eb:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_24:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.56040723299999995, 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014928096, 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246144+0000", 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0669999999999999e-06 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252177+0000", 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060330760000000001 2024-09-21T09:12:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252211+0000", 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3822000000000002e-05 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252228+0000", 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7125999999999998e-05 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252379+0000", 2024-09-21T09:12:21.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015065 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252417+0000", 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8665000000000003e-05 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.260976+0000", 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085584029999999992 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261071+0000", 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5286999999999998e-05 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1286 3.3c e60/24 3:3c018bdd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_43:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.458778+0000", 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.34777258700000002, 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01189574, 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.907 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.458778+0000", 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.458778+0000", 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.458780+0000", 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5969999999999999e-06 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.463354+0000", 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004573723 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.463400+0000", 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6255999999999999e-05 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.463418+0000", 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8219e-05 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.463539+0000", 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012092299999999999 2024-09-21T09:12:21.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.463582+0000", 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2979000000000003e-05 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.470587+0000", 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070045790000000004 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.470673+0000", 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6464000000000004e-05 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1291 3.2 3:4203678b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.27372177600000003, 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015334344999999999, 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.912 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1291 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532834+0000", 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8329999999999999e-06 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537680+0000", 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048457689999999998 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537707+0000", 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7364000000000001e-05 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537721+0000", 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3935e-05 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537860+0000", 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000138646 2024-09-21T09:12:21.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.538194+0000", 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033445799999999999 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.538521+0000", 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032673799999999997 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.546553+0000", 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080323600000000005 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.547994+0000", 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00144082 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.548087+0000", 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2627000000000006e-05 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.548163+0000", 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5795000000000002e-05 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1303 3.2b 3:d7a32023:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.100192116, 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017871702999999999, 2024-09-21T09:12:21.918 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1303 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706362+0000", 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1659999999999996e-06 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712782+0000", 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006419803 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712817+0000", 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5466000000000002e-05 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712838+0000", 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0919000000000001e-05 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712933+0000", 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4452999999999998e-05 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713042+0000", 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109304 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713159+0000", 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011710299999999999 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.719777+0000", 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006617497 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724152+0000", 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043755240000000004 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724191+0000", 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8337999999999998e-05 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724230+0000", 2024-09-21T09:12:21.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.913e-05 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1304 3.2 3:40da9a43:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.080998305000000007, 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018044510999999999, 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:21.924 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1304 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:21.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725555+0000", 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.977e-06 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730352+0000", 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047973670000000003 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:21.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730394+0000", 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2199e-05 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730412+0000", 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7679000000000001e-05 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730524+0000", 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011182400000000001 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730728+0000", 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000204448 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730907+0000", 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000178753 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.736861+0000", 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059537629999999999 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743469+0000", 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066083970000000002 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743539+0000", 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9387000000000005e-05 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743596+0000", 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7717000000000003e-05 2024-09-21T09:12:21.929 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.930 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:21.930 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:21.930 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:21.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:21.932 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:21.927+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:22.032 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:22.027+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:22.116 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:22.116 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:22.116 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:22.116 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:22.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:22.133 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:22.129+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:22.233 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:22.229+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:22.318 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:22.318 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:22.319 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:22.319 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:22.319 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:22.334 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:22.335 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:22.331+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:22.435 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:22.431+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:22.509 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:22.509 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:22.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:22.509 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:22.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.509 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1163 3.17 3:eb0740dd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:22.509 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:22.509 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.5956822380000002, 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019360854, 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1163 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911569+0000", 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6460000000000002e-06 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917121+0000", 2024-09-21T09:12:22.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005551846 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917164+0000", 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2916e-05 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917183+0000", 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8508999999999998e-05 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917318+0000", 2024-09-21T09:12:22.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013504200000000001 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917572+0000", 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025395300000000001 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917798+0000", 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022648300000000001 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.929367+0000", 2024-09-21T09:12:22.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011568729999999999 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930809+0000", 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014424730000000001 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930883+0000", 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3910000000000002e-05 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930928+0000", 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4345999999999999e-05 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1235 3.18 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.525488521, 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028152907000000001, 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.515 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1235 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:22.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981763+0000", 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7700000000000002e-06 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988006+0000", 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062426979999999997 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988042+0000", 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6461999999999998e-05 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988067+0000", 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4372999999999999e-05 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988210+0000", 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014307299999999999 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988480+0000", 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026992500000000002 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988718+0000", 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023859400000000001 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.002159+0000", 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01344091 2024-09-21T09:12:22.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009749+0000", 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075900769999999998 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009840+0000", 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0736999999999995e-05 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009913+0000", 2024-09-21T09:12:22.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3287999999999994e-05 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1246 3.31 3:8d902261:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.506559078, 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022053738, 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1246 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000694+0000", 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2599999999999999e-06 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004867+0000", 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041723300000000001 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004920+0000", 2024-09-21T09:12:22.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2985000000000002e-05 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004948+0000", 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8362999999999999e-05 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005091+0000", 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000142903 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005381+0000", 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029025500000000001 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005674+0000", 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000292878 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.017583+0000", 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011908981000000001 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022585+0000", 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050024179999999998 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022674+0000", 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8486999999999995e-05 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022744+0000", 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9877999999999997e-05 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.526 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1250 3.0 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.4507522179999999, 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026211538999999999, 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.527 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1250 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056500+0000", 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.18e-06 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061414+0000", 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049142930000000001 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061455+0000", 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0689000000000003e-05 2024-09-21T09:12:22.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061475+0000", 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9760000000000001e-05 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061649+0000", 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000174308 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062062+0000", 2024-09-21T09:12:22.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041290199999999998 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062448+0000", 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038618600000000001 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.075288+0000", 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012839623999999999 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082540+0000", 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072523489999999999 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082633+0000", 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3200000000000002e-05 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082708+0000", 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5048000000000004e-05 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.532 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1253 3.38 3:1e71958a:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.089330+0000", 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.417919522, 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017066640000000001, 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1253 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.089330+0000", 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.089330+0000", 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.089332+0000", 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8430000000000001e-06 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.093454+0000", 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041216860000000003 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.093491+0000", 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6863000000000003e-05 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.093507+0000", 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5899000000000001e-05 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.093671+0000", 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016388199999999999 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.094073+0000", 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000401999 2024-09-21T09:12:22.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.094455+0000", 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000381896 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.103666+0000", 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092115440000000003 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.106096+0000", 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024302730000000002 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.106251+0000", 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015418300000000001 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.106396+0000", 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014557200000000001 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.538 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1255 3.23 3:c447b817:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.111421+0000", 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.3958283840000001, 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017195503000000001, 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1255 2024-09-21T09:12:22.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.111421+0000", 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.111421+0000", 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.111423+0000", 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6230000000000001e-06 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.115036+0000", 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036129999999999999 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.115073+0000", 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6431999999999999e-05 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.115093+0000", 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979999999999998e-05 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.115239+0000", 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145785 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.115488+0000", 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024910999999999998 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.115728+0000", 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240144 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.122915+0000", 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071875469999999999 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.128446+0000", 2024-09-21T09:12:22.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055303230000000002 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.128541+0000", 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5736999999999995e-05 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.128616+0000", 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4821999999999996e-05 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1258 3.17 3:e9fd25dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.3610244790000001, 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025293568999999998, 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1258 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.545 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146228+0000", 2024-09-21T09:12:22.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8130000000000002e-06 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151893+0000", 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056641929999999997 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151937+0000", 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4768999999999998e-05 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151978+0000", 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0844999999999999e-05 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152239+0000", 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026088000000000001 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152546+0000", 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000306905 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152815+0000", 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268912 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.165057+0000", 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012242368 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171206+0000", 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006148349 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171389+0000", 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018327799999999999 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171518+0000", 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129257 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.550 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1260 3.17 3:eb13e7c3:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.3360980200000001, 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021083792000000001, 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1260 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171154+0000", 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9040000000000001e-06 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176055+0000", 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049010299999999998 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176092+0000", 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6662000000000002e-05 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176109+0000", 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7042999999999999e-05 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176228+0000", 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119747 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176521+0000", 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029217499999999999 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176753+0000", 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023253299999999999 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.187711+0000", 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010958324 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192068+0000", 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043564989999999998 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192163+0000", 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.48e-05 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192235+0000", 2024-09-21T09:12:22.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2075000000000004e-05 2024-09-21T09:12:22.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.556 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.556 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1264 3.27 3:e753e52b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.556 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.214324+0000", 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.2929249629999999, 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017445499, 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1264 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.214324+0000", 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.214324+0000", 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.214327+0000", 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.773e-06 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.218203+0000", 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038756989999999998 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.218239+0000", 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6378999999999998e-05 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.218255+0000", 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6053e-05 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.218382+0000", 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126737 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.218630+0000", 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000248006 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.218855+0000", 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225014 2024-09-21T09:12:22.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.227136+0000", 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0082816539999999994 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.231602+0000", 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004465999 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.231692+0000", 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9556999999999997e-05 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.231770+0000", 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7627999999999996e-05 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1266 3.38 3:1db25443:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.562 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.272479787, 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018278652999999999, 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1266 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234772+0000", 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5730000000000002e-06 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240589+0000", 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058167760000000001 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240661+0000", 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2358000000000001e-05 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240687+0000", 2024-09-21T09:12:22.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5522000000000001e-05 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240897+0000", 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021069799999999999 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.241146+0000", 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024912600000000001 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.241373+0000", 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022685399999999999 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.248615+0000", 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072417089999999998 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252728+0000", 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041126729999999998 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252915+0000", 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018731100000000001 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.253048+0000", 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000133053 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1272 3.29 3:963d269b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.568 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.2097207000000001, 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019343672999999999, 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1272 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297532+0000", 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-06 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300259+0000", 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027266579999999999 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300306+0000", 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6748e-05 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300325+0000", 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9752999999999999e-05 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300489+0000", 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016374200000000001 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300746+0000", 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025647300000000001 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300967+0000", 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022157700000000001 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.309603+0000", 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086360010000000008 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316784+0000", 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071809450000000002 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316833+0000", 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8949999999999997e-05 2024-09-21T09:12:22.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316872+0000", 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1274 3.27 3:e4ee4224:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.316982+0000", 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.190267588, 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016557349999999998, 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1274 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316982+0000", 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316982+0000", 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316983+0000", 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8199999999999999e-06 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.321197+0000", 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042138389999999996 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.321226+0000", 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8546000000000001e-05 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.321239+0000", 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2889e-05 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.321325+0000", 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6323999999999995e-05 2024-09-21T09:12:22.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.321494+0000", 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016915300000000001 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.321628+0000", 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000134165 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.327249+0000", 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056205400000000003 2024-09-21T09:12:22.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.333434+0000", 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061850639999999997 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.333493+0000", 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9477e-05 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.333539+0000", 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5532999999999999e-05 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1283 3.29 3:97ed8f1e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.0937739630000001, 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02166881, 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.580 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1283 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413478+0000", 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417497+0000", 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004018822 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417541+0000", 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3961999999999997e-05 2024-09-21T09:12:22.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417568+0000", 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6452999999999999e-05 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417777+0000", 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020961499999999999 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418024+0000", 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000247159 2024-09-21T09:12:22.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418257+0000", 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023203000000000001 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.427160+0000", 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089031600000000002 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435069+0000", 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079094850000000008 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435111+0000", 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1959000000000003e-05 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435144+0000", 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2815999999999999e-05 2024-09-21T09:12:22.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1299 3.38 3:1d64e930:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.644808+0000", 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86244082899999996, 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016216622, 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.586 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1299 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.644808+0000", 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.644808+0000", 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.644811+0000", 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.05e-06 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.648791+0000", 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039795560000000004 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.648835+0000", 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4459999999999998e-05 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.648849+0000", 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3219e-05 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.649015+0000", 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016639199999999999 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.649430+0000", 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000415141 2024-09-21T09:12:22.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.649849+0000", 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000419369 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.658363+0000", 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085140470000000003 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.660953+0000", 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025892699999999999 2024-09-21T09:12:22.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.660993+0000", 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9977e-05 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.661025+0000", 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2141000000000003e-05 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1306 3.3d 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.74907779500000005, 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020194347000000001, 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1306 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758174+0000", 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762157+0000", 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039825770000000002 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762201+0000", 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4245000000000001e-05 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762220+0000", 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8808999999999999e-05 2024-09-21T09:12:22.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762324+0000", 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104033 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762588+0000", 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026391700000000001 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762811+0000", 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000222957 2024-09-21T09:12:22.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.771599+0000", 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087878469999999997 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778144+0000", 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065449810000000001 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778244+0000", 2024-09-21T09:12:22.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9901000000000005e-05 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778366+0000", 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012201000000000001 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1308 3.1e 3:7b3fa023:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.789488+0000", 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.71776119599999999, 2024-09-21T09:12:22.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017593206, 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1308 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.789488+0000", 2024-09-21T09:12:22.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.789488+0000", 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.789490+0000", 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5399999999999998e-06 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.793508+0000", 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040180550000000004 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.793547+0000", 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8111999999999997e-05 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.793564+0000", 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7866000000000001e-05 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.793696+0000", 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013149 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.793937+0000", 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241427 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.794146+0000", 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000209094 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.800970+0000", 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068230510000000001 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.806930+0000", 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059603620000000003 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.807016+0000", 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5719999999999999e-05 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.807081+0000", 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5488999999999996e-05 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1309 3.27 3:e4cec97a:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.813138+0000", 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.69411076800000004, 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016444140999999999, 2024-09-21T09:12:22.603 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1309 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.813138+0000", 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.813138+0000", 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.813141+0000", 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6630000000000002e-06 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.817125+0000", 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00398365 2024-09-21T09:12:22.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.817171+0000", 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6312e-05 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.817190+0000", 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8946000000000001e-05 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.817390+0000", 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019970799999999999 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.817641+0000", 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025111900000000001 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.817872+0000", 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023082699999999999 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.824826+0000", 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069547330000000003 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.829388+0000", 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004561224 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.829497+0000", 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109887 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.829582+0000", 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5072000000000001e-05 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1311 3.27 3:e6d5d281:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.64819360699999995, 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024501067000000001, 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.609 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1311 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859057+0000", 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5149999999999999e-06 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862830+0000", 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037728620000000001 2024-09-21T09:12:22.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862850+0000", 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0264000000000001e-05 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862859+0000", 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2189999999999993e-06 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863041+0000", 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018214899999999999 2024-09-21T09:12:22.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863291+0000", 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024963299999999997 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863529+0000", 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023759000000000001 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.870237+0000", 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067083170000000001 2024-09-21T09:12:22.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883389+0000", 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013151532 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883486+0000", 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7640999999999996e-05 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883557+0000", 2024-09-21T09:12:22.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0345000000000005e-05 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1314 3.3d 3:be72b899:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.919023+0000", 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.58822656600000001, 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017582444999999999, 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.615 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1314 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.919023+0000", 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.919023+0000", 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.919026+0000", 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0029999999999999e-06 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.922911+0000", 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038856189999999999 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.922953+0000", 2024-09-21T09:12:22.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1461999999999997e-05 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.922972+0000", 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8929000000000001e-05 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.923124+0000", 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015280299999999999 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.923380+0000", 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025519900000000001 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.923616+0000", 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023685700000000001 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.931946+0000", 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083292230000000002 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.936348+0000", 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044028469999999997 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.936474+0000", 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125477 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.936605+0000", 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013102599999999999 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.620 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1317 3.3e 3:7ff9933d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.52650283399999998, 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018704327, 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1317 2024-09-21T09:12:22.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:22.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980750+0000", 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0929999999999996e-06 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984763+0000", 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040130219999999998 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984810+0000", 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6579000000000002e-05 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:22.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984831+0000", 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1115999999999999e-05 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985053+0000", 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022203699999999999 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985323+0000", 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026964900000000001 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:22.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985563+0000", 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023996299999999999 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.995589+0000", 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010026372 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999270+0000", 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036809500000000001 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999369+0000", 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9048000000000004e-05 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999451+0000", 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1497999999999998e-05 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:22.626 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:22.628 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:22.628 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:22.623+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:22.666 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:22.728 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:22.725+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:22.775 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:22.776 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:22.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:22.840 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:22.837+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:22.849 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:22.849 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:22.871 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:22.871 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:22.894 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:22.894 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:22.917 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:22.918 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:22.930 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:22.927+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:22.956 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:22.979 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:22.979 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:22.982 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:22.983 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:22.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:23.015 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:23.031 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:23.027+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:23.049 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:23.049 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:23.130 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:23.130 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:23.133 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:23.129+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:23.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:23.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T09:12:23.233 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:23.231+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:23.322 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:23.322 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:23.335 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:23.329+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:23.337 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:23.435 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:23.433+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:23.511 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:23.511 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:23.527 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:23.536 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:23.531+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:23.637 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:23.635+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:23.721 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:23.721 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:23.738 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:23.735+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:23.742 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:23.840 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:23.837+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:23.887 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:23.887 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:23.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:23.941 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:23.937+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:24.042 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:24.039+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:24.054 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:24.054 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:24.080 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:24.142 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:24.137+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:24.165 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-09-21T09:12:24.243 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:24.237+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:24.284 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:24.284 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:24.304 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:24.318 INFO:tasks.workunit.client.0.smithi007.stdout:quota enabled for the user usr2 2024-09-21T09:12:24.318 INFO:tasks.workunit.client.0.smithi007.stdout:adding file to bucket buck_2024_08_21_09_12_18: 1Gb. 2024-09-21T09:12:24.318 INFO:tasks.workunit.client.0.smithi007.stdout:upload file successful 2024-09-21T09:12:24.318 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:24.318 INFO:tasks.workunit.client.0.smithi007.stdout:Test case: PASSED - quota set for user: usr2 with max_size=1048576000 passed 2024-09-21T09:12:24.319 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:24.344 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:24.341+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:24.424 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:24.424 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:24.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:24.445 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:24.441+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:24.545 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:24.541+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:24.589 INFO:tasks.workunit.client.0.smithi007.stdout:user usr2 deleted 2024-09-21T09:12:24.617 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:24.617 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:24.634 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:24.646 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:24.641+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:24.747 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:24.741+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:24.760 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:24.760 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:24.776 INFO:tasks.workunit.client.0.smithi007.stdout:Bucket Created: buck_2024_08_21_09_12_24 2024-09-21T09:12:24.778 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:24.848 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:24.845+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:24.905 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:24.905 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:24.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:24.949 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:24.945+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:25.016 INFO:tasks.workunit.client.0.smithi007.stderr:10+0 records in 2024-09-21T09:12:25.016 INFO:tasks.workunit.client.0.smithi007.stderr:10+0 records out 2024-09-21T09:12:25.017 INFO:tasks.workunit.client.0.smithi007.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.070461 s, 1.5 GB/s 2024-09-21T09:12:25.045 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:25.045 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:25.050 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:25.045+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:25.066 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:25.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:25.151 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:25.145+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:25.190 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:25.191 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:25.204 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:25.249 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:25.250 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:25.252 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:25.249+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:25.266 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:25.282 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:25.282 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:25.298 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:25.298 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:25.318 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:25.318 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:25.318 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:25.318 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:25.318 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:25.319 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:25.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:25.354 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:25.354 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:25.351+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:25.389 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:25.389 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:25.424 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:25.424 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:25.448 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:25.448 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:25.448 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:25.448 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:25.448 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:25.454 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:25.451+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:25.479 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:25.555 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:25.549+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:25.655 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:25.651+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:25.674 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:25.674 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:25.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:25.674 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:25.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.674 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1234 3.d 3:b2a8e85c:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:25.674 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:20.969813+0000", 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.7012178850000002, 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015476112, 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1234 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.969813+0000", 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.969813+0000", 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.969817+0000", 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2289999999999999e-06 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972407+0000", 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025901679999999999 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972437+0000", 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9955e-05 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972453+0000", 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5760000000000002e-05 2024-09-21T09:12:25.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972551+0000", 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8505999999999995e-05 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972713+0000", 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016156499999999999 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:25.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972860+0000", 2024-09-21T09:12:25.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000147255 2024-09-21T09:12:25.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.985159+0000", 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012299203 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.985174+0000", 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4921e-05 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.985234+0000", 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0349000000000001e-05 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.985290+0000", 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5201000000000002e-05 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1249 3.14 3:2ad301c5:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.045969+0000", 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.625062464, 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.019155074000000001, 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1249 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.045969+0000", 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.045969+0000", 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.045973+0000", 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7900000000000001e-06 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.048237+0000", 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00226414 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.048279+0000", 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2506000000000003e-05 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.048305+0000", 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5449999999999999e-05 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.048483+0000", 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017779800000000001 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.048817+0000", 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033483599999999998 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.049155+0000", 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033755200000000002 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.063690+0000", 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01453526 2024-09-21T09:12:25.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.065043+0000", 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001352535 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.065088+0000", 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5213000000000002e-05 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.065124+0000", 2024-09-21T09:12:25.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5994000000000001e-05 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1258 3.17 e60/24 3:e9fd25dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_15:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.152827+0000", 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.5182040649999999, 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017562556999999999, 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.152827+0000", 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.152827+0000", 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.152828+0000", 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6300000000000004e-07 2024-09-21T09:12:25.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.161027+0000", 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081988970000000001 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.161047+0000", 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9653e-05 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.161054+0000", 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5610000000000001e-06 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.161110+0000", 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5958000000000002e-05 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.161135+0000", 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4420999999999999e-05 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.170325+0000", 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091902640000000001 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.170390+0000", 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4939999999999998e-05 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1260 3.17 e60/24 3:eb13e7c3:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_17:head v 60'3, mlcod=58'1)", 2024-09-21T09:12:25.693 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.176576+0000", 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4944548820000003, 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.014479636000000001, 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.176576+0000", 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.176576+0000", 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.176578+0000", 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.686e-06 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.180404+0000", 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038261240000000002 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.180426+0000", 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1435999999999999e-05 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.180440+0000", 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3922e-05 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.180499+0000", 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9416999999999997e-05 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.180519+0000", 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9579999999999999e-05 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.191013+0000", 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010494473000000001 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.191056+0000", 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2997999999999997e-05 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1267 3.9 3:931159eb:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.243320+0000", 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4277111700000003, 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017673600000000001, 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.698 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1267 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.243320+0000", 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.243320+0000", 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.243323+0000", 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.734e-06 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245009+0000", 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016861440000000001 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245041+0000", 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1642e-05 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245052+0000", 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.181e-05 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245138+0000", 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5623000000000003e-05 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245300+0000", 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016173199999999999 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245453+0000", 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015279900000000001 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.251731+0000", 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062788560000000002 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.260877+0000", 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091458630000000006 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.260941+0000", 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3936000000000006e-05 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.260994+0000", 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2460999999999998e-05 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.703 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1301 3.1d 3:ba8f96da:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.679679+0000", 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.9913523209999999, 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017094921999999999, 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1301 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.679679+0000", 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.679679+0000", 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.679683+0000", 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8399999999999997e-06 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.682833+0000", 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003150646 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.682873+0000", 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9821999999999999e-05 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.682890+0000", 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6637e-05 2024-09-21T09:12:25.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.683057+0000", 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000167128 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.683300+0000", 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024265699999999999 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.683514+0000", 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000214615 2024-09-21T09:12:25.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.691474+0000", 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079597660000000001 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.696635+0000", 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051609020000000002 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.696711+0000", 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5566000000000001e-05 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.696774+0000", 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3343000000000007e-05 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1307 3.30 3:0e012621:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.775950+0000", 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.8950813650000002, 2024-09-21T09:12:25.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015980379999999999, 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1307 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.775950+0000", 2024-09-21T09:12:25.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.775950+0000", 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.775954+0000", 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5559999999999999e-06 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.779002+0000", 2024-09-21T09:12:25.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030481499999999999 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.779043+0000", 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0918999999999999e-05 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.779062+0000", 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9123e-05 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.779249+0000", 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018697599999999999 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.779660+0000", 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041146500000000002 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.780040+0000", 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037961599999999999 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.787855+0000", 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0078154750000000005 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.791781+0000", 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039261670000000004 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.791866+0000", 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4250000000000001e-05 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.791930+0000", 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4683000000000004e-05 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1313 3.14 3:2980a0af:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.904130+0000", 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7669013979999999, 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.018618775000000001, 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.715 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1313 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.904130+0000", 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.904130+0000", 2024-09-21T09:12:25.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.904133+0000", 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5360000000000001e-06 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.907058+0000", 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002924879 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.907111+0000", 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2676999999999997e-05 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.907132+0000", 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1157000000000001e-05 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.907309+0000", 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177109 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.907713+0000", 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040353900000000001 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.908129+0000", 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041571499999999999 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.917121+0000", 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0089928690000000006 2024-09-21T09:12:25.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.922473+0000", 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053513839999999998 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.922656+0000", 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000183148 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.922749+0000", 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2762000000000004e-05 2024-09-21T09:12:25.720 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1315 3.d 3:b14120c2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.941502+0000", 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7295296430000002, 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020772466999999999, 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.721 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1315 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.941502+0000", 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.941502+0000", 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.941506+0000", 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3100000000000002e-06 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.944695+0000", 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031890730000000002 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.944744+0000", 2024-09-21T09:12:25.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8708999999999997e-05 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.944767+0000", 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.351e-05 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.944945+0000", 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000178204 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.945400+0000", 2024-09-21T09:12:25.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045455499999999999 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.945848+0000", 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044811100000000001 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.953417+0000", 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075691029999999998 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.962063+0000", 2024-09-21T09:12:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0086456640000000008 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.962156+0000", 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3566000000000005e-05 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.962274+0000", 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000117662 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1318 3.2f 3:f4b1572d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.002007+0000", 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.6690239509999998, 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.016069502999999999, 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1318 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.727 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.002007+0000", 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.002007+0000", 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.002012+0000", 2024-09-21T09:12:25.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2760000000000002e-06 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006026+0000", 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040146490000000003 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006072+0000", 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5963e-05 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006100+0000", 2024-09-21T09:12:25.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7457000000000002e-05 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006317+0000", 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217417 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006580+0000", 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026252099999999999 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006776+0000", 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019605499999999999 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.014808+0000", 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0080321469999999999 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.017968+0000", 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003159851 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.018027+0000", 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8987000000000003e-05 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.018077+0000", 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0179999999999997e-05 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.732 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1321 3.37 e60/24 3:ef44c02d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_78:head v 60'3, mlcod=59'1)", 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.075062+0000", 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.5959697730000002, 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.019875680999999999, 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.075062+0000", 2024-09-21T09:12:25.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.075062+0000", 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.075064+0000", 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.903e-06 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.079688+0000", 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046240059999999999 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.079726+0000", 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7632000000000002e-05 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.079744+0000", 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8397e-05 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.079923+0000", 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000178741 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.080018+0000", 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4282000000000003e-05 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.094827+0000", 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.014809503999999999 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.094937+0000", 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000110216 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1325 3.2f 3:f4fe5e24:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.159821+0000", 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.5112105270000002, 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.018908983000000001, 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.737 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1325 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.159821+0000", 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.159821+0000", 2024-09-21T09:12:25.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.159825+0000", 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.313e-06 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163038+0000", 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032133190000000001 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163100+0000", 2024-09-21T09:12:25.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2012000000000002e-05 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163130+0000", 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9297000000000001e-05 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163294+0000", 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016418100000000001 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163604+0000", 2024-09-21T09:12:25.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000310196 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163930+0000", 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032566600000000001 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.178227+0000", 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.014296737 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.178555+0000", 2024-09-21T09:12:25.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032863899999999998 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.178651+0000", 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5972999999999997e-05 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.178730+0000", 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8650000000000001e-05 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1330 3.1d 3:b940fb57:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.254772+0000", 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.4162595819999999, 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.016515141000000001, 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1330 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.254772+0000", 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.254772+0000", 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.254776+0000", 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2429999999999999e-06 2024-09-21T09:12:25.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258083+0000", 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033070450000000002 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258142+0000", 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8712000000000003e-05 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258174+0000", 2024-09-21T09:12:25.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1792999999999999e-05 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258341+0000", 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016761799999999999 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258623+0000", 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000281857 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:25.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258817+0000", 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019397500000000001 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.265620+0000", 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006802982 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.271200+0000", 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055796600000000002 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.271248+0000", 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8479999999999997e-05 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.271287+0000", 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8776000000000003e-05 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1334 3.d 3:b1129d38:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.337685+0000", 2024-09-21T09:12:25.748 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3333464209999999, 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.014768049, 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1334 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.337685+0000", 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.337685+0000", 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.337688+0000", 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6840000000000001e-06 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.340625+0000", 2024-09-21T09:12:25.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029372550000000002 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.340687+0000", 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1832e-05 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.340717+0000", 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0006999999999999e-05 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.340893+0000", 2024-09-21T09:12:25.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000176439 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.341167+0000", 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027384399999999998 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.341467+0000", 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030046700000000001 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.349535+0000", 2024-09-21T09:12:25.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0080673729999999992 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.352315+0000", 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027806950000000001 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.352393+0000", 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7263999999999998e-05 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.352453+0000", 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0189000000000003e-05 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1341 3.30 3:0c933a22:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.481745+0000", 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.189286616, 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015199446, 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1341 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.481745+0000", 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.481745+0000", 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.481748+0000", 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2389999999999998e-06 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484114+0000", 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023658630000000002 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484159+0000", 2024-09-21T09:12:25.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4879000000000002e-05 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484199+0000", 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0673000000000002e-05 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484293+0000", 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3286000000000001e-05 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484492+0000", 2024-09-21T09:12:25.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199311 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484619+0000", 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012670800000000001 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.491197+0000", 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006578169 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.496637+0000", 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0054398190000000003 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.496825+0000", 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000188352 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.496944+0000", 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.759 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1346 3.1d 3:b8511b4a:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.581419+0000", 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.089612045, 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.018633033, 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1346 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.581419+0000", 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.581419+0000", 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.581422+0000", 2024-09-21T09:12:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5160000000000001e-06 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.584199+0000", 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002777692 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.584244+0000", 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4767e-05 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.584265+0000", 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1137000000000001e-05 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.584425+0000", 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015947300000000001 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.584742+0000", 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031674699999999998 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.585048+0000", 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030630300000000001 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.595833+0000", 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010785131999999999 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.599761+0000", 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039277970000000002 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.599927+0000", 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000166181 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.600052+0000", 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012528800000000001 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1353 3.28 3:16e0de94:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.708716+0000", 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.962315807, 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.018892649000000001, 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1353 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.708716+0000", 2024-09-21T09:12:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.708716+0000", 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.708718+0000", 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6479999999999999e-06 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.710742+0000", 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020235689999999998 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.710782+0000", 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0077999999999998e-05 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.710800+0000", 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7875000000000001e-05 2024-09-21T09:12:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.710881+0000", 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0882000000000003e-05 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.711029+0000", 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000148114 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.711127+0000", 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8690000000000005e-05 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.715628+0000", 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045005549999999998 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.727474+0000", 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011846478000000001 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.727550+0000", 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5178000000000004e-05 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.727608+0000", 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8582000000000003e-05 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1532 3.28 3:15768fe5:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:25.443098+0000", 2024-09-21T09:12:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.22793348799999999, 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.019281034999999998, 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1532 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.443098+0000", 2024-09-21T09:12:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.443098+0000", 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.443101+0000", 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1580000000000001e-06 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445209+0000", 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021083719999999999 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445239+0000", 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9513e-05 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445254+0000", 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5407e-05 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445326+0000", 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1717999999999993e-05 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445454+0000", 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128295 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445562+0000", 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107559 2024-09-21T09:12:25.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.451785+0000", 2024-09-21T09:12:25.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062227200000000002 2024-09-21T09:12:25.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.462257+0000", 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010471960000000001 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.462324+0000", 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7957e-05 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.462379+0000", 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4376000000000003e-05 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1546 3.1d 3:b8116d35:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:25.591903+0000", 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.079128117999999997, 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021960640999999999, 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.778 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1546 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.591903+0000", 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.591903+0000", 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.591907+0000", 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3560000000000001e-06 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.593829+0000", 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019223720000000001 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.593855+0000", 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5856000000000001e-05 2024-09-21T09:12:25.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.593867+0000", 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1968e-05 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.593945+0000", 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8708999999999995e-05 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.594118+0000", 2024-09-21T09:12:25.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000172058 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.594278+0000", 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016031500000000001 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.601447+0000", 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071693110000000003 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.613717+0000", 2024-09-21T09:12:25.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012270104 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.613786+0000", 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8452000000000001e-05 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.613864+0000", 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8139999999999994e-05 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1547 3.22 3:44fd850b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:25.600685+0000", 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.070345860999999996, 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.019146303999999999, 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1547 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.600685+0000", 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.600685+0000", 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.600688+0000", 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2139999999999999e-06 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.602581+0000", 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018937310000000001 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.602609+0000", 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8062999999999999e-05 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.602623+0000", 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3555e-05 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.602711+0000", 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8358999999999999e-05 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.602887+0000", 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000175272 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.603050+0000", 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000163237 2024-09-21T09:12:25.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.610284+0000", 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0072336620000000001 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.619687+0000", 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0094037800000000005 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.619769+0000", 2024-09-21T09:12:25.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2074000000000001e-05 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.619832+0000", 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2356999999999999e-05 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:25.789 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:25.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:25.791 INFO:tasks.workunit.client.0.smithi007.stdout:quota enabled for the user 0.49028942624955 2024-09-21T09:12:25.791 INFO:tasks.workunit.client.0.smithi007.stdout:adding file to bucket buck_2024_08_21_09_12_24: 100Mb. 2024-09-21T09:12:25.791 INFO:tasks.workunit.client.0.smithi007.stdout:upload file successful 2024-09-21T09:12:25.791 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:25.787+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:25.892 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:25.889+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:25.932 INFO:tasks.workunit.client.0.smithi007.stdout:Bucket Created: buck_2024_08_21_09_12_25 2024-09-21T09:12:25.935 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:25.935 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:25.935 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:25.935 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:25.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:25.992 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:25.989+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:26.093 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:26.091+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:26.124 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:26.125 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:26.125 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:26.125 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:26.125 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:26.139 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:26.194 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:26.189+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:26.202 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T09:12:26.270 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1265 3.3a e60/24 3:5cfa63b7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_22:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.0370690490000003, 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025518386000000001, 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.271 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230289+0000", 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1399999999999996e-07 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239530+0000", 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092409199999999997 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239574+0000", 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4301999999999997e-05 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239594+0000", 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9559999999999999e-05 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239779+0000", 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018548800000000001 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239846+0000", 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6897999999999995e-05 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255678+0000", 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015831548000000001 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255807+0000", 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000128856 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.275 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1267 3.9 e60/24 3:931159eb:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_24:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.0212143549999997, 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014928096, 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246144+0000", 2024-09-21T09:12:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0669999999999999e-06 2024-09-21T09:12:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252177+0000", 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060330760000000001 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252211+0000", 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3822000000000002e-05 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252228+0000", 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7125999999999998e-05 2024-09-21T09:12:26.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252379+0000", 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015065 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252417+0000", 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8665000000000003e-05 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.260976+0000", 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085584029999999992 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261071+0000", 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5286999999999998e-05 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1286 3.3c e60/24 3:3c018bdd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_43:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.458778+0000", 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.808579709, 2024-09-21T09:12:26.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01189574, 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.458778+0000", 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.458778+0000", 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.458780+0000", 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5969999999999999e-06 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.463354+0000", 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004573723 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.463400+0000", 2024-09-21T09:12:26.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6255999999999999e-05 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.463418+0000", 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8219e-05 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.463539+0000", 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012092299999999999 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.463582+0000", 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2979000000000003e-05 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.470587+0000", 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070045790000000004 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.470673+0000", 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6464000000000004e-05 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.285 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1291 3.2 3:4203678b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.285 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:26.285 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.7345288979999998, 2024-09-21T09:12:26.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015334344999999999, 2024-09-21T09:12:26.285 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.285 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.285 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1291 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532834+0000", 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8329999999999999e-06 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537680+0000", 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048457689999999998 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537707+0000", 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7364000000000001e-05 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537721+0000", 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3935e-05 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537860+0000", 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000138646 2024-09-21T09:12:26.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.538194+0000", 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033445799999999999 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.538521+0000", 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032673799999999997 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.546553+0000", 2024-09-21T09:12:26.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080323600000000005 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.547994+0000", 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00144082 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.548087+0000", 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2627000000000006e-05 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.548163+0000", 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5795000000000002e-05 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1303 3.2b 3:d7a32023:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.560999238, 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017871702999999999, 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.291 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1303 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:26.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706362+0000", 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1659999999999996e-06 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712782+0000", 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006419803 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712817+0000", 2024-09-21T09:12:26.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5466000000000002e-05 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712838+0000", 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0919000000000001e-05 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712933+0000", 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4452999999999998e-05 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713042+0000", 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109304 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713159+0000", 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011710299999999999 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.719777+0000", 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006617497 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724152+0000", 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043755240000000004 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724191+0000", 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8337999999999998e-05 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724230+0000", 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.913e-05 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.297 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1304 3.2 3:40da9a43:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.297 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:26.297 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5418054269999999, 2024-09-21T09:12:26.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018044510999999999, 2024-09-21T09:12:26.297 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.297 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.297 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.297 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.297 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1304 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:26.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725555+0000", 2024-09-21T09:12:26.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.977e-06 2024-09-21T09:12:26.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730352+0000", 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047973670000000003 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730394+0000", 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2199e-05 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730412+0000", 2024-09-21T09:12:26.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7679000000000001e-05 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730524+0000", 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011182400000000001 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730728+0000", 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000204448 2024-09-21T09:12:26.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:26.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730907+0000", 2024-09-21T09:12:26.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000178753 2024-09-21T09:12:26.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.736861+0000", 2024-09-21T09:12:26.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059537629999999999 2024-09-21T09:12:26.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743469+0000", 2024-09-21T09:12:26.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066083970000000002 2024-09-21T09:12:26.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743539+0000", 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9387000000000005e-05 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743596+0000", 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7717000000000003e-05 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.305 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1306 3.3d e60/24 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:26.305 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:26.305 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5042274209999995, 2024-09-21T09:12:26.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014663086000000001, 2024-09-21T09:12:26.305 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.305 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.305 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.305 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763131+0000", 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2500000000000001e-06 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766744+0000", 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003613256 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766796+0000", 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1907999999999998e-05 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766820+0000", 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4097e-05 2024-09-21T09:12:26.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766950+0000", 2024-09-21T09:12:26.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129436 2024-09-21T09:12:26.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766990+0000", 2024-09-21T09:12:26.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9826000000000001e-05 2024-09-21T09:12:26.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.777707+0000", 2024-09-21T09:12:26.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010717232 2024-09-21T09:12:26.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.777793+0000", 2024-09-21T09:12:26.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6081000000000005e-05 2024-09-21T09:12:26.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.310 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.310 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.310 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1314 3.3d e60/24 3:be72b899:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_71:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:26.310 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.923882+0000", 2024-09-21T09:12:26.310 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3434756840000004, 2024-09-21T09:12:26.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012152436000000001, 2024-09-21T09:12:26.311 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.311 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.311 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.311 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.923882+0000", 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.923882+0000", 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.923884+0000", 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1969999999999999e-06 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.926664+0000", 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027801190000000002 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.926707+0000", 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2911999999999998e-05 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.926731+0000", 2024-09-21T09:12:26.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4579999999999998e-05 2024-09-21T09:12:26.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.926906+0000", 2024-09-21T09:12:26.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017419500000000001 2024-09-21T09:12:26.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.926972+0000", 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6383999999999993e-05 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.935884+0000", 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089119030000000005 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.936034+0000", 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015014600000000001 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.315 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1319 3.1b 3:da10b4a0:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.2431875750000003, 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020034222000000001, 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.316 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1319 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024172+0000", 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6639999999999998e-06 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028099+0000", 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039262639999999996 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028132+0000", 2024-09-21T09:12:26.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3155999999999999e-05 2024-09-21T09:12:26.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028146+0000", 2024-09-21T09:12:26.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3835999999999999e-05 2024-09-21T09:12:26.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028273+0000", 2024-09-21T09:12:26.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127436 2024-09-21T09:12:26.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028566+0000", 2024-09-21T09:12:26.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029305899999999997 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028799+0000", 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023329399999999999 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.040586+0000", 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011786173 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044077+0000", 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034909429999999998 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044145+0000", 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8182000000000006e-05 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044204+0000", 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9215000000000001e-05 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.322 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1331 3.2b 3:d6dd70dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.9877355140000001, 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015879798000000001, 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.323 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1331 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:26.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279625+0000", 2024-09-21T09:12:26.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.932e-06 2024-09-21T09:12:26.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283705+0000", 2024-09-21T09:12:26.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040801630000000004 2024-09-21T09:12:26.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283748+0000", 2024-09-21T09:12:26.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3216000000000001e-05 2024-09-21T09:12:26.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283766+0000", 2024-09-21T09:12:26.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7717e-05 2024-09-21T09:12:26.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283929+0000", 2024-09-21T09:12:26.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016334800000000001 2024-09-21T09:12:26.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.284333+0000", 2024-09-21T09:12:26.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000404013 2024-09-21T09:12:26.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:26.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.284775+0000", 2024-09-21T09:12:26.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044202199999999998 2024-09-21T09:12:26.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.293797+0000", 2024-09-21T09:12:26.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0090219979999999998 2024-09-21T09:12:26.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295202+0000", 2024-09-21T09:12:26.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001404977 2024-09-21T09:12:26.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295378+0000", 2024-09-21T09:12:26.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175656 2024-09-21T09:12:26.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295502+0000", 2024-09-21T09:12:26.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012375600000000001 2024-09-21T09:12:26.333 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.333 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.333 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.334 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1335 3.39 e60/24 3:9e12c6c8:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_92:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:26.334 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:26.334 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.901086823, 2024-09-21T09:12:26.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014870665, 2024-09-21T09:12:26.334 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.334 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.335 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.335 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:26.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:26.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366273+0000", 2024-09-21T09:12:26.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0130000000000002e-06 2024-09-21T09:12:26.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371450+0000", 2024-09-21T09:12:26.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051763310000000002 2024-09-21T09:12:26.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371486+0000", 2024-09-21T09:12:26.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6684999999999999e-05 2024-09-21T09:12:26.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371507+0000", 2024-09-21T09:12:26.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0869999999999998e-05 2024-09-21T09:12:26.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371672+0000", 2024-09-21T09:12:26.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016454600000000001 2024-09-21T09:12:26.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371712+0000", 2024-09-21T09:12:26.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0045e-05 2024-09-21T09:12:26.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.381006+0000", 2024-09-21T09:12:26.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092941480000000003 2024-09-21T09:12:26.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.381141+0000", 2024-09-21T09:12:26.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013502699999999999 2024-09-21T09:12:26.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.344 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.345 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1349 3.39 e60/24 3:9cb062e9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_106:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:26.345 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.657724+0000", 2024-09-21T09:12:26.345 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.6096327869999998, 2024-09-21T09:12:26.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01199125, 2024-09-21T09:12:26.345 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.346 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.346 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.657724+0000", 2024-09-21T09:12:26.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.657724+0000", 2024-09-21T09:12:26.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.657726+0000", 2024-09-21T09:12:26.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.922e-06 2024-09-21T09:12:26.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.662069+0000", 2024-09-21T09:12:26.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043425750000000004 2024-09-21T09:12:26.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.662102+0000", 2024-09-21T09:12:26.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3234000000000001e-05 2024-09-21T09:12:26.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.662115+0000", 2024-09-21T09:12:26.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2896e-05 2024-09-21T09:12:26.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.662222+0000", 2024-09-21T09:12:26.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010681899999999999 2024-09-21T09:12:26.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.662251+0000", 2024-09-21T09:12:26.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8884e-05 2024-09-21T09:12:26.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.669660+0000", 2024-09-21T09:12:26.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074088230000000001 2024-09-21T09:12:26.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.669716+0000", 2024-09-21T09:12:26.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6097000000000002e-05 2024-09-21T09:12:26.354 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.354 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.354 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.355 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1360 3.19 3:9846b005:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.355 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:26.355 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.481600888, 2024-09-21T09:12:26.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022976068999999998, 2024-09-21T09:12:26.355 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.355 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.356 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1360 2024-09-21T09:12:26.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.356 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:26.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:26.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785759+0000", 2024-09-21T09:12:26.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0539999999999999e-06 2024-09-21T09:12:26.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792174+0000", 2024-09-21T09:12:26.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064142349999999999 2024-09-21T09:12:26.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792218+0000", 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4759000000000003e-05 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792239+0000", 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0931999999999999e-05 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792401+0000", 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016128900000000001 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792724+0000", 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032341200000000003 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.793086+0000", 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000361751 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.800495+0000", 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074087129999999999 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808444+0000", 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079492120000000006 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808604+0000", 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015997900000000001 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808732+0000", 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012873299999999999 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1372 3.2b 3:d4d898f8:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.3436274369999999, 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017677609, 2024-09-21T09:12:26.362 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.363 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.363 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.363 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.363 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.363 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1372 2024-09-21T09:12:26.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.364 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:26.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:26.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923732+0000", 2024-09-21T09:12:26.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7489999999999999e-06 2024-09-21T09:12:26.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927536+0000", 2024-09-21T09:12:26.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038041720000000002 2024-09-21T09:12:26.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927563+0000", 2024-09-21T09:12:26.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7225000000000001e-05 2024-09-21T09:12:26.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927578+0000", 2024-09-21T09:12:26.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4955e-05 2024-09-21T09:12:26.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927772+0000", 2024-09-21T09:12:26.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019444199999999999 2024-09-21T09:12:26.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.928019+0000", 2024-09-21T09:12:26.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024669399999999999 2024-09-21T09:12:26.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:26.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.928268+0000", 2024-09-21T09:12:26.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024846999999999998 2024-09-21T09:12:26.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.936113+0000", 2024-09-21T09:12:26.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078454619999999992 2024-09-21T09:12:26.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941192+0000", 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050785589999999999 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941307+0000", 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115364 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941407+0000", 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000100517 2024-09-21T09:12:26.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1534 3.2b 3:d47ba0a2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80185978599999996, 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021807494, 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.372 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1534 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465501+0000", 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4860000000000002e-06 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473846+0000", 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083450369999999996 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473888+0000", 2024-09-21T09:12:26.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2079000000000001e-05 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473915+0000", 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7214000000000001e-05 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474073+0000", 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015771900000000001 2024-09-21T09:12:26.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474356+0000", 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028332999999999999 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474593+0000", 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023622000000000001 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.486329+0000", 2024-09-21T09:12:26.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011736483000000001 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487017+0000", 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068800299999999997 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487182+0000", 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000164716 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487305+0000", 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012320699999999999 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1536 3.3a e61/24 3:5db53460:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_5:head v 61'4, mlcod=60'2)", 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.77514670299999999, 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015410841999999999, 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492212+0000", 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8929999999999999e-06 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497695+0000", 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054820720000000002 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497726+0000", 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0991999999999997e-05 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497746+0000", 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0786999999999999e-05 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497898+0000", 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151256 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497961+0000", 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3268000000000005e-05 2024-09-21T09:12:26.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.507519+0000", 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095583869999999998 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.507621+0000", 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102187 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1538 3.3c e61/24 3:3ebc624b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_7:head v 61'5, mlcod=60'3)", 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.511124+0000", 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.75623286999999995, 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012629757, 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.511124+0000", 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.511124+0000", 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.511127+0000", 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4360000000000001e-06 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515765+0000", 2024-09-21T09:12:26.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046386350000000003 2024-09-21T09:12:26.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515800+0000", 2024-09-21T09:12:26.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4122999999999998e-05 2024-09-21T09:12:26.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515822+0000", 2024-09-21T09:12:26.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2200000000000001e-05 2024-09-21T09:12:26.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515993+0000", 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000171402 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.516040+0000", 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199e-05 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.523653+0000", 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007612265 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.523754+0000", 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010149699999999999 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1542 3.3d e61/24 3:bc2592c4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_11:head v 61'6, mlcod=60'4)", 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.557268+0000", 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.71008902399999996, 2024-09-21T09:12:26.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013801205, 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557268+0000", 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557268+0000", 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557271+0000", 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8159999999999998e-06 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560080+0000", 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002808868 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560121+0000", 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1084999999999997e-05 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560152+0000", 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0716000000000002e-05 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560333+0000", 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018096900000000001 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560422+0000", 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9425000000000005e-05 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.570720+0000", 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010297987999999999 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571069+0000", 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034933799999999998 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1545 3.2b 3:d625eaa7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.68256984099999995, 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017872958000000001, 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1545 2024-09-21T09:12:26.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584811+0000", 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3762000000000001e-05 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588898+0000", 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040866059999999996 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588937+0000", 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9439e-05 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588956+0000", 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8340000000000001e-05 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589073+0000", 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0001175 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589331+0000", 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025805000000000001 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589555+0000", 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223525 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.600733+0000", 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011178250000000001 2024-09-21T09:12:26.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602354+0000", 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001621054 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602536+0000", 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018230500000000001 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602660+0000", 2024-09-21T09:12:26.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124127 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1549 3.1b 3:dae9f2a4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.64575992100000001, 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018896029000000002, 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1549 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621602+0000", 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9300000000000002e-06 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627034+0000", 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054319820000000001 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627076+0000", 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1492000000000002e-05 2024-09-21T09:12:26.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627095+0000", 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9636e-05 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627245+0000", 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014983299999999999 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627542+0000", 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029642600000000002 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627779+0000", 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023740400000000001 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639133+0000", 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011353667 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640182+0000", 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010494510000000001 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640365+0000", 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018299500000000001 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640493+0000", 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012821299999999999 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.405 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.405 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:26.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:26.407 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:26.405+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:26.507 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:26.501+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:26.579 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:26.579 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:26.579 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:26.579 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:26.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:26.607 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:26.603+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:26.709 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:26.707+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:26.765 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:26.766 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:26.766 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:26.766 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:26.766 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:26.780 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:26.784 INFO:tasks.workunit.client.0.smithi007.stderr:10+0 records in 2024-09-21T09:12:26.784 INFO:tasks.workunit.client.0.smithi007.stderr:10+0 records out 2024-09-21T09:12:26.784 INFO:tasks.workunit.client.0.smithi007.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.71575 s, 147 MB/s 2024-09-21T09:12:26.810 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:26.807+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:26.911 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:26.911 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:26.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:26.911 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:26.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.911 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1163 3.17 3:eb0740dd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:26.911 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9975946019999995, 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019360854, 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1163 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911569+0000", 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6460000000000002e-06 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917121+0000", 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005551846 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917164+0000", 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2916e-05 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917183+0000", 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8508999999999998e-05 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917318+0000", 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013504200000000001 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917572+0000", 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025395300000000001 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917798+0000", 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022648300000000001 2024-09-21T09:12:26.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.929367+0000", 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011568729999999999 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930809+0000", 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014424730000000001 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930883+0000", 2024-09-21T09:12:26.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3910000000000002e-05 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930928+0000", 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4345999999999999e-05 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1235 3.18 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:26.917 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.927400885, 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028152907000000001, 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1235 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981763+0000", 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7700000000000002e-06 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988006+0000", 2024-09-21T09:12:26.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062426979999999997 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988042+0000", 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6461999999999998e-05 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988067+0000", 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4372999999999999e-05 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988210+0000", 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014307299999999999 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988480+0000", 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026992500000000002 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988718+0000", 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023859400000000001 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.002159+0000", 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01344091 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009749+0000", 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075900769999999998 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009840+0000", 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0736999999999995e-05 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009913+0000", 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3287999999999994e-05 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1246 3.31 3:8d902261:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.9084714419999997, 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022053738, 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.923 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1246 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000694+0000", 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2599999999999999e-06 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004867+0000", 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041723300000000001 2024-09-21T09:12:26.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004920+0000", 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2985000000000002e-05 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004948+0000", 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8362999999999999e-05 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005091+0000", 2024-09-21T09:12:26.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000142903 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005381+0000", 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029025500000000001 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005674+0000", 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000292878 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.017583+0000", 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011908981000000001 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022585+0000", 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050024179999999998 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022674+0000", 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8486999999999995e-05 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022744+0000", 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9877999999999997e-05 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1250 3.0 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8526645820000001, 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026211538999999999, 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.929 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1250 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056500+0000", 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.18e-06 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061414+0000", 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049142930000000001 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061455+0000", 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0689000000000003e-05 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061475+0000", 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9760000000000001e-05 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061649+0000", 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000174308 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062062+0000", 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041290199999999998 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062448+0000", 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038618600000000001 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.075288+0000", 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012839623999999999 2024-09-21T09:12:26.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082540+0000", 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072523489999999999 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082633+0000", 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3200000000000002e-05 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082708+0000", 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5048000000000004e-05 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1258 3.17 3:e9fd25dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7629368430000003, 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025293568999999998, 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.935 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1258 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146228+0000", 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8130000000000002e-06 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151893+0000", 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056641929999999997 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151937+0000", 2024-09-21T09:12:26.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4768999999999998e-05 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151978+0000", 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0844999999999999e-05 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152239+0000", 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026088000000000001 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152546+0000", 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000306905 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152815+0000", 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268912 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.165057+0000", 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012242368 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171206+0000", 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006148349 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171389+0000", 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018327799999999999 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171518+0000", 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129257 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1260 3.17 3:eb13e7c3:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7380103839999999, 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021083792000000001, 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.941 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1260 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171154+0000", 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9040000000000001e-06 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176055+0000", 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049010299999999998 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176092+0000", 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6662000000000002e-05 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176109+0000", 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7042999999999999e-05 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176228+0000", 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119747 2024-09-21T09:12:26.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176521+0000", 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029217499999999999 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176753+0000", 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023253299999999999 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.187711+0000", 2024-09-21T09:12:26.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010958324 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192068+0000", 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043564989999999998 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192163+0000", 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.48e-05 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192235+0000", 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2075000000000004e-05 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1266 3.38 3:1db25443:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.6743921510000002, 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018278652999999999, 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1266 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234772+0000", 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5730000000000002e-06 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240589+0000", 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058167760000000001 2024-09-21T09:12:26.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240661+0000", 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2358000000000001e-05 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240687+0000", 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5522000000000001e-05 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240897+0000", 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021069799999999999 2024-09-21T09:12:26.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.241146+0000", 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024912600000000001 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.241373+0000", 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022685399999999999 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.248615+0000", 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072417089999999998 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252728+0000", 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041126729999999998 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252915+0000", 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018731100000000001 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.253048+0000", 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000133053 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1272 3.29 3:963d269b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.6116330640000003, 2024-09-21T09:12:26.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019343672999999999, 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1272 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:26.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297532+0000", 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-06 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300259+0000", 2024-09-21T09:12:26.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027266579999999999 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300306+0000", 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6748e-05 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300325+0000", 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9752999999999999e-05 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300489+0000", 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016374200000000001 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300746+0000", 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025647300000000001 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300967+0000", 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022157700000000001 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.309603+0000", 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086360010000000008 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316784+0000", 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071809450000000002 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316833+0000", 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8949999999999997e-05 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316872+0000", 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1283 3.29 3:97ed8f1e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.4956863269999996, 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02166881, 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.959 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1283 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413478+0000", 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417497+0000", 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004018822 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417541+0000", 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3961999999999997e-05 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417568+0000", 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6452999999999999e-05 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417777+0000", 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020961499999999999 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418024+0000", 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000247159 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418257+0000", 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023203000000000001 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.427160+0000", 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089031600000000002 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435069+0000", 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079094850000000008 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435111+0000", 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1959000000000003e-05 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435144+0000", 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2815999999999999e-05 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1306 3.3d 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.150990159, 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020194347000000001, 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1306 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.965 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758174+0000", 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762157+0000", 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039825770000000002 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762201+0000", 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4245000000000001e-05 2024-09-21T09:12:26.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762220+0000", 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8808999999999999e-05 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762324+0000", 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104033 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762588+0000", 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026391700000000001 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762811+0000", 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000222957 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.771599+0000", 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087878469999999997 2024-09-21T09:12:26.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778144+0000", 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065449810000000001 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778244+0000", 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9901000000000005e-05 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778366+0000", 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012201000000000001 2024-09-21T09:12:26.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1308 3.1e 3:7b3fa023:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.789488+0000", 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1196735599999998, 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017593206, 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.971 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1308 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.789488+0000", 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.789488+0000", 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.789490+0000", 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5399999999999998e-06 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.793508+0000", 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040180550000000004 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.793547+0000", 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8111999999999997e-05 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.793564+0000", 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7866000000000001e-05 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.793696+0000", 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013149 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.793937+0000", 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241427 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.794146+0000", 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000209094 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.800970+0000", 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068230510000000001 2024-09-21T09:12:26.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.806930+0000", 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059603620000000003 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.807016+0000", 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5719999999999999e-05 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.807081+0000", 2024-09-21T09:12:26.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5488999999999996e-05 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1311 3.27 3:e6d5d281:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.0501059709999998, 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024501067000000001, 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1311 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:26.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859057+0000", 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5149999999999999e-06 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862830+0000", 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037728620000000001 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862850+0000", 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0264000000000001e-05 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862859+0000", 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2189999999999993e-06 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863041+0000", 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018214899999999999 2024-09-21T09:12:26.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863291+0000", 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024963299999999997 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863529+0000", 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023759000000000001 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.870237+0000", 2024-09-21T09:12:26.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067083170000000001 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883389+0000", 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013151532 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883486+0000", 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7640999999999996e-05 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883557+0000", 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0345000000000005e-05 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1314 3.3d 3:be72b899:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.919023+0000", 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9901389299999996, 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017582444999999999, 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.983 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1314 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.919023+0000", 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.919023+0000", 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.919026+0000", 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0029999999999999e-06 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.922911+0000", 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038856189999999999 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.922953+0000", 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1461999999999997e-05 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.922972+0000", 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8929000000000001e-05 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.923124+0000", 2024-09-21T09:12:26.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015280299999999999 2024-09-21T09:12:26.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.923380+0000", 2024-09-21T09:12:26.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025519900000000001 2024-09-21T09:12:26.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.923616+0000", 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023685700000000001 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.931946+0000", 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083292230000000002 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.936348+0000", 2024-09-21T09:12:26.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044028469999999997 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.936474+0000", 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125477 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.936605+0000", 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013102599999999999 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1317 3.3e 3:7ff9933d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9284151979999997, 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018704327, 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:26.990 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1317 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980750+0000", 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0929999999999996e-06 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984763+0000", 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040130219999999998 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984810+0000", 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6579000000000002e-05 2024-09-21T09:12:26.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984831+0000", 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1115999999999999e-05 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985053+0000", 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022203699999999999 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985323+0000", 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026964900000000001 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985563+0000", 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023996299999999999 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.995589+0000", 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010026372 2024-09-21T09:12:26.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999270+0000", 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036809500000000001 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999369+0000", 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9048000000000004e-05 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:26.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999451+0000", 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1497999999999998e-05 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1339 3.3b e60/24 3:debf2709:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_96:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.442266+0000", 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.4668951210000003, 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017647639999999999, 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:26.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.442266+0000", 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.442266+0000", 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:26.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.442269+0000", 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.066e-06 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.449733+0000", 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074634189999999998 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.449775+0000", 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1894999999999998e-05 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.449792+0000", 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6976000000000001e-05 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.449949+0000", 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015686000000000001 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.449998+0000", 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9302000000000003e-05 2024-09-21T09:12:26.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.459830+0000", 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098319400000000008 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.459914+0000", 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4182000000000001e-05 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.000 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1359 3.3d 3:bc104684:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.1326508710000001, 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020340127, 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1359 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776514+0000", 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8770000000000003e-06 2024-09-21T09:12:27.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783654+0000", 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071395319999999996 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783702+0000", 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8449000000000003e-05 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783722+0000", 2024-09-21T09:12:27.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9398999999999998e-05 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783892+0000", 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017003 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784158+0000", 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026600899999999999 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784416+0000", 2024-09-21T09:12:27.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025767999999999999 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795150+0000", 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010734321 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795847+0000", 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00069705199999999998 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796516+0000", 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066950600000000005 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796851+0000", 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033427199999999999 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1535 3.29 3:94169add:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.4325762479999999, 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021366508999999999, 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1535 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476590+0000", 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7269999999999998e-06 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483098+0000", 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065085480000000003 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483149+0000", 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0726000000000002e-05 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483171+0000", 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1622999999999999e-05 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483359+0000", 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018774199999999999 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483790+0000", 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000431915 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:27.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.484215+0000", 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000424664 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.493337+0000", 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091213739999999998 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497756+0000", 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044193039999999998 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497856+0000", 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9838000000000002e-05 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497952+0000", 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6047999999999999e-05 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1539 3.1f 3:f84f9343:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.388572492, 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017806683, 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1539 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520593+0000", 2024-09-21T09:12:27.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5760000000000002e-06 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524577+0000", 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039848710000000001 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524619+0000", 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1196000000000003e-05 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524638+0000", 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9219e-05 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524772+0000", 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013400400000000001 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.525057+0000", 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028520599999999998 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.525312+0000", 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025493400000000001 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.532161+0000", 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068492040000000002 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538068+0000", 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059067579999999998 2024-09-21T09:12:27.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538256+0000", 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000188285 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538396+0000", 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013943000000000001 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1542 3.3d 3:bc2592c4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.3568874319999999, 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019304961999999998, 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1542 2024-09-21T09:12:27.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552277+0000", 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2160000000000002e-06 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556307+0000", 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040297140000000002 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556345+0000", 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7996e-05 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556381+0000", 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6121999999999997e-05 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556519+0000", 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013799999999999999 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556785+0000", 2024-09-21T09:12:27.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026605299999999998 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557027+0000", 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241905 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.564209+0000", 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071818280000000003 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571404+0000", 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071951100000000002 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571496+0000", 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2269999999999996e-05 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571579+0000", 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2748000000000001e-05 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1543 3.1e 3:7938dd95:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.3474545949999999, 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020873849999999999, 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1543 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561710+0000", 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2499999999999998e-06 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567451+0000", 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005740864 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567493+0000", 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1851999999999998e-05 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567512+0000", 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-05 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567654+0000", 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014127899999999999 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567918+0000", 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026440799999999999 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.568159+0000", 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240564 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.577966+0000", 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098075639999999995 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582419+0000", 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044529060000000004 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582514+0000", 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4438000000000006e-05 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582581+0000", 2024-09-21T09:12:27.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7125000000000005e-05 2024-09-21T09:12:27.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.030 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.030 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.030 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:27.030 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:26.905+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:27.031 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:27.033 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:27.031+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:27.134 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:27.129+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:27.205 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-09-21T09:12:27.216 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:27.216 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:27.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.216 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1593 3.33 3:ccba01ee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:27.216 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:27.217 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.016276101000000001, 2024-09-21T09:12:27.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016306503, 2024-09-21T09:12:27.217 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.217 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.217 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "waiting for sub ops", 2024-09-21T09:12:27.217 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.218 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.218 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.218 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1593 2024-09-21T09:12:27.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.218 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:27.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:27.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199727+0000", 2024-09-21T09:12:27.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.616e-06 2024-09-21T09:12:27.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210215+0000", 2024-09-21T09:12:27.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010487918000000001 2024-09-21T09:12:27.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210257+0000", 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1375999999999998e-05 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210284+0000", 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7630000000000001e-05 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210450+0000", 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016565899999999999 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210824+0000", 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037435799999999998 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.211233+0000", 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040886699999999999 2024-09-21T09:12:27.222 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.223 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.223 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.223 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.223 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-21T09:12:27.223 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 1 2024-09-21T09:12:27.223 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:27.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:27.273 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:27.271+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:27.335 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:27.331+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:27.423 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:27.423 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:27.423 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:27.423 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:27.423 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:27.436 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:27.433+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:27.437 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:27.444 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:27.524 INFO:tasks.workunit.client.0.smithi007.stdout:quota enabled for the user 0.49028942624955 2024-09-21T09:12:27.524 INFO:tasks.workunit.client.0.smithi007.stdout:adding file to bucket buck_2024_08_21_09_12_25: 100Mb. 2024-09-21T09:12:27.524 INFO:tasks.workunit.client.0.smithi007.stdout:upload file successful 2024-09-21T09:12:27.537 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:27.532+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:27.594 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:27.595 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:27.612 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:27.612 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:27.618 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:27.618 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:27.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:27.618 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:27.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1235 3.18 e59/24 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.6255355510000005, 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020425276999999999, 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:27.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988949+0000", 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3659999999999999e-06 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994552+0000", 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056024719999999998 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994598+0000", 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6365000000000001e-05 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994624+0000", 2024-09-21T09:12:27.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6132e-05 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994804+0000", 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180209 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994849+0000", 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4838e-05 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009267+0000", 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014417780999999999 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009372+0000", 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105114 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1268 3.5 e60/24 3:a2dbcac0:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_25:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.257325+0000", 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.3571572170000001, 2024-09-21T09:12:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014256181, 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.257325+0000", 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.257325+0000", 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.257326+0000", 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8700000000000005e-07 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261877+0000", 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045506139999999997 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261925+0000", 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8118000000000002e-05 2024-09-21T09:12:27.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261944+0000", 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9040000000000001e-05 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.262128+0000", 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184081 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.262197+0000", 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.271490+0000", 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092929919999999999 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.271581+0000", 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1741000000000001e-05 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.627 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1287 3.33 3:cd21f967:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.1409847759999998, 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015957355999999999, 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.628 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1287 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:27.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473503+0000", 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7479999999999999e-06 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477595+0000", 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040917059999999996 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477625+0000", 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9765e-05 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477637+0000", 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2439000000000001e-05 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477738+0000", 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010084 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477862+0000", 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124201 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477961+0000", 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8373000000000002e-05 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.484421+0000", 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064599890000000002 2024-09-21T09:12:27.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489327+0000", 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049063270000000003 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489378+0000", 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0835999999999999e-05 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489455+0000", 2024-09-21T09:12:27.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7132000000000006e-05 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1290 3.32 3:4ee3f10c:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.517176+0000", 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.0973060920000002, 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014261803999999999, 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1290 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.517176+0000", 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.517176+0000", 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.517196+0000", 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9323000000000001e-05 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.520982+0000", 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037866470000000002 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521012+0000", 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9658999999999998e-05 2024-09-21T09:12:27.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521025+0000", 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3183000000000001e-05 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521128+0000", 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103269 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521249+0000", 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012012599999999999 2024-09-21T09:12:27.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521349+0000", 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000100694 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.530865+0000", 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095156249999999998 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.531347+0000", 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048167199999999999 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.531395+0000", 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8760000000000001e-05 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.531438+0000", 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2846000000000003e-05 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.639 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1300 3.12 3:493715d7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.947260676, 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015508042999999999, 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.640 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1300 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667225+0000", 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670749+0000", 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035240269999999999 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670777+0000", 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7506999999999999e-05 2024-09-21T09:12:27.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670791+0000", 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4215e-05 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670930+0000", 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000138591 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.671163+0000", 2024-09-21T09:12:27.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023348800000000001 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.671376+0000", 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021324700000000001 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.678083+0000", 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067063239999999996 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682605+0000", 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045220870000000002 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682672+0000", 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7238999999999998e-05 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682730+0000", 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7970999999999998e-05 2024-09-21T09:12:27.645 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1302 3.25 3:a46cad48:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.691784+0000", 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.9226988460000003, 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014564102000000001, 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.646 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1302 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.691784+0000", 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.691784+0000", 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.691787+0000", 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6839999999999998e-06 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695687+0000", 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038992430000000002 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695722+0000", 2024-09-21T09:12:27.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5573e-05 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695741+0000", 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8887000000000001e-05 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695837+0000", 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6032999999999993e-05 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695992+0000", 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015526299999999999 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.696126+0000", 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013412499999999999 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.701430+0000", 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053031049999999998 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706265+0000", 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004835743 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706310+0000", 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4255000000000002e-05 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706348+0000", 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8191000000000001e-05 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.651 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1312 3.b e60/24 3:d07beb3d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_69:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7273478969999996, 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015617013000000001, 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:27.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887136+0000", 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.578e-06 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.891977+0000", 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048406509999999996 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892015+0000", 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7722000000000002e-05 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892032+0000", 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7405999999999999e-05 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892152+0000", 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119757 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892194+0000", 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2002000000000002e-05 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902665+0000", 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010471543 2024-09-21T09:12:27.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902752+0000", 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6353999999999993e-05 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1316 3.5 e60/24 3:a3fa7fee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_73:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.6514383119999998, 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016060771000000001, 2024-09-21T09:12:27.656 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963046+0000", 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8729999999999999e-06 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968897+0000", 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058507289999999998 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968933+0000", 2024-09-21T09:12:27.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6112000000000003e-05 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968953+0000", 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9763e-05 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.969113+0000", 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016067800000000001 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.969185+0000", 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1761999999999995e-05 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.978989+0000", 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098042709999999998 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.979105+0000", 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011558299999999999 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1317 3.3e e60/24 3:7ff9933d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_74:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.985804+0000", 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.628678646, 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013205334000000001, 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985804+0000", 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985804+0000", 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985806+0000", 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1830000000000001e-06 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990044+0000", 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042378559999999999 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990094+0000", 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0309000000000002e-05 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990122+0000", 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7611999999999999e-05 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990285+0000", 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016361899999999999 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990331+0000", 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5969e-05 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.998872+0000", 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085405559999999995 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999009+0000", 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013723000000000001 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1323 3.12 3:4a999ff4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.5015788150000002, 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019594209000000001, 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1323 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112907+0000", 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1e-06 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117323+0000", 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044160229999999998 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117368+0000", 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5105000000000003e-05 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117387+0000", 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.931e-05 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117571+0000", 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018423199999999999 2024-09-21T09:12:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117976+0000", 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040424599999999998 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.118414+0000", 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043875199999999999 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.131859+0000", 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013444621 2024-09-21T09:12:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132294+0000", 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043466199999999999 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132420+0000", 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012634699999999999 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132498+0000", 2024-09-21T09:12:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7811000000000004e-05 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1326 3.20 e60/24 3:0644c05f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_83:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.180816+0000", 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.4336669019999997, 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012603535000000001, 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.180816+0000", 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.180816+0000", 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.180818+0000", 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6070000000000002e-06 2024-09-21T09:12:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.185973+0000", 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005154573 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.186000+0000", 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7361000000000001e-05 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.186016+0000", 2024-09-21T09:12:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5937999999999999e-05 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.186128+0000", 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171300000000001 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.186168+0000", 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0021999999999997e-05 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.193348+0000", 2024-09-21T09:12:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071801069999999998 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.193419+0000", 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1214e-05 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1332 3.33 3:cc16045e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.3166121720000001, 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024640585, 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1332 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297873+0000", 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9560000000000002e-06 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302007+0000", 2024-09-21T09:12:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041338299999999998 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302045+0000", 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7929000000000002e-05 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302062+0000", 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6844e-05 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302223+0000", 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000161232 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302631+0000", 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000408059 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.303057+0000", 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000425463 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.312222+0000", 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091652239999999996 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322385+0000", 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010163292000000001 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322455+0000", 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0104000000000005e-05 2024-09-21T09:12:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322511+0000", 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5652000000000002e-05 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1340 3.24 3:244553ef:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1538921799999997, 2024-09-21T09:12:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022132493999999999, 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1340 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460593+0000", 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7259999999999998e-06 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465499+0000", 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049057679999999996 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465546+0000", 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6692e-05 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465565+0000", 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9939e-05 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465709+0000", 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014318999999999999 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465937+0000", 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022867100000000001 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.466152+0000", 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000214637 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.473162+0000", 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070101199999999999 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482551+0000", 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093889520000000008 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482644+0000", 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2768000000000004e-05 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482723+0000", 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030999999999996e-05 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1347 3.25 3:a6a24497:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.0077565919999998, 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017645750000000002, 2024-09-21T09:12:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1347 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606730+0000", 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6069999999999999e-06 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611645+0000", 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049153929999999997 2024-09-21T09:12:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611688+0000", 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2658999999999999e-05 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611708+0000", 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.031e-05 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611908+0000", 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020053399999999999 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612168+0000", 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025985100000000002 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612436+0000", 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026782899999999997 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.619627+0000", 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071906119999999999 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624183+0000", 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045566000000000001 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624279+0000", 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6113000000000006e-05 2024-09-21T09:12:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624372+0000", 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2242000000000002e-05 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1348 3.5 e60/24 3:a2bfd640:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_105:head v 60'4, mlcod=60'2)", 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.634030+0000", 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9804529710000001, 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012882487999999999, 2024-09-21T09:12:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.634030+0000", 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.634030+0000", 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.634031+0000", 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.877e-06 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639106+0000", 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005074126 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639148+0000", 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1989000000000001e-05 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639170+0000", 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2592e-05 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639363+0000", 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019313199999999999 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639408+0000", 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4569e-05 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.646846+0000", 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074385800000000002 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.646912+0000", 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5623000000000005e-05 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1540 3.5 e61/24 3:a26ab227:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_9:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.083502974, 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018163744999999999, 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530982+0000", 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8169999999999999e-06 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538703+0000", 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077210630000000002 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538740+0000", 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6495000000000002e-05 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538759+0000", 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9259999999999999e-05 2024-09-21T09:12:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538893+0000", 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013350999999999999 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538936+0000", 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3046000000000001e-05 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549057+0000", 2024-09-21T09:12:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010120986 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549143+0000", 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6568000000000002e-05 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1550 3.1 3:83bb88f2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.9823934059999999, 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884271000000001, 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1550 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632093+0000", 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9859999999999996e-06 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638741+0000", 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066476859999999999 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638784+0000", 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2982999999999998e-05 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638802+0000", 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8026e-05 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638971+0000", 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016929600000000001 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639309+0000", 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000338315 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639731+0000", 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042143600000000002 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.652998+0000", 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013267187999999999 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654665+0000", 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001667106 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654849+0000", 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184212 2024-09-21T09:12:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654973+0000", 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012403699999999999 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1553 3.25 3:a4ab7629:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.950711246, 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019797014000000002, 2024-09-21T09:12:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1553 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663774+0000", 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7089999999999998e-06 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668592+0000", 2024-09-21T09:12:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048180580000000001 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668632+0000", 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9765999999999998e-05 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668648+0000", 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6460000000000002e-05 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668837+0000", 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018921500000000001 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669259+0000", 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042197600000000001 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669691+0000", 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043113599999999999 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683148+0000", 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013457184000000001 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683341+0000", 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019356899999999999 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683441+0000", 2024-09-21T09:12:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9777000000000004e-05 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683568+0000", 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127164 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1593 3.33 3:ccba01ee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.41475778299999999, 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034096062000000003, 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1593 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199727+0000", 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.616e-06 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210215+0000", 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010487918000000001 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210257+0000", 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1375999999999998e-05 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210284+0000", 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7630000000000001e-05 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210450+0000", 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016565899999999999 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210824+0000", 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037435799999999998 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.211233+0000", 2024-09-21T09:12:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040886699999999999 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223360+0000", 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012127012 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233490+0000", 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010129917 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233690+0000", 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019989199999999999 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233821+0000", 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000130817 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1601 3.1 3:80d10627:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.30173359999999999, 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018087450000000001, 2024-09-21T09:12:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1601 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312751+0000", 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.503e-06 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316621+0000", 2024-09-21T09:12:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038693740000000001 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316644+0000", 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3617000000000001e-05 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316657+0000", 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2213e-05 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316721+0000", 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4871999999999998e-05 2024-09-21T09:12:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316835+0000", 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113594 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316940+0000", 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010543 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.321841+0000", 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049003730000000004 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330736+0000", 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008894941 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330783+0000", 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6811000000000003e-05 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330836+0000", 2024-09-21T09:12:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3721999999999998e-05 2024-09-21T09:12:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:27.726 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:27.727 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:27.727 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:27.728 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:27.728 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:27.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:27.729 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:27.729 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:27.730 INFO:tasks.workunit.client.0.smithi007.stdout:Bucket Created: buck_2024_08_21_09_12_27 2024-09-21T09:12:27.730 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:27.730 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:27.730 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:27.731 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:27.731 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:27.723+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:27.742 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:27.742 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:27.828 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:27.823+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:27.909 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:27.909 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:27.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:27.929 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:27.927+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:28.029 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:28.027+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:28.052 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:28.052 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:28.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:28.131 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:28.127+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:28.196 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:28.196 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:28.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:28.232 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:28.228+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:28.333 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:28.328+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:28.347 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:28.347 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:28.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:28.434 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:28.428+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:28.490 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:28.490 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:28.504 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:28.531 INFO:tasks.workunit.client.0.smithi007.stderr:10+0 records in 2024-09-21T09:12:28.531 INFO:tasks.workunit.client.0.smithi007.stderr:10+0 records out 2024-09-21T09:12:28.531 INFO:tasks.workunit.client.0.smithi007.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.678208 s, 155 MB/s 2024-09-21T09:12:28.534 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:28.528+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:28.631 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:28.631 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:28.634 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:28.628+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:28.647 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:28.735 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:28.731+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:28.807 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:28.807 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:28.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:28.836 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:28.832+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:28.937 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:28.932+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:29.011 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:29.011 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:29.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:29.037 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:29.032+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:29.138 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:29.132+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:29.172 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:29.172 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:29.193 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:29.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T09:12:29.238 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:29.235+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:29.288 INFO:tasks.workunit.client.0.smithi007.stdout:quota enabled for the user 0.49028942624955 2024-09-21T09:12:29.289 INFO:tasks.workunit.client.0.smithi007.stdout:adding file to bucket buck_2024_08_21_09_12_27: 100Mb. 2024-09-21T09:12:29.289 INFO:tasks.workunit.client.0.smithi007.stdout:upload file successful 2024-09-21T09:12:29.289 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:29.289 INFO:tasks.workunit.client.0.smithi007.stdout:Test case: PASSED - user quota max size for 0.49028942624955 passed on 3 buckets 2024-09-21T09:12:29.289 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:29.311 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:29.311 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:29.326 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:29.338 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:29.332+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:29.439 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:29.432+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:29.448 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:29.448 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:29.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:29.540 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:29.535+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:29.581 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:29.581 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:29.596 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:29.637 INFO:tasks.workunit.client.0.smithi007.stdout:user 0.49028942624955 deleted 2024-09-21T09:12:29.685 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:29.683+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:29.742 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:29.736+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:29.753 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:29.754 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:29.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:29.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:29.823 INFO:tasks.workunit.client.0.smithi007.stdout:Bucket Created: buck_2024_08_21_09_12_29 2024-09-21T09:12:29.842 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:29.839+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:29.913 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:29.927 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:29.927 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:29.930 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:29.930 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:29.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:29.944 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:29.939+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:29.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:29.949 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:29.967 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:29.992 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:29.993 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:30.013 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:30.033 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:30.034 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:30.044 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:30.040+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:30.055 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:30.065 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:30.065 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1234 3.d 3:b2a8e85c:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:20.969813+0000", 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.0926259799999993, 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015476112, 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1234 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.969813+0000", 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.969813+0000", 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.969817+0000", 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2289999999999999e-06 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972407+0000", 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025901679999999999 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972437+0000", 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9955e-05 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972453+0000", 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5760000000000002e-05 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972551+0000", 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8505999999999995e-05 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972713+0000", 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016156499999999999 2024-09-21T09:12:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.972860+0000", 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000147255 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.985159+0000", 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012299203 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.985174+0000", 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4921e-05 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.985234+0000", 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0349000000000001e-05 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:20.985290+0000", 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5201000000000002e-05 2024-09-21T09:12:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1249 3.14 3:2ad301c5:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.045969+0000", 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.0164705590000001, 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.019155074000000001, 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1249 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.045969+0000", 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.045969+0000", 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.045973+0000", 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7900000000000001e-06 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.048237+0000", 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00226414 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.048279+0000", 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2506000000000003e-05 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.048305+0000", 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5449999999999999e-05 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.048483+0000", 2024-09-21T09:12:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017779800000000001 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.048817+0000", 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033483599999999998 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.049155+0000", 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033755200000000002 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.063690+0000", 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.01453526 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.065043+0000", 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001352535 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.065088+0000", 2024-09-21T09:12:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5213000000000002e-05 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.065124+0000", 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5994000000000001e-05 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1258 3.17 e60/24 3:e9fd25dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_15:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.152827+0000", 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.90961216, 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017562556999999999, 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.152827+0000", 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.152827+0000", 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.152828+0000", 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6300000000000004e-07 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.161027+0000", 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0081988970000000001 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.161047+0000", 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9653e-05 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.161054+0000", 2024-09-21T09:12:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5610000000000001e-06 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.161110+0000", 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5958000000000002e-05 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.161135+0000", 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4420999999999999e-05 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.170325+0000", 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091902640000000001 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.170390+0000", 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4939999999999998e-05 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1267 3.9 3:931159eb:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.243320+0000", 2024-09-21T09:12:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.8191192649999994, 2024-09-21T09:12:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017673600000000001, 2024-09-21T09:12:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1267 2024-09-21T09:12:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.243320+0000", 2024-09-21T09:12:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.243320+0000", 2024-09-21T09:12:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.243323+0000", 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.734e-06 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245009+0000", 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016861440000000001 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245041+0000", 2024-09-21T09:12:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1642e-05 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245052+0000", 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.181e-05 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245138+0000", 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5623000000000003e-05 2024-09-21T09:12:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245300+0000", 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016173199999999999 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.245453+0000", 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015279900000000001 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.251731+0000", 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062788560000000002 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.260877+0000", 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0091458630000000006 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.260941+0000", 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3936000000000006e-05 2024-09-21T09:12:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.260994+0000", 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2460999999999998e-05 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1301 3.1d 3:ba8f96da:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.679679+0000", 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.382760416, 2024-09-21T09:12:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.017094921999999999, 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1301 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.679679+0000", 2024-09-21T09:12:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.679679+0000", 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.679683+0000", 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8399999999999997e-06 2024-09-21T09:12:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.682833+0000", 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003150646 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.682873+0000", 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9821999999999999e-05 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.682890+0000", 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6637e-05 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.683057+0000", 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000167128 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.683300+0000", 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024265699999999999 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.683514+0000", 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000214615 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.691474+0000", 2024-09-21T09:12:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0079597660000000001 2024-09-21T09:12:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.696635+0000", 2024-09-21T09:12:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0051609020000000002 2024-09-21T09:12:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.696711+0000", 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5566000000000001e-05 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.696774+0000", 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3343000000000007e-05 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1307 3.30 3:0e012621:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.775950+0000", 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.2864894600000003, 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015980379999999999, 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1307 2024-09-21T09:12:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.775950+0000", 2024-09-21T09:12:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.775950+0000", 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.775954+0000", 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5559999999999999e-06 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.779002+0000", 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030481499999999999 2024-09-21T09:12:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.779043+0000", 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0918999999999999e-05 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.779062+0000", 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9123e-05 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.779249+0000", 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018697599999999999 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.779660+0000", 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041146500000000002 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.780040+0000", 2024-09-21T09:12:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037961599999999999 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.787855+0000", 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0078154750000000005 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.791781+0000", 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039261670000000004 2024-09-21T09:12:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.791866+0000", 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4250000000000001e-05 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.791930+0000", 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4683000000000004e-05 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1313 3.14 3:2980a0af:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.904130+0000", 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.1583094930000009, 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.018618775000000001, 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1313 2024-09-21T09:12:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.904130+0000", 2024-09-21T09:12:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.904130+0000", 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.904133+0000", 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5360000000000001e-06 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.907058+0000", 2024-09-21T09:12:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002924879 2024-09-21T09:12:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.907111+0000", 2024-09-21T09:12:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2676999999999997e-05 2024-09-21T09:12:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.907132+0000", 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1157000000000001e-05 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.907309+0000", 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000177109 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.907713+0000", 2024-09-21T09:12:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040353900000000001 2024-09-21T09:12:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.908129+0000", 2024-09-21T09:12:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041571499999999999 2024-09-21T09:12:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.917121+0000", 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0089928690000000006 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.922473+0000", 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053513839999999998 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.922656+0000", 2024-09-21T09:12:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000183148 2024-09-21T09:12:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.922749+0000", 2024-09-21T09:12:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2762000000000004e-05 2024-09-21T09:12:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1315 3.d 3:b14120c2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:21.941502+0000", 2024-09-21T09:12:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.1209377380000003, 2024-09-21T09:12:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.020772466999999999, 2024-09-21T09:12:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1315 2024-09-21T09:12:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.941502+0000", 2024-09-21T09:12:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.941502+0000", 2024-09-21T09:12:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.941506+0000", 2024-09-21T09:12:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3100000000000002e-06 2024-09-21T09:12:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.944695+0000", 2024-09-21T09:12:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031890730000000002 2024-09-21T09:12:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.944744+0000", 2024-09-21T09:12:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8708999999999997e-05 2024-09-21T09:12:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.944767+0000", 2024-09-21T09:12:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.351e-05 2024-09-21T09:12:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.944945+0000", 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000178204 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.945400+0000", 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045455499999999999 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.945848+0000", 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044811100000000001 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.953417+0000", 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0075691029999999998 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.962063+0000", 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0086456640000000008 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.962156+0000", 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3566000000000005e-05 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:21.962274+0000", 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000117662 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1318 3.2f 3:f4b1572d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.002007+0000", 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.0604320460000007, 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.016069502999999999, 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1318 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.002007+0000", 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.002007+0000", 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.002012+0000", 2024-09-21T09:12:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2760000000000002e-06 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006026+0000", 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040146490000000003 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006072+0000", 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5963e-05 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006100+0000", 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7457000000000002e-05 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006317+0000", 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000217417 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006580+0000", 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026252099999999999 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.006776+0000", 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019605499999999999 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.014808+0000", 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0080321469999999999 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.017968+0000", 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003159851 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.018027+0000", 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8987000000000003e-05 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.018077+0000", 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0179999999999997e-05 2024-09-21T09:12:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4367.0:1321 3.37 e60/24 3:ef44c02d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_78:head v 60'3, mlcod=59'1)", 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.075062+0000", 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.9873778680000003, 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.019875680999999999, 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.075062+0000", 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.075062+0000", 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.075064+0000", 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.903e-06 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.079688+0000", 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046240059999999999 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.079726+0000", 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7632000000000002e-05 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.079744+0000", 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8397e-05 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.079923+0000", 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000178741 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.080018+0000", 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4282000000000003e-05 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.094827+0000", 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.014809503999999999 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.094937+0000", 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000110216 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1325 3.2f 3:f4fe5e24:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.159821+0000", 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.9026186220000003, 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.018908983000000001, 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1325 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.159821+0000", 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.159821+0000", 2024-09-21T09:12:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.159825+0000", 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.313e-06 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163038+0000", 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032133190000000001 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163100+0000", 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2012000000000002e-05 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163130+0000", 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9297000000000001e-05 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163294+0000", 2024-09-21T09:12:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016418100000000001 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163604+0000", 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000310196 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.163930+0000", 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032566600000000001 2024-09-21T09:12:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.178227+0000", 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.014296737 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.178555+0000", 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032863899999999998 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.178651+0000", 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5972999999999997e-05 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.178730+0000", 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8650000000000001e-05 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1330 3.1d 3:b940fb57:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.254772+0000", 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.8076676769999995, 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.016515141000000001, 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1330 2024-09-21T09:12:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.254772+0000", 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.254772+0000", 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.254776+0000", 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2429999999999999e-06 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258083+0000", 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033070450000000002 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258142+0000", 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8712000000000003e-05 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258174+0000", 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1792999999999999e-05 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258341+0000", 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016761799999999999 2024-09-21T09:12:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258623+0000", 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000281857 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.258817+0000", 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019397500000000001 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.265620+0000", 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006802982 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.271200+0000", 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055796600000000002 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.271248+0000", 2024-09-21T09:12:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8479999999999997e-05 2024-09-21T09:12:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.271287+0000", 2024-09-21T09:12:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8776000000000003e-05 2024-09-21T09:12:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1334 3.d 3:b1129d38:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.337685+0000", 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.724754516, 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.014768049, 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1334 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.337685+0000", 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.337685+0000", 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.337688+0000", 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6840000000000001e-06 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.340625+0000", 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029372550000000002 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.340687+0000", 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1832e-05 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.340717+0000", 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0006999999999999e-05 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.340893+0000", 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000176439 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.341167+0000", 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027384399999999998 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.341467+0000", 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030046700000000001 2024-09-21T09:12:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.349535+0000", 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0080673729999999992 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.352315+0000", 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027806950000000001 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.352393+0000", 2024-09-21T09:12:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7263999999999998e-05 2024-09-21T09:12:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.352453+0000", 2024-09-21T09:12:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0189000000000003e-05 2024-09-21T09:12:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1341 3.30 3:0c933a22:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.481745+0000", 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.5806947109999996, 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015199446, 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1341 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.481745+0000", 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.481745+0000", 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.481748+0000", 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2389999999999998e-06 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484114+0000", 2024-09-21T09:12:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023658630000000002 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484159+0000", 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4879000000000002e-05 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484199+0000", 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0673000000000002e-05 2024-09-21T09:12:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484293+0000", 2024-09-21T09:12:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3286000000000001e-05 2024-09-21T09:12:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484492+0000", 2024-09-21T09:12:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000199311 2024-09-21T09:12:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.484619+0000", 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012670800000000001 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.491197+0000", 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.006578169 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.496637+0000", 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0054398190000000003 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.496825+0000", 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000188352 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.496944+0000", 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1346 3.1d 3:b8511b4a:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.581419+0000", 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.48102014, 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.018633033, 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1346 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.581419+0000", 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.581419+0000", 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.581422+0000", 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5160000000000001e-06 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.584199+0000", 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002777692 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.584244+0000", 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4767e-05 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.584265+0000", 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1137000000000001e-05 2024-09-21T09:12:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.584425+0000", 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015947300000000001 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.584742+0000", 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031674699999999998 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.585048+0000", 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030630300000000001 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.595833+0000", 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010785131999999999 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.599761+0000", 2024-09-21T09:12:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039277970000000002 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.599927+0000", 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000166181 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.600052+0000", 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012528800000000001 2024-09-21T09:12:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1353 3.28 3:16e0de94:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:22.708716+0000", 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.3537239019999996, 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.018892649000000001, 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1353 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.708716+0000", 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.708716+0000", 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.708718+0000", 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6479999999999999e-06 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.710742+0000", 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020235689999999998 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.710782+0000", 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0077999999999998e-05 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.710800+0000", 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7875000000000001e-05 2024-09-21T09:12:30.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.710881+0000", 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0882000000000003e-05 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.711029+0000", 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000148114 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:30.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.711127+0000", 2024-09-21T09:12:30.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8690000000000005e-05 2024-09-21T09:12:30.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.715628+0000", 2024-09-21T09:12:30.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045005549999999998 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.727474+0000", 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.011846478000000001 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.727550+0000", 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5178000000000004e-05 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:22.727608+0000", 2024-09-21T09:12:30.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8582000000000003e-05 2024-09-21T09:12:30.176 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.176 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.176 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.176 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1532 3.28 3:15768fe5:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:30.176 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:25.443098+0000", 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.6193415829999998, 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.019281034999999998, 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1532 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.443098+0000", 2024-09-21T09:12:30.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.443098+0000", 2024-09-21T09:12:30.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.443101+0000", 2024-09-21T09:12:30.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1580000000000001e-06 2024-09-21T09:12:30.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445209+0000", 2024-09-21T09:12:30.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021083719999999999 2024-09-21T09:12:30.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445239+0000", 2024-09-21T09:12:30.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9513e-05 2024-09-21T09:12:30.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445254+0000", 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5407e-05 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445326+0000", 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1717999999999993e-05 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445454+0000", 2024-09-21T09:12:30.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128295 2024-09-21T09:12:30.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:30.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.445562+0000", 2024-09-21T09:12:30.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107559 2024-09-21T09:12:30.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.451785+0000", 2024-09-21T09:12:30.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062227200000000002 2024-09-21T09:12:30.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.462257+0000", 2024-09-21T09:12:30.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010471960000000001 2024-09-21T09:12:30.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.462324+0000", 2024-09-21T09:12:30.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7957e-05 2024-09-21T09:12:30.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.462379+0000", 2024-09-21T09:12:30.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4376000000000003e-05 2024-09-21T09:12:30.184 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.185 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.185 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.185 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1546 3.1d 3:b8116d35:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:30.185 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:25.591903+0000", 2024-09-21T09:12:30.185 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4705362129999999, 2024-09-21T09:12:30.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.021960640999999999, 2024-09-21T09:12:30.185 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.186 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.186 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.186 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.186 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.186 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.186 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1546 2024-09-21T09:12:30.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.186 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.591903+0000", 2024-09-21T09:12:30.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.591903+0000", 2024-09-21T09:12:30.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.591907+0000", 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3560000000000001e-06 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.593829+0000", 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019223720000000001 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.593855+0000", 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5856000000000001e-05 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.593867+0000", 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1968e-05 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.593945+0000", 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8708999999999995e-05 2024-09-21T09:12:30.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.594118+0000", 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000172058 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.594278+0000", 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016031500000000001 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.601447+0000", 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0071693110000000003 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.613717+0000", 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.012270104 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.613786+0000", 2024-09-21T09:12:30.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8452000000000001e-05 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.613864+0000", 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8139999999999994e-05 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1547 3.22 3:44fd850b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:25.600685+0000", 2024-09-21T09:12:30.192 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4617539559999999, 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.019146303999999999, 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1547 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.600685+0000", 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.600685+0000", 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.600688+0000", 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2139999999999999e-06 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.602581+0000", 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018937310000000001 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.602609+0000", 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8062999999999999e-05 2024-09-21T09:12:30.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.602623+0000", 2024-09-21T09:12:30.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3555e-05 2024-09-21T09:12:30.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.602711+0000", 2024-09-21T09:12:30.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8358999999999999e-05 2024-09-21T09:12:30.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.602887+0000", 2024-09-21T09:12:30.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000175272 2024-09-21T09:12:30.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:30.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.603050+0000", 2024-09-21T09:12:30.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000163237 2024-09-21T09:12:30.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.610284+0000", 2024-09-21T09:12:30.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0072336620000000001 2024-09-21T09:12:30.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.619687+0000", 2024-09-21T09:12:30.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0094037800000000005 2024-09-21T09:12:30.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.619769+0000", 2024-09-21T09:12:30.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2074000000000001e-05 2024-09-21T09:12:30.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:25.619832+0000", 2024-09-21T09:12:30.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2356999999999999e-05 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4367.0:1598 3.22 3:44afe765:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2024-09-21T09:12:27.280041+0000", 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.7823984579999999, 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.015839341, 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: "continuous": false, 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2024-09-21T09:12:30.200 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2024-09-21T09:12:30.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4367", 2024-09-21T09:12:30.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.201 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1598 2024-09-21T09:12:30.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.201 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2024-09-21T09:12:30.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2024-09-21T09:12:30.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.280041+0000", 2024-09-21T09:12:30.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.280041+0000", 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.280043+0000", 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3309999999999998e-06 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.282786+0000", 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027430979999999998 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.282816+0000", 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9427000000000001e-05 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.282833+0000", 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6824e-05 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.282976+0000", 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014304000000000001 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.283294+0000", 2024-09-21T09:12:30.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000318494 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.283591+0000", 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029703200000000003 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.294176+0000", 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010584546 2024-09-21T09:12:30.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.295768+0000", 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015924769999999999 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.295831+0000", 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2571999999999997e-05 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T09:12:30.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2024-09-21T09:12:30.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2024-09-21T09:12:27.295880+0000", 2024-09-21T09:12:30.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9499999999999997e-05 2024-09-21T09:12:30.207 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.207 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.207 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.207 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T09:12:30.207 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T09:12:30.207 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:30.210 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-09-21T09:12:30.211 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:30.204+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:30.310 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:30.307+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:30.348 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:30.349 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:30.349 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:30.349 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:30.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:30.411 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:30.407+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:30.488 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:30.488 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:30.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:30.512 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:30.507+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:30.613 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:30.608+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:30.621 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:30.621 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1265 3.3a e60/24 3:5cfa63b7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_22:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3894293159999993, 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025518386000000001, 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:30.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:30.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230289+0000", 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1399999999999996e-07 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239530+0000", 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092409199999999997 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239574+0000", 2024-09-21T09:12:30.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4301999999999997e-05 2024-09-21T09:12:30.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239594+0000", 2024-09-21T09:12:30.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9559999999999999e-05 2024-09-21T09:12:30.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239779+0000", 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018548800000000001 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239846+0000", 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6897999999999995e-05 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255678+0000", 2024-09-21T09:12:30.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015831548000000001 2024-09-21T09:12:30.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255807+0000", 2024-09-21T09:12:30.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000128856 2024-09-21T09:12:30.627 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.627 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.627 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.628 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1267 3.9 e60/24 3:931159eb:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_24:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:30.628 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:30.628 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3735746219999996, 2024-09-21T09:12:30.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014928096, 2024-09-21T09:12:30.628 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.628 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.628 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.629 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:30.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:30.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246144+0000", 2024-09-21T09:12:30.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0669999999999999e-06 2024-09-21T09:12:30.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252177+0000", 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060330760000000001 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252211+0000", 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3822000000000002e-05 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252228+0000", 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7125999999999998e-05 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252379+0000", 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015065 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252417+0000", 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8665000000000003e-05 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.260976+0000", 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085584029999999992 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261071+0000", 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5286999999999998e-05 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1291 3.2 3:4203678b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.0868891650000005, 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015334344999999999, 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1291 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.634 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532834+0000", 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8329999999999999e-06 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537680+0000", 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048457689999999998 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537707+0000", 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7364000000000001e-05 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537721+0000", 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3935e-05 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537860+0000", 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000138646 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.538194+0000", 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033445799999999999 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.538521+0000", 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032673799999999997 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.546553+0000", 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080323600000000005 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.547994+0000", 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00144082 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.548087+0000", 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2627000000000006e-05 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.548163+0000", 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5795000000000002e-05 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.639 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1303 3.2b 3:d7a32023:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.9133595050000007, 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017871702999999999, 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.640 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1303 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706362+0000", 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1659999999999996e-06 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712782+0000", 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006419803 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712817+0000", 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5466000000000002e-05 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712838+0000", 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0919000000000001e-05 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712933+0000", 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4452999999999998e-05 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713042+0000", 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109304 2024-09-21T09:12:30.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713159+0000", 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011710299999999999 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.719777+0000", 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006617497 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724152+0000", 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043755240000000004 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724191+0000", 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8337999999999998e-05 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724230+0000", 2024-09-21T09:12:30.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.913e-05 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1304 3.2 3:40da9a43:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.8941656939999998, 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018044510999999999, 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.646 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1304 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725555+0000", 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.977e-06 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730352+0000", 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047973670000000003 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730394+0000", 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2199e-05 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730412+0000", 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7679000000000001e-05 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730524+0000", 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011182400000000001 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730728+0000", 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000204448 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730907+0000", 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000178753 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.736861+0000", 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059537629999999999 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743469+0000", 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066083970000000002 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743539+0000", 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9387000000000005e-05 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743596+0000", 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7717000000000003e-05 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1306 3.3d e60/24 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.8565876879999994, 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014663086000000001, 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:30.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763131+0000", 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2500000000000001e-06 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766744+0000", 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003613256 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766796+0000", 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1907999999999998e-05 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766820+0000", 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4097e-05 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766950+0000", 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129436 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766990+0000", 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9826000000000001e-05 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.777707+0000", 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010717232 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.777793+0000", 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6081000000000005e-05 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1319 3.1b 3:da10b4a0:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.5955478420000002, 2024-09-21T09:12:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020034222000000001, 2024-09-21T09:12:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1319 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024172+0000", 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6639999999999998e-06 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028099+0000", 2024-09-21T09:12:30.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039262639999999996 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028132+0000", 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3155999999999999e-05 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028146+0000", 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3835999999999999e-05 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028273+0000", 2024-09-21T09:12:30.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127436 2024-09-21T09:12:30.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028566+0000", 2024-09-21T09:12:30.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029305899999999997 2024-09-21T09:12:30.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028799+0000", 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023329399999999999 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.040586+0000", 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011786173 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044077+0000", 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034909429999999998 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044145+0000", 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8182000000000006e-05 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044204+0000", 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9215000000000001e-05 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1331 3.2b 3:d6dd70dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.3400957810000005, 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015879798000000001, 2024-09-21T09:12:30.665 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.666 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.666 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.666 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.666 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.666 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.666 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1331 2024-09-21T09:12:30.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.666 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279625+0000", 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.932e-06 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283705+0000", 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040801630000000004 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283748+0000", 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3216000000000001e-05 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283766+0000", 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7717e-05 2024-09-21T09:12:30.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283929+0000", 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016334800000000001 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.284333+0000", 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000404013 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.284775+0000", 2024-09-21T09:12:30.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044202199999999998 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.293797+0000", 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0090219979999999998 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295202+0000", 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001404977 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295378+0000", 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175656 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295502+0000", 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012375600000000001 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1335 3.39 e60/24 3:9e12c6c8:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_92:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:30.671 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.2534470899999999, 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014870665, 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366273+0000", 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0130000000000002e-06 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371450+0000", 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051763310000000002 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371486+0000", 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6684999999999999e-05 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371507+0000", 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0869999999999998e-05 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371672+0000", 2024-09-21T09:12:30.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016454600000000001 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371712+0000", 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0045e-05 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.381006+0000", 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092941480000000003 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.381141+0000", 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013502699999999999 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1360 3.19 3:9846b005:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.8339611549999999, 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022976068999999998, 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.676 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.677 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1360 2024-09-21T09:12:30.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.677 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785759+0000", 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0539999999999999e-06 2024-09-21T09:12:30.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792174+0000", 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064142349999999999 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792218+0000", 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4759000000000003e-05 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792239+0000", 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0931999999999999e-05 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792401+0000", 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016128900000000001 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792724+0000", 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032341200000000003 2024-09-21T09:12:30.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.793086+0000", 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000361751 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.800495+0000", 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074087129999999999 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808444+0000", 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079492120000000006 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808604+0000", 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015997900000000001 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808732+0000", 2024-09-21T09:12:30.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012873299999999999 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1372 3.2b 3:d4d898f8:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.6959877040000002, 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017677609, 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1372 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923732+0000", 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7489999999999999e-06 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927536+0000", 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038041720000000002 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927563+0000", 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7225000000000001e-05 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927578+0000", 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4955e-05 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927772+0000", 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019444199999999999 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.928019+0000", 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024669399999999999 2024-09-21T09:12:30.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.928268+0000", 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024846999999999998 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.936113+0000", 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078454619999999992 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941192+0000", 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050785589999999999 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941307+0000", 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115364 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941407+0000", 2024-09-21T09:12:30.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000100517 2024-09-21T09:12:30.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.689 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.689 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1534 3.2b 3:d47ba0a2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:30.689 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:30.689 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1542200530000004, 2024-09-21T09:12:30.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021807494, 2024-09-21T09:12:30.689 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1534 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:30.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465501+0000", 2024-09-21T09:12:30.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4860000000000002e-06 2024-09-21T09:12:30.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473846+0000", 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083450369999999996 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473888+0000", 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2079000000000001e-05 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473915+0000", 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7214000000000001e-05 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474073+0000", 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015771900000000001 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474356+0000", 2024-09-21T09:12:30.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028332999999999999 2024-09-21T09:12:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474593+0000", 2024-09-21T09:12:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023622000000000001 2024-09-21T09:12:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.486329+0000", 2024-09-21T09:12:30.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011736483000000001 2024-09-21T09:12:30.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487017+0000", 2024-09-21T09:12:30.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068800299999999997 2024-09-21T09:12:30.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487182+0000", 2024-09-21T09:12:30.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000164716 2024-09-21T09:12:30.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487305+0000", 2024-09-21T09:12:30.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012320699999999999 2024-09-21T09:12:30.696 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.696 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.696 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.697 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1536 3.3a e61/24 3:5db53460:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_5:head v 61'4, mlcod=60'2)", 2024-09-21T09:12:30.697 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:30.697 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1275069699999998, 2024-09-21T09:12:30.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015410841999999999, 2024-09-21T09:12:30.697 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.697 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.698 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:30.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:30.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492212+0000", 2024-09-21T09:12:30.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8929999999999999e-06 2024-09-21T09:12:30.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497695+0000", 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054820720000000002 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497726+0000", 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0991999999999997e-05 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497746+0000", 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0786999999999999e-05 2024-09-21T09:12:30.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497898+0000", 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151256 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497961+0000", 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3268000000000005e-05 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.507519+0000", 2024-09-21T09:12:30.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095583869999999998 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.507621+0000", 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102187 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1538 3.3c e61/24 3:3ebc624b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_7:head v 61'5, mlcod=60'3)", 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.511124+0000", 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1085931369999997, 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012629757, 2024-09-21T09:12:30.702 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.511124+0000", 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.511124+0000", 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.511127+0000", 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4360000000000001e-06 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515765+0000", 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046386350000000003 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515800+0000", 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4122999999999998e-05 2024-09-21T09:12:30.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515822+0000", 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2200000000000001e-05 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515993+0000", 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000171402 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.516040+0000", 2024-09-21T09:12:30.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199e-05 2024-09-21T09:12:30.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.523653+0000", 2024-09-21T09:12:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007612265 2024-09-21T09:12:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.523754+0000", 2024-09-21T09:12:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010149699999999999 2024-09-21T09:12:30.709 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1542 3.3d e61/24 3:bc2592c4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_11:head v 61'6, mlcod=60'4)", 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.557268+0000", 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.0624492910000001, 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013801205, 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557268+0000", 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557268+0000", 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557271+0000", 2024-09-21T09:12:30.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8159999999999998e-06 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560080+0000", 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002808868 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560121+0000", 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1084999999999997e-05 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560152+0000", 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0716000000000002e-05 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560333+0000", 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018096900000000001 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560422+0000", 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9425000000000005e-05 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.570720+0000", 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010297987999999999 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571069+0000", 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034933799999999998 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1545 3.2b 3:d625eaa7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.0349301080000002, 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017872958000000001, 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1545 2024-09-21T09:12:30.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584811+0000", 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3762000000000001e-05 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588898+0000", 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040866059999999996 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588937+0000", 2024-09-21T09:12:30.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9439e-05 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588956+0000", 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8340000000000001e-05 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589073+0000", 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0001175 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589331+0000", 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025805000000000001 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589555+0000", 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223525 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.600733+0000", 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011178250000000001 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602354+0000", 2024-09-21T09:12:30.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001621054 2024-09-21T09:12:30.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602536+0000", 2024-09-21T09:12:30.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018230500000000001 2024-09-21T09:12:30.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602660+0000", 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124127 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1549 3.1b 3:dae9f2a4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9981201879999997, 2024-09-21T09:12:30.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018896029000000002, 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1549 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621602+0000", 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9300000000000002e-06 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627034+0000", 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054319820000000001 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627076+0000", 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1492000000000002e-05 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627095+0000", 2024-09-21T09:12:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9636e-05 2024-09-21T09:12:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627245+0000", 2024-09-21T09:12:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014983299999999999 2024-09-21T09:12:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627542+0000", 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029642600000000002 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627779+0000", 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023740400000000001 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639133+0000", 2024-09-21T09:12:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011353667 2024-09-21T09:12:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640182+0000", 2024-09-21T09:12:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010494510000000001 2024-09-21T09:12:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640365+0000", 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018299500000000001 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640493+0000", 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012821299999999999 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1599 3.7 3:e3ccd4a9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:30.728 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.3303131490000002, 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017842754999999998, 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1599 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289408+0000", 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2629999999999999e-06 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294631+0000", 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052238329999999998 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294652+0000", 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0381e-05 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294663+0000", 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.095e-05 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294756+0000", 2024-09-21T09:12:30.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3329e-05 2024-09-21T09:12:30.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294975+0000", 2024-09-21T09:12:30.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000219256 2024-09-21T09:12:30.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.295187+0000", 2024-09-21T09:12:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021132400000000001 2024-09-21T09:12:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.306696+0000", 2024-09-21T09:12:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011508846 2024-09-21T09:12:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307149+0000", 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000453306 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307191+0000", 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2106e-05 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307247+0000", 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6161e-05 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1607 3.2b 3:d67827bf:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.2397918680000002, 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019045075000000002, 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1607 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379929+0000", 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0589999999999998e-06 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383914+0000", 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039857199999999999 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383957+0000", 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2962e-05 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383977+0000", 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9436000000000002e-05 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384091+0000", 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0001138 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384275+0000", 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000183983 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384458+0000", 2024-09-21T09:12:30.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000183723 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.390465+0000", 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060069199999999998 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398837+0000", 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083720530000000008 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398915+0000", 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8108999999999994e-05 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398971+0000", 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5309999999999997e-05 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1617 3.2 3:43f6ae7e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6_100Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.508282+0000", 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.111435626, 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01523673, 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1617 2024-09-21T09:12:30.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.508282+0000", 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.508282+0000", 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.508285+0000", 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6129999999999998e-06 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512338+0000", 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040529880000000004 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512395+0000", 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7741999999999997e-05 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512414+0000", 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9165999999999999e-05 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512504+0000", 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9506000000000007e-05 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512653+0000", 2024-09-21T09:12:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014948399999999999 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.513208+0000", 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055438299999999998 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.522213+0000", 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0090056010000000002 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.523412+0000", 2024-09-21T09:12:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011987009999999999 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.523475+0000", 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2593000000000002e-05 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.523519+0000", 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3952999999999997e-05 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:30.749 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:30.750 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:30.751 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:30.748+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:30.851 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:30.844+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:30.927 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:30.927 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:30.927 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:30.927 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:30.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:30.953 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:30.947+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:31.054 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:31.051+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:31.109 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:31.109 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:31.109 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:31.110 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:31.110 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:31.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:31.168 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:31.164+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:31.255 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:31.248+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:31.259 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:31.259 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:31.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:31.259 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:31.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.259 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1163 3.17 3:eb0740dd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:31.259 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:31.259 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.343699037, 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019360854, 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1163 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911569+0000", 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6460000000000002e-06 2024-09-21T09:12:31.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917121+0000", 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005551846 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917164+0000", 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2916e-05 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917183+0000", 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8508999999999998e-05 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917318+0000", 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013504200000000001 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917572+0000", 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025395300000000001 2024-09-21T09:12:31.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917798+0000", 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022648300000000001 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.929367+0000", 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011568729999999999 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930809+0000", 2024-09-21T09:12:31.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014424730000000001 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930883+0000", 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3910000000000002e-05 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930928+0000", 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4345999999999999e-05 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1235 3.18 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.27350532, 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028152907000000001, 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1235 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.266 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981763+0000", 2024-09-21T09:12:31.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7700000000000002e-06 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988006+0000", 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062426979999999997 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988042+0000", 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6461999999999998e-05 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988067+0000", 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4372999999999999e-05 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988210+0000", 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014307299999999999 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988480+0000", 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026992500000000002 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:31.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988718+0000", 2024-09-21T09:12:31.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023859400000000001 2024-09-21T09:12:31.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.002159+0000", 2024-09-21T09:12:31.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01344091 2024-09-21T09:12:31.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009749+0000", 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075900769999999998 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009840+0000", 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0736999999999995e-05 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009913+0000", 2024-09-21T09:12:31.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3287999999999994e-05 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1246 3.31 3:8d902261:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.254575877000001, 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022053738, 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.272 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1246 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000694+0000", 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2599999999999999e-06 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004867+0000", 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041723300000000001 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004920+0000", 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2985000000000002e-05 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004948+0000", 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8362999999999999e-05 2024-09-21T09:12:31.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005091+0000", 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000142903 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005381+0000", 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029025500000000001 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:31.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005674+0000", 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000292878 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.017583+0000", 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011908981000000001 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022585+0000", 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050024179999999998 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022674+0000", 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8486999999999995e-05 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022744+0000", 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9877999999999997e-05 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1250 3.0 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.198769017, 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026211538999999999, 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1250 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056500+0000", 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.18e-06 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061414+0000", 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049142930000000001 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061455+0000", 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0689000000000003e-05 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061475+0000", 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9760000000000001e-05 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061649+0000", 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000174308 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062062+0000", 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041290199999999998 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062448+0000", 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038618600000000001 2024-09-21T09:12:31.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.075288+0000", 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012839623999999999 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082540+0000", 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072523489999999999 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082633+0000", 2024-09-21T09:12:31.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3200000000000002e-05 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082708+0000", 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5048000000000004e-05 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1258 3.17 3:e9fd25dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:31.284 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.109041277999999, 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025293568999999998, 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1258 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:31.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146228+0000", 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8130000000000002e-06 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151893+0000", 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056641929999999997 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151937+0000", 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4768999999999998e-05 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151978+0000", 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0844999999999999e-05 2024-09-21T09:12:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152239+0000", 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026088000000000001 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152546+0000", 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000306905 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152815+0000", 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268912 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.165057+0000", 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012242368 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171206+0000", 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006148349 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171389+0000", 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018327799999999999 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171518+0000", 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129257 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1260 3.17 3:eb13e7c3:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.084114819, 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021083792000000001, 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1260 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171154+0000", 2024-09-21T09:12:31.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9040000000000001e-06 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176055+0000", 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049010299999999998 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176092+0000", 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6662000000000002e-05 2024-09-21T09:12:31.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176109+0000", 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7042999999999999e-05 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176228+0000", 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119747 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176521+0000", 2024-09-21T09:12:31.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029217499999999999 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176753+0000", 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023253299999999999 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.187711+0000", 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010958324 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192068+0000", 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043564989999999998 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192163+0000", 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.48e-05 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192235+0000", 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2075000000000004e-05 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1266 3.38 3:1db25443:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.020496586, 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018278652999999999, 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1266 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234772+0000", 2024-09-21T09:12:31.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5730000000000002e-06 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240589+0000", 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058167760000000001 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240661+0000", 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2358000000000001e-05 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240687+0000", 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5522000000000001e-05 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240897+0000", 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021069799999999999 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.241146+0000", 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024912600000000001 2024-09-21T09:12:31.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.241373+0000", 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022685399999999999 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.248615+0000", 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072417089999999998 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252728+0000", 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041126729999999998 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252915+0000", 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018731100000000001 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.253048+0000", 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000133053 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.302 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1272 3.29 3:963d269b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9577374990000003, 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019343672999999999, 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.303 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1272 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297532+0000", 2024-09-21T09:12:31.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-06 2024-09-21T09:12:31.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300259+0000", 2024-09-21T09:12:31.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027266579999999999 2024-09-21T09:12:31.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300306+0000", 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6748e-05 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300325+0000", 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9752999999999999e-05 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300489+0000", 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016374200000000001 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300746+0000", 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025647300000000001 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300967+0000", 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022157700000000001 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.309603+0000", 2024-09-21T09:12:31.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086360010000000008 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316784+0000", 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071809450000000002 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316833+0000", 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8949999999999997e-05 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316872+0000", 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1283 3.29 3:97ed8f1e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.8417907620000005, 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02166881, 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.309 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1283 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413478+0000", 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417497+0000", 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004018822 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417541+0000", 2024-09-21T09:12:31.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3961999999999997e-05 2024-09-21T09:12:31.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417568+0000", 2024-09-21T09:12:31.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6452999999999999e-05 2024-09-21T09:12:31.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417777+0000", 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020961499999999999 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418024+0000", 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000247159 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418257+0000", 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023203000000000001 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.427160+0000", 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089031600000000002 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435069+0000", 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079094850000000008 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435111+0000", 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1959000000000003e-05 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435144+0000", 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2815999999999999e-05 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1306 3.3d 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.497094594, 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020194347000000001, 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1306 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758174+0000", 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762157+0000", 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039825770000000002 2024-09-21T09:12:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762201+0000", 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4245000000000001e-05 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762220+0000", 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8808999999999999e-05 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762324+0000", 2024-09-21T09:12:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104033 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762588+0000", 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026391700000000001 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762811+0000", 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000222957 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.771599+0000", 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087878469999999997 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778144+0000", 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065449810000000001 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778244+0000", 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9901000000000005e-05 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778366+0000", 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012201000000000001 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1311 3.27 3:e6d5d281:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3962104059999998, 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024501067000000001, 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.322 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1311 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859057+0000", 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5149999999999999e-06 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862830+0000", 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037728620000000001 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862850+0000", 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0264000000000001e-05 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862859+0000", 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2189999999999993e-06 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863041+0000", 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018214899999999999 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863291+0000", 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024963299999999997 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863529+0000", 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023759000000000001 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.870237+0000", 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067083170000000001 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883389+0000", 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013151532 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883486+0000", 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7640999999999996e-05 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883557+0000", 2024-09-21T09:12:31.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0345000000000005e-05 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1317 3.3e 3:7ff9933d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.2745196330000006, 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018704327, 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.328 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1317 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980750+0000", 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0929999999999996e-06 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984763+0000", 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040130219999999998 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984810+0000", 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6579000000000002e-05 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984831+0000", 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1115999999999999e-05 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985053+0000", 2024-09-21T09:12:31.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022203699999999999 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985323+0000", 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026964900000000001 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985563+0000", 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023996299999999999 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.995589+0000", 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010026372 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999270+0000", 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036809500000000001 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999369+0000", 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9048000000000004e-05 2024-09-21T09:12:31.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999451+0000", 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1497999999999998e-05 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1359 3.3d 3:bc104684:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:31.334 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.478755306, 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020340127, 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1359 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776514+0000", 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8770000000000003e-06 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783654+0000", 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071395319999999996 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783702+0000", 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8449000000000003e-05 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783722+0000", 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9398999999999998e-05 2024-09-21T09:12:31.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783892+0000", 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017003 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784158+0000", 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026600899999999999 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784416+0000", 2024-09-21T09:12:31.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025767999999999999 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795150+0000", 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010734321 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795847+0000", 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00069705199999999998 2024-09-21T09:12:31.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796516+0000", 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066950600000000005 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796851+0000", 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033427199999999999 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.340 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1535 3.29 3:94169add:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7786806830000002, 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021366508999999999, 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1535 2024-09-21T09:12:31.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476590+0000", 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7269999999999998e-06 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483098+0000", 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065085480000000003 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483149+0000", 2024-09-21T09:12:31.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0726000000000002e-05 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483171+0000", 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1622999999999999e-05 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483359+0000", 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018774199999999999 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483790+0000", 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000431915 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.484215+0000", 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000424664 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.493337+0000", 2024-09-21T09:12:31.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091213739999999998 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497756+0000", 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044193039999999998 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497856+0000", 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9838000000000002e-05 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497952+0000", 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6047999999999999e-05 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1539 3.1f 3:f84f9343:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7346769269999998, 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017806683, 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.347 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1539 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520593+0000", 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5760000000000002e-06 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524577+0000", 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039848710000000001 2024-09-21T09:12:31.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524619+0000", 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1196000000000003e-05 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524638+0000", 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9219e-05 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524772+0000", 2024-09-21T09:12:31.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013400400000000001 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.525057+0000", 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028520599999999998 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.525312+0000", 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025493400000000001 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.532161+0000", 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068492040000000002 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538068+0000", 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059067579999999998 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538256+0000", 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000188285 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538396+0000", 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013943000000000001 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1542 3.3d 3:bc2592c4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7029918669999997, 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019304961999999998, 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.353 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1542 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552277+0000", 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2160000000000002e-06 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556307+0000", 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040297140000000002 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556345+0000", 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7996e-05 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556381+0000", 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6121999999999997e-05 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556519+0000", 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013799999999999999 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556785+0000", 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026605299999999998 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557027+0000", 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241905 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.564209+0000", 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071818280000000003 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571404+0000", 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071951100000000002 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571496+0000", 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2269999999999996e-05 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571579+0000", 2024-09-21T09:12:31.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2748000000000001e-05 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1543 3.1e 3:7938dd95:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.6935590300000003, 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020873849999999999, 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1543 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:31.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561710+0000", 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2499999999999998e-06 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567451+0000", 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005740864 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567493+0000", 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1851999999999998e-05 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567512+0000", 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-05 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567654+0000", 2024-09-21T09:12:31.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014127899999999999 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567918+0000", 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026440799999999999 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.568159+0000", 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240564 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.577966+0000", 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098075639999999995 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582419+0000", 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044529060000000004 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582514+0000", 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4438000000000006e-05 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582581+0000", 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7125000000000005e-05 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1594 3.1e 3:7b761948:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.042449811, 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.031784366000000001, 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1594 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212820+0000", 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0899999999999998e-06 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223204+0000", 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010383691 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223255+0000", 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1128000000000002e-05 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223283+0000", 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7523000000000001e-05 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223484+0000", 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149499999999999 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223901+0000", 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000417334 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224303+0000", 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040194699999999999 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.242455+0000", 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018151792999999999 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244504+0000", 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020487370000000001 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244559+0000", 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4959e-05 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244600+0000", 2024-09-21T09:12:31.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1668999999999997e-05 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1595 3.29 3:9443c179:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0307285820000001, 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020426626, 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1595 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224539+0000", 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.607e-06 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228447+0000", 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003908412 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228476+0000", 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9155000000000001e-05 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228488+0000", 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1274000000000001e-05 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228601+0000", 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113485 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228854+0000", 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025256399999999999 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.229066+0000", 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000212322 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.241625+0000", 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012559130999999999 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244748+0000", 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031230160000000002 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244898+0000", 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014988800000000001 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244964+0000", 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5772000000000007e-05 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1597 3.17 3:e845bb01:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.9892170460000003, 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022999776, 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1597 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:31.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266050+0000", 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.451e-06 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269917+0000", 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038665650000000002 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269941+0000", 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4465e-05 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269953+0000", 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2082000000000001e-05 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270023+0000", 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9733000000000005e-05 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270183+0000", 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016033200000000001 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270338+0000", 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015478399999999999 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.275262+0000", 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049237040000000001 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288908+0000", 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013646149 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288979+0000", 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1227000000000001e-05 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289049+0000", 2024-09-21T09:12:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9283999999999996e-05 2024-09-21T09:12:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.382 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:31.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:31.384 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:31.380+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:31.484 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:31.480+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:31.560 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:31.560 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:31.560 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:31.560 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:31.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:31.616 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:31.612+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:31.685 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:31.680+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:31.735 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:31.735 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:31.735 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:31.735 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:31.735 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:31.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:31.786 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:31.783+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:31.887 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:31.880+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:31.924 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:31.924 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:31.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1235 3.18 e59/24 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.932015939999999, 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020425276999999999, 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988949+0000", 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3659999999999999e-06 2024-09-21T09:12:31.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994552+0000", 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056024719999999998 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994598+0000", 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6365000000000001e-05 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994624+0000", 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6132e-05 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994804+0000", 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180209 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994849+0000", 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4838e-05 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009267+0000", 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014417780999999999 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009372+0000", 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105114 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1268 3.5 e60/24 3:a2dbcac0:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_25:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:31.929 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.257325+0000", 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.663637606, 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014256181, 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.257325+0000", 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.257325+0000", 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.257326+0000", 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8700000000000005e-07 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261877+0000", 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045506139999999997 2024-09-21T09:12:31.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261925+0000", 2024-09-21T09:12:31.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8118000000000002e-05 2024-09-21T09:12:31.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261944+0000", 2024-09-21T09:12:31.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9040000000000001e-05 2024-09-21T09:12:31.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.262128+0000", 2024-09-21T09:12:31.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184081 2024-09-21T09:12:31.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.262197+0000", 2024-09-21T09:12:31.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-21T09:12:31.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.271490+0000", 2024-09-21T09:12:31.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092929919999999999 2024-09-21T09:12:31.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.271581+0000", 2024-09-21T09:12:31.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1741000000000001e-05 2024-09-21T09:12:31.935 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.935 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1287 3.33 3:cd21f967:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.447465165000001, 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015957355999999999, 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.936 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1287 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473503+0000", 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7479999999999999e-06 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477595+0000", 2024-09-21T09:12:31.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040917059999999996 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477625+0000", 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9765e-05 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477637+0000", 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2439000000000001e-05 2024-09-21T09:12:31.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477738+0000", 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010084 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477862+0000", 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124201 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477961+0000", 2024-09-21T09:12:31.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8373000000000002e-05 2024-09-21T09:12:31.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.484421+0000", 2024-09-21T09:12:31.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064599890000000002 2024-09-21T09:12:31.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489327+0000", 2024-09-21T09:12:31.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049063270000000003 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489378+0000", 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0835999999999999e-05 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489455+0000", 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7132000000000006e-05 2024-09-21T09:12:31.942 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.943 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.943 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.943 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1290 3.32 3:4ee3f10c:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.943 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.517176+0000", 2024-09-21T09:12:31.943 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.403786480999999, 2024-09-21T09:12:31.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014261803999999999, 2024-09-21T09:12:31.943 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.944 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.944 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.944 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.944 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.944 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1290 2024-09-21T09:12:31.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.944 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.517176+0000", 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.517176+0000", 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.517196+0000", 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9323000000000001e-05 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.520982+0000", 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037866470000000002 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521012+0000", 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9658999999999998e-05 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521025+0000", 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3183000000000001e-05 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521128+0000", 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103269 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521249+0000", 2024-09-21T09:12:31.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012012599999999999 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521349+0000", 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000100694 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.530865+0000", 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095156249999999998 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.531347+0000", 2024-09-21T09:12:31.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048167199999999999 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.531395+0000", 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8760000000000001e-05 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.531438+0000", 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2846000000000003e-05 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.949 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1300 3.12 3:493715d7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.253741065, 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015508042999999999, 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1300 2024-09-21T09:12:31.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667225+0000", 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670749+0000", 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035240269999999999 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670777+0000", 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7506999999999999e-05 2024-09-21T09:12:31.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670791+0000", 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4215e-05 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670930+0000", 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000138591 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.671163+0000", 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023348800000000001 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.671376+0000", 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021324700000000001 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.678083+0000", 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067063239999999996 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682605+0000", 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045220870000000002 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682672+0000", 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7238999999999998e-05 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682730+0000", 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7970999999999998e-05 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1302 3.25 3:a46cad48:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.691784+0000", 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.229179235, 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014564102000000001, 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1302 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.691784+0000", 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.691784+0000", 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.691787+0000", 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6839999999999998e-06 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695687+0000", 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038992430000000002 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695722+0000", 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5573e-05 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695741+0000", 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8887000000000001e-05 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695837+0000", 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6032999999999993e-05 2024-09-21T09:12:31.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695992+0000", 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015526299999999999 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.696126+0000", 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013412499999999999 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.701430+0000", 2024-09-21T09:12:31.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053031049999999998 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706265+0000", 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004835743 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706310+0000", 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4255000000000002e-05 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706348+0000", 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8191000000000001e-05 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1312 3.b e60/24 3:d07beb3d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_69:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.033828286, 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015617013000000001, 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.962 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887136+0000", 2024-09-21T09:12:31.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.578e-06 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.891977+0000", 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048406509999999996 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892015+0000", 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7722000000000002e-05 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892032+0000", 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7405999999999999e-05 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892152+0000", 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119757 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892194+0000", 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2002000000000002e-05 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902665+0000", 2024-09-21T09:12:31.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010471543 2024-09-21T09:12:31.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902752+0000", 2024-09-21T09:12:31.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6353999999999993e-05 2024-09-21T09:12:31.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.966 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1316 3.5 e60/24 3:a3fa7fee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_73:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9579187010000005, 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016060771000000001, 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:31.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:31.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963046+0000", 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8729999999999999e-06 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968897+0000", 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058507289999999998 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968933+0000", 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6112000000000003e-05 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968953+0000", 2024-09-21T09:12:31.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9763e-05 2024-09-21T09:12:31.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.969113+0000", 2024-09-21T09:12:31.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016067800000000001 2024-09-21T09:12:31.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.969185+0000", 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1761999999999995e-05 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.978989+0000", 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098042709999999998 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.979105+0000", 2024-09-21T09:12:31.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011558299999999999 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1317 3.3e e60/24 3:7ff9933d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_74:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.985804+0000", 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9351590349999999, 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013205334000000001, 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985804+0000", 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985804+0000", 2024-09-21T09:12:31.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985806+0000", 2024-09-21T09:12:31.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1830000000000001e-06 2024-09-21T09:12:31.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990044+0000", 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042378559999999999 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990094+0000", 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0309000000000002e-05 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990122+0000", 2024-09-21T09:12:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7611999999999999e-05 2024-09-21T09:12:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990285+0000", 2024-09-21T09:12:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016361899999999999 2024-09-21T09:12:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990331+0000", 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5969e-05 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.998872+0000", 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085405559999999995 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999009+0000", 2024-09-21T09:12:31.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013723000000000001 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1323 3.12 3:4a999ff4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.8080592039999992, 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019594209000000001, 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1323 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112907+0000", 2024-09-21T09:12:31.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1e-06 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117323+0000", 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044160229999999998 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117368+0000", 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5105000000000003e-05 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117387+0000", 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.931e-05 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117571+0000", 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018423199999999999 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117976+0000", 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040424599999999998 2024-09-21T09:12:31.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.118414+0000", 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043875199999999999 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.131859+0000", 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013444621 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132294+0000", 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043466199999999999 2024-09-21T09:12:31.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132420+0000", 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012634699999999999 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132498+0000", 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7811000000000004e-05 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1332 3.33 3:cc16045e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.623092561, 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024640585, 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1332 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297873+0000", 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9560000000000002e-06 2024-09-21T09:12:31.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302007+0000", 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041338299999999998 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302045+0000", 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7929000000000002e-05 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302062+0000", 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6844e-05 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302223+0000", 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000161232 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302631+0000", 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000408059 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.303057+0000", 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000425463 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.312222+0000", 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091652239999999996 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322385+0000", 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010163292000000001 2024-09-21T09:12:31.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322455+0000", 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0104000000000005e-05 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322511+0000", 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5652000000000002e-05 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1340 3.24 3:244553ef:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.4603725690000005, 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022132493999999999, 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1340 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460593+0000", 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7259999999999998e-06 2024-09-21T09:12:31.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465499+0000", 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049057679999999996 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465546+0000", 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6692e-05 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465565+0000", 2024-09-21T09:12:31.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9939e-05 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465709+0000", 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014318999999999999 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465937+0000", 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022867100000000001 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:31.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.466152+0000", 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000214637 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.473162+0000", 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070101199999999999 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482551+0000", 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093889520000000008 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482644+0000", 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2768000000000004e-05 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482723+0000", 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030999999999996e-05 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1347 3.25 3:a6a24497:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3142369810000005, 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017645750000000002, 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1347 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:31.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606730+0000", 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6069999999999999e-06 2024-09-21T09:12:31.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611645+0000", 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049153929999999997 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611688+0000", 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2658999999999999e-05 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611708+0000", 2024-09-21T09:12:31.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.031e-05 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611908+0000", 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020053399999999999 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612168+0000", 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025985100000000002 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:32.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612436+0000", 2024-09-21T09:12:32.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026782899999999997 2024-09-21T09:12:32.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:32.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.619627+0000", 2024-09-21T09:12:32.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071906119999999999 2024-09-21T09:12:32.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624183+0000", 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045566000000000001 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624279+0000", 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6113000000000006e-05 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624372+0000", 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2242000000000002e-05 2024-09-21T09:12:32.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.003 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:32.003 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.003 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1348 3.5 e60/24 3:a2bfd640:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_105:head v 60'4, mlcod=60'2)", 2024-09-21T09:12:32.003 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.634030+0000", 2024-09-21T09:12:32.003 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.2869333600000008, 2024-09-21T09:12:32.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012882487999999999, 2024-09-21T09:12:32.003 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:32.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.634030+0000", 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.634030+0000", 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.634031+0000", 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.877e-06 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639106+0000", 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005074126 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:32.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639148+0000", 2024-09-21T09:12:32.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1989000000000001e-05 2024-09-21T09:12:32.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:32.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639170+0000", 2024-09-21T09:12:32.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2592e-05 2024-09-21T09:12:32.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:32.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639363+0000", 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019313199999999999 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639408+0000", 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4569e-05 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.646846+0000", 2024-09-21T09:12:32.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074385800000000002 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.646912+0000", 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5623000000000005e-05 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.008 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1540 3.5 e61/24 3:a26ab227:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_9:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.3899833629999998, 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018163744999999999, 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:32.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530982+0000", 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8169999999999999e-06 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:32.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538703+0000", 2024-09-21T09:12:32.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077210630000000002 2024-09-21T09:12:32.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:32.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538740+0000", 2024-09-21T09:12:32.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6495000000000002e-05 2024-09-21T09:12:32.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:32.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538759+0000", 2024-09-21T09:12:32.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9259999999999999e-05 2024-09-21T09:12:32.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:32.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538893+0000", 2024-09-21T09:12:32.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013350999999999999 2024-09-21T09:12:32.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:32.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538936+0000", 2024-09-21T09:12:32.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3046000000000001e-05 2024-09-21T09:12:32.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:32.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549057+0000", 2024-09-21T09:12:32.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010120986 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549143+0000", 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6568000000000002e-05 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1550 3.1 3:83bb88f2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:32.014 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.2888737949999998, 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884271000000001, 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1550 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:32.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632093+0000", 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9859999999999996e-06 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:32.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638741+0000", 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066476859999999999 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638784+0000", 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2982999999999998e-05 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638802+0000", 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8026e-05 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638971+0000", 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016929600000000001 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639309+0000", 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000338315 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639731+0000", 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042143600000000002 2024-09-21T09:12:32.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.652998+0000", 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013267187999999999 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654665+0000", 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001667106 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654849+0000", 2024-09-21T09:12:32.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184212 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654973+0000", 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012403699999999999 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1553 3.25 3:a4ab7629:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.2571916349999999, 2024-09-21T09:12:32.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019797014000000002, 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1553 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663774+0000", 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7089999999999998e-06 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:32.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668592+0000", 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048180580000000001 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668632+0000", 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9765999999999998e-05 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668648+0000", 2024-09-21T09:12:32.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6460000000000002e-05 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668837+0000", 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018921500000000001 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669259+0000", 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042197600000000001 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669691+0000", 2024-09-21T09:12:32.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043113599999999999 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683148+0000", 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013457184000000001 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683341+0000", 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019356899999999999 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:32.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683441+0000", 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9777000000000004e-05 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683568+0000", 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127164 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1593 3.33 3:ccba01ee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:32.026 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.7212381719999996, 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034096062000000003, 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1593 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:32.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199727+0000", 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.616e-06 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:32.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210215+0000", 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010487918000000001 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210257+0000", 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1375999999999998e-05 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210284+0000", 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7630000000000001e-05 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210450+0000", 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016565899999999999 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210824+0000", 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037435799999999998 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.211233+0000", 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040886699999999999 2024-09-21T09:12:32.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223360+0000", 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012127012 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233490+0000", 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010129917 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233690+0000", 2024-09-21T09:12:32.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019989199999999999 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233821+0000", 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000130817 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1601 3.1 3:80d10627:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6082139890000002, 2024-09-21T09:12:32.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018087450000000001, 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1601 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:32.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:32.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:32.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312751+0000", 2024-09-21T09:12:32.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.503e-06 2024-09-21T09:12:32.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316621+0000", 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038693740000000001 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316644+0000", 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3617000000000001e-05 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316657+0000", 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2213e-05 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316721+0000", 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4871999999999998e-05 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316835+0000", 2024-09-21T09:12:32.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113594 2024-09-21T09:12:32.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:32.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316940+0000", 2024-09-21T09:12:32.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010543 2024-09-21T09:12:32.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:32.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.321841+0000", 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049003730000000004 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330736+0000", 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008894941 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330783+0000", 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6811000000000003e-05 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330836+0000", 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3721999999999998e-05 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1614 3.24 3:25a4f5f7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.483105+0000", 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.4378581239999999, 2024-09-21T09:12:32.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013360077, 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1614 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.483105+0000", 2024-09-21T09:12:32.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:32.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.483105+0000", 2024-09-21T09:12:32.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:32.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:32.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.483107+0000", 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3879999999999998e-06 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.486908+0000", 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038010359999999998 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.486939+0000", 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1105000000000001e-05 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.486953+0000", 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.327e-05 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.487050+0000", 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7530999999999998e-05 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:32.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.487217+0000", 2024-09-21T09:12:32.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000166706 2024-09-21T09:12:32.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:32.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.487359+0000", 2024-09-21T09:12:32.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014268000000000001 2024-09-21T09:12:32.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:32.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.493135+0000", 2024-09-21T09:12:32.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057750259999999999 2024-09-21T09:12:32.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:32.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.496369+0000", 2024-09-21T09:12:32.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032342030000000002 2024-09-21T09:12:32.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:32.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.496420+0000", 2024-09-21T09:12:32.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0939000000000001e-05 2024-09-21T09:12:32.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:32.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:32.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:32.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.496465+0000", 2024-09-21T09:12:32.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5192999999999999e-05 2024-09-21T09:12:32.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.047 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:32.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:32.047 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:32.047 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:32.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:32.049 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:32.043+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:32.149 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:32.144+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:32.210 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:32.223 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:32.224 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:32.224 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:32.224 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:32.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T09:12:32.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:32.280 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:32.276+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:32.351 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:32.344+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:32.369 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:32.370 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:32.387 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:32.387 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:32.404 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:32.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:32.410 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:32.410 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:32.422 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:32.422 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:32.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:32.441 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:32.441 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:32.451 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:32.447+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:32.461 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:32.461 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:32.480 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:32.481 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:32.500 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:32.553 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:32.548+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:32.596 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:32.596 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:32.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:32.654 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:32.648+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:32.739 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:32.739 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:32.754 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:32.755 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:32.752+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:32.856 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:32.851+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:32.885 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:32.885 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:32.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:32.989 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:32.987+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:33.059 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:33.052+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:33.074 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:33.074 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:33.089 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:33.160 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:33.156+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:33.261 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:33.259+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:33.264 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:33.264 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:33.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:33.365 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:33.363+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:33.409 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-09-21T09:12:33.455 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:33.455 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:33.462 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:33.460+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:33.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:33.563 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:33.556+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:33.635 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:33.635 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:33.650 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:33.663 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:33.656+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:33.764 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:33.764+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:33.779 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:33.780 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:33.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:33.865 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:33.860+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:33.914 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:33.915 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:33.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:33.977 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:33.975+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:34.058 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:34.058 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:34.066 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:34.060+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:34.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:34.167 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:34.160+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:34.236 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:34.236 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:34.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:34.297 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:34.295+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:34.369 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:34.364+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:34.371 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:34.371 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:34.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:34.473 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:34.471+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:34.519 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:34.550 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:34.551 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:34.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:34.612 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:34.608+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:34.667 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:34.668 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:34.671 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:34.664+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:34.684 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:34.685 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:34.701 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:34.702 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:34.702 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:34.717 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:34.717 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:34.718 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:34.735 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:34.735 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:34.753 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:34.753 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:34.772 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:34.772 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:34.790 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:34.791 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:34.804 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:34.800+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:34.872 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:34.867+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:34.891 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:34.891 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:34.891 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:34.891 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:34.891 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:34.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:34.996 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:34.992+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:35.074 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:35.071+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:35.080 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1265 3.3a e60/24 3:5cfa63b7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_22:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.846476119, 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025518386000000001, 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.081 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230289+0000", 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1399999999999996e-07 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239530+0000", 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092409199999999997 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239574+0000", 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4301999999999997e-05 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239594+0000", 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9559999999999999e-05 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239779+0000", 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018548800000000001 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239846+0000", 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6897999999999995e-05 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255678+0000", 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015831548000000001 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255807+0000", 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000128856 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1267 3.9 e60/24 3:931159eb:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_24:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:35.085 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.830621425, 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014928096, 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:35.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246144+0000", 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0669999999999999e-06 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252177+0000", 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060330760000000001 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252211+0000", 2024-09-21T09:12:35.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3822000000000002e-05 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252228+0000", 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7125999999999998e-05 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252379+0000", 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015065 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252417+0000", 2024-09-21T09:12:35.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8665000000000003e-05 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.260976+0000", 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085584029999999992 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261071+0000", 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5286999999999998e-05 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1291 3.2 3:4203678b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.543935968, 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015334344999999999, 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1291 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532834+0000", 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8329999999999999e-06 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537680+0000", 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048457689999999998 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537707+0000", 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7364000000000001e-05 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537721+0000", 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3935e-05 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537860+0000", 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000138646 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.538194+0000", 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033445799999999999 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.538521+0000", 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032673799999999997 2024-09-21T09:12:35.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.546553+0000", 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080323600000000005 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.547994+0000", 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00144082 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.548087+0000", 2024-09-21T09:12:35.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2627000000000006e-05 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.548163+0000", 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5795000000000002e-05 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1303 3.2b 3:d7a32023:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.370406308, 2024-09-21T09:12:35.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017871702999999999, 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1303 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706362+0000", 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1659999999999996e-06 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712782+0000", 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006419803 2024-09-21T09:12:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712817+0000", 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5466000000000002e-05 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712838+0000", 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0919000000000001e-05 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712933+0000", 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4452999999999998e-05 2024-09-21T09:12:35.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713042+0000", 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109304 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713159+0000", 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011710299999999999 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.719777+0000", 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006617497 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724152+0000", 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043755240000000004 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724191+0000", 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8337999999999998e-05 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724230+0000", 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.913e-05 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1304 3.2 3:40da9a43:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.351212497000001, 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018044510999999999, 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.101 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1304 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725555+0000", 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.977e-06 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730352+0000", 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047973670000000003 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730394+0000", 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2199e-05 2024-09-21T09:12:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730412+0000", 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7679000000000001e-05 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730524+0000", 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011182400000000001 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730728+0000", 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000204448 2024-09-21T09:12:35.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730907+0000", 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000178753 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.736861+0000", 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059537629999999999 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743469+0000", 2024-09-21T09:12:35.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066083970000000002 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743539+0000", 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9387000000000005e-05 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743596+0000", 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7717000000000003e-05 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1306 3.3d e60/24 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.313634491, 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014663086000000001, 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763131+0000", 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2500000000000001e-06 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766744+0000", 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003613256 2024-09-21T09:12:35.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766796+0000", 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1907999999999998e-05 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766820+0000", 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4097e-05 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766950+0000", 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129436 2024-09-21T09:12:35.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766990+0000", 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9826000000000001e-05 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.777707+0000", 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010717232 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.777793+0000", 2024-09-21T09:12:35.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6081000000000005e-05 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1319 3.1b 3:da10b4a0:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.052594644999999, 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020034222000000001, 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1319 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024172+0000", 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6639999999999998e-06 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028099+0000", 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039262639999999996 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028132+0000", 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3155999999999999e-05 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028146+0000", 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3835999999999999e-05 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028273+0000", 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127436 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028566+0000", 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029305899999999997 2024-09-21T09:12:35.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028799+0000", 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023329399999999999 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.040586+0000", 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011786173 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044077+0000", 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034909429999999998 2024-09-21T09:12:35.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044145+0000", 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8182000000000006e-05 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044204+0000", 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9215000000000001e-05 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.116 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1331 3.2b 3:d6dd70dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.797142583999999, 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015879798000000001, 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1331 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279625+0000", 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.932e-06 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283705+0000", 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040801630000000004 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283748+0000", 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3216000000000001e-05 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283766+0000", 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7717e-05 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283929+0000", 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016334800000000001 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.284333+0000", 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000404013 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.284775+0000", 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044202199999999998 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.293797+0000", 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0090219979999999998 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295202+0000", 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001404977 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295378+0000", 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175656 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295502+0000", 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012375600000000001 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1335 3.39 e60/24 3:9e12c6c8:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_92:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.710493893000001, 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014870665, 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366273+0000", 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0130000000000002e-06 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371450+0000", 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051763310000000002 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371486+0000", 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6684999999999999e-05 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371507+0000", 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0869999999999998e-05 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371672+0000", 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016454600000000001 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371712+0000", 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0045e-05 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.381006+0000", 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092941480000000003 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.381141+0000", 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013502699999999999 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1360 3.19 3:9846b005:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.126 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.291007958, 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022976068999999998, 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1360 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785759+0000", 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0539999999999999e-06 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792174+0000", 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064142349999999999 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792218+0000", 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4759000000000003e-05 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792239+0000", 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0931999999999999e-05 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792401+0000", 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016128900000000001 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792724+0000", 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032341200000000003 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.793086+0000", 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000361751 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.800495+0000", 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074087129999999999 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808444+0000", 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079492120000000006 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808604+0000", 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015997900000000001 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808732+0000", 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012873299999999999 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1372 3.2b 3:d4d898f8:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.153034506999999, 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017677609, 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.132 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1372 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:35.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923732+0000", 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7489999999999999e-06 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927536+0000", 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038041720000000002 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927563+0000", 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7225000000000001e-05 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927578+0000", 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4955e-05 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927772+0000", 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019444199999999999 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.928019+0000", 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024669399999999999 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.928268+0000", 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024846999999999998 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.936113+0000", 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078454619999999992 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941192+0000", 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050785589999999999 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941307+0000", 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115364 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941407+0000", 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000100517 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.137 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1534 3.2b 3:d47ba0a2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.6112668560000003, 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021807494, 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1534 2024-09-21T09:12:35.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465501+0000", 2024-09-21T09:12:35.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4860000000000002e-06 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473846+0000", 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083450369999999996 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473888+0000", 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2079000000000001e-05 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473915+0000", 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7214000000000001e-05 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474073+0000", 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015771900000000001 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474356+0000", 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028332999999999999 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474593+0000", 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023622000000000001 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.486329+0000", 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011736483000000001 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487017+0000", 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068800299999999997 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487182+0000", 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000164716 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487305+0000", 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012320699999999999 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1536 3.3a e61/24 3:5db53460:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_5:head v 61'4, mlcod=60'2)", 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5845537729999997, 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015410841999999999, 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492212+0000", 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8929999999999999e-06 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497695+0000", 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054820720000000002 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497726+0000", 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0991999999999997e-05 2024-09-21T09:12:35.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497746+0000", 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0786999999999999e-05 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497898+0000", 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151256 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497961+0000", 2024-09-21T09:12:35.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3268000000000005e-05 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.507519+0000", 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095583869999999998 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.507621+0000", 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102187 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1538 3.3c e61/24 3:3ebc624b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_7:head v 61'5, mlcod=60'3)", 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.511124+0000", 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5656399400000005, 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012629757, 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.511124+0000", 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.511124+0000", 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.511127+0000", 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4360000000000001e-06 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515765+0000", 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046386350000000003 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515800+0000", 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4122999999999998e-05 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515822+0000", 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2200000000000001e-05 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.515993+0000", 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000171402 2024-09-21T09:12:35.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.516040+0000", 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199e-05 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.523653+0000", 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007612265 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.523754+0000", 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010149699999999999 2024-09-21T09:12:35.151 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1542 3.3d e61/24 3:bc2592c4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_11:head v 61'6, mlcod=60'4)", 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.557268+0000", 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5194960940000009, 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013801205, 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557268+0000", 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557268+0000", 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557271+0000", 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8159999999999998e-06 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560080+0000", 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002808868 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560121+0000", 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1084999999999997e-05 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560152+0000", 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0716000000000002e-05 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560333+0000", 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018096900000000001 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.560422+0000", 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9425000000000005e-05 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.570720+0000", 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010297987999999999 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571069+0000", 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034933799999999998 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1545 3.2b 3:d625eaa7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.4919769110000001, 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017872958000000001, 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.156 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1545 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584811+0000", 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3762000000000001e-05 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588898+0000", 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040866059999999996 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588937+0000", 2024-09-21T09:12:35.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9439e-05 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588956+0000", 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8340000000000001e-05 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589073+0000", 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0001175 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589331+0000", 2024-09-21T09:12:35.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025805000000000001 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589555+0000", 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223525 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.600733+0000", 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011178250000000001 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602354+0000", 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001621054 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602536+0000", 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018230500000000001 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602660+0000", 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124127 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1549 3.1b 3:dae9f2a4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.4551669910000005, 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018896029000000002, 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1549 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.162 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621602+0000", 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9300000000000002e-06 2024-09-21T09:12:35.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627034+0000", 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054319820000000001 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627076+0000", 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1492000000000002e-05 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627095+0000", 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9636e-05 2024-09-21T09:12:35.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627245+0000", 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014983299999999999 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627542+0000", 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029642600000000002 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627779+0000", 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023740400000000001 2024-09-21T09:12:35.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639133+0000", 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011353667 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640182+0000", 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010494510000000001 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640365+0000", 2024-09-21T09:12:35.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018299500000000001 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640493+0000", 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012821299999999999 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1599 3.7 3:e3ccd4a9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.7873599520000001, 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017842754999999998, 2024-09-21T09:12:35.167 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1599 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289408+0000", 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2629999999999999e-06 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294631+0000", 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052238329999999998 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294652+0000", 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0381e-05 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294663+0000", 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.095e-05 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294756+0000", 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3329e-05 2024-09-21T09:12:35.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294975+0000", 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000219256 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.295187+0000", 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021132400000000001 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.306696+0000", 2024-09-21T09:12:35.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011508846 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307149+0000", 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000453306 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307191+0000", 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2106e-05 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307247+0000", 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6161e-05 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1607 3.2b 3:d67827bf:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.6968386710000001, 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019045075000000002, 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.173 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1607 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379929+0000", 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0589999999999998e-06 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383914+0000", 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039857199999999999 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383957+0000", 2024-09-21T09:12:35.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2962e-05 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383977+0000", 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9436000000000002e-05 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384091+0000", 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0001138 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384275+0000", 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000183983 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384458+0000", 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000183723 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.390465+0000", 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060069199999999998 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398837+0000", 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083720530000000008 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398915+0000", 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8108999999999994e-05 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398971+0000", 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5309999999999997e-05 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.178 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1617 3.2 3:43f6ae7e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6_100Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.508282+0000", 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.5684824290000003, 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01523673, 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1617 2024-09-21T09:12:35.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.508282+0000", 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.508282+0000", 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.508285+0000", 2024-09-21T09:12:35.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6129999999999998e-06 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512338+0000", 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040529880000000004 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512395+0000", 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7741999999999997e-05 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512414+0000", 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9165999999999999e-05 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512504+0000", 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9506000000000007e-05 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512653+0000", 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014948399999999999 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.513208+0000", 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055438299999999998 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.522213+0000", 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0090056010000000002 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.523412+0000", 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011987009999999999 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.523475+0000", 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2593000000000002e-05 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.523519+0000", 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3952999999999997e-05 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.184 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:35.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:35.186 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:35.183+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:35.287 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:35.283+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:35.359 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:35.359 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:35.359 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:35.359 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:35.374 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:35.388 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:35.383+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:35.437 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T09:12:35.489 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:35.484+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:35.502 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:35.502 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:35.502 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:35.502 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:35.502 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:35.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:35.608 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:35.604+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:35.687 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1163 3.17 3:eb0740dd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:35.689 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:35.689 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.773967224, 2024-09-21T09:12:35.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019360854, 2024-09-21T09:12:35.689 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1163 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911569+0000", 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6460000000000002e-06 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917121+0000", 2024-09-21T09:12:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005551846 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917164+0000", 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2916e-05 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917183+0000", 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8508999999999998e-05 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917318+0000", 2024-09-21T09:12:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013504200000000001 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917572+0000", 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025395300000000001 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917798+0000", 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022648300000000001 2024-09-21T09:12:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.929367+0000", 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011568729999999999 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930809+0000", 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014424730000000001 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930883+0000", 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3910000000000002e-05 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930928+0000", 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4345999999999999e-05 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1235 3.18 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.703773506999999, 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028152907000000001, 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1235 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981763+0000", 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7700000000000002e-06 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988006+0000", 2024-09-21T09:12:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062426979999999997 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988042+0000", 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6461999999999998e-05 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988067+0000", 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4372999999999999e-05 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988210+0000", 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014307299999999999 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988480+0000", 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026992500000000002 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988718+0000", 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023859400000000001 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.002159+0000", 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01344091 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009749+0000", 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075900769999999998 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009840+0000", 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0736999999999995e-05 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009913+0000", 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3287999999999994e-05 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1246 3.31 3:8d902261:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.684844064, 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022053738, 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1246 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000694+0000", 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2599999999999999e-06 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004867+0000", 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041723300000000001 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004920+0000", 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2985000000000002e-05 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004948+0000", 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8362999999999999e-05 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005091+0000", 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000142903 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005381+0000", 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029025500000000001 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005674+0000", 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000292878 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.017583+0000", 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011908981000000001 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022585+0000", 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050024179999999998 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022674+0000", 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8486999999999995e-05 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022744+0000", 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9877999999999997e-05 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1250 3.0 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.629037203999999, 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026211538999999999, 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.707 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1250 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056500+0000", 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.18e-06 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061414+0000", 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049142930000000001 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061455+0000", 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0689000000000003e-05 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061475+0000", 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9760000000000001e-05 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061649+0000", 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000174308 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062062+0000", 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041290199999999998 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062448+0000", 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038618600000000001 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.075288+0000", 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012839623999999999 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082540+0000", 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072523489999999999 2024-09-21T09:12:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082633+0000", 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3200000000000002e-05 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082708+0000", 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5048000000000004e-05 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1258 3.17 3:e9fd25dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.539309465000001, 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025293568999999998, 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1258 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146228+0000", 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8130000000000002e-06 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151893+0000", 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056641929999999997 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151937+0000", 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4768999999999998e-05 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151978+0000", 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0844999999999999e-05 2024-09-21T09:12:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152239+0000", 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026088000000000001 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152546+0000", 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000306905 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152815+0000", 2024-09-21T09:12:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268912 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.165057+0000", 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012242368 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171206+0000", 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006148349 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171389+0000", 2024-09-21T09:12:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018327799999999999 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171518+0000", 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129257 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1260 3.17 3:eb13e7c3:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.514383005999999, 2024-09-21T09:12:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021083792000000001, 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1260 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171154+0000", 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9040000000000001e-06 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176055+0000", 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049010299999999998 2024-09-21T09:12:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176092+0000", 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6662000000000002e-05 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176109+0000", 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7042999999999999e-05 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176228+0000", 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119747 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176521+0000", 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029217499999999999 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176753+0000", 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023253299999999999 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.187711+0000", 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010958324 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192068+0000", 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043564989999999998 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192163+0000", 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.48e-05 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192235+0000", 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2075000000000004e-05 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1266 3.38 3:1db25443:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.450764773, 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018278652999999999, 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1266 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234772+0000", 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5730000000000002e-06 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240589+0000", 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058167760000000001 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240661+0000", 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2358000000000001e-05 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240687+0000", 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5522000000000001e-05 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240897+0000", 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021069799999999999 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.241146+0000", 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024912600000000001 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.241373+0000", 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022685399999999999 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.248615+0000", 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072417089999999998 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252728+0000", 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041126729999999998 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252915+0000", 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018731100000000001 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.253048+0000", 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000133053 2024-09-21T09:12:35.729 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1272 3.29 3:963d269b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.388005686, 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019343672999999999, 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.730 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1272 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297532+0000", 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-06 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300259+0000", 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027266579999999999 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300306+0000", 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6748e-05 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300325+0000", 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9752999999999999e-05 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300489+0000", 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016374200000000001 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300746+0000", 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025647300000000001 2024-09-21T09:12:35.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300967+0000", 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022157700000000001 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.309603+0000", 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086360010000000008 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316784+0000", 2024-09-21T09:12:35.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071809450000000002 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316833+0000", 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8949999999999997e-05 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316872+0000", 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1283 3.29 3:97ed8f1e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.272058949, 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02166881, 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1283 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413478+0000", 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417497+0000", 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004018822 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417541+0000", 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3961999999999997e-05 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417568+0000", 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6452999999999999e-05 2024-09-21T09:12:35.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417777+0000", 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020961499999999999 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418024+0000", 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000247159 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418257+0000", 2024-09-21T09:12:35.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023203000000000001 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.427160+0000", 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089031600000000002 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435069+0000", 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079094850000000008 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435111+0000", 2024-09-21T09:12:35.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1959000000000003e-05 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435144+0000", 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2815999999999999e-05 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1306 3.3d 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.927362780999999, 2024-09-21T09:12:35.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020194347000000001, 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1306 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758174+0000", 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762157+0000", 2024-09-21T09:12:35.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039825770000000002 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762201+0000", 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4245000000000001e-05 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762220+0000", 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8808999999999999e-05 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762324+0000", 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104033 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762588+0000", 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026391700000000001 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762811+0000", 2024-09-21T09:12:35.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000222957 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.771599+0000", 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087878469999999997 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778144+0000", 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065449810000000001 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778244+0000", 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9901000000000005e-05 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778366+0000", 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012201000000000001 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1311 3.27 3:e6d5d281:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.826478593000001, 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024501067000000001, 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1311 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:35.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859057+0000", 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5149999999999999e-06 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862830+0000", 2024-09-21T09:12:35.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037728620000000001 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862850+0000", 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0264000000000001e-05 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862859+0000", 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2189999999999993e-06 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863041+0000", 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018214899999999999 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863291+0000", 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024963299999999997 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863529+0000", 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023759000000000001 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.870237+0000", 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067083170000000001 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883389+0000", 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013151532 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883486+0000", 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7640999999999996e-05 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883557+0000", 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0345000000000005e-05 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1317 3.3e 3:7ff9933d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.70478782, 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018704327, 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.753 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1317 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980750+0000", 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0929999999999996e-06 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984763+0000", 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040130219999999998 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984810+0000", 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6579000000000002e-05 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984831+0000", 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1115999999999999e-05 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985053+0000", 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022203699999999999 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985323+0000", 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026964900000000001 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985563+0000", 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023996299999999999 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.995589+0000", 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010026372 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999270+0000", 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036809500000000001 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999369+0000", 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9048000000000004e-05 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999451+0000", 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1497999999999998e-05 2024-09-21T09:12:35.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1359 3.3d 3:bc104684:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.909023492999999, 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020340127, 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.759 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1359 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776514+0000", 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8770000000000003e-06 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783654+0000", 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071395319999999996 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783702+0000", 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8449000000000003e-05 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783722+0000", 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9398999999999998e-05 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783892+0000", 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017003 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784158+0000", 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026600899999999999 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784416+0000", 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025767999999999999 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795150+0000", 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010734321 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795847+0000", 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00069705199999999998 2024-09-21T09:12:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796516+0000", 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066950600000000005 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796851+0000", 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033427199999999999 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.764 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1535 3.29 3:94169add:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.20894887, 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021366508999999999, 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1535 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476590+0000", 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7269999999999998e-06 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483098+0000", 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065085480000000003 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483149+0000", 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0726000000000002e-05 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483171+0000", 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1622999999999999e-05 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483359+0000", 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018774199999999999 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483790+0000", 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000431915 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.484215+0000", 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000424664 2024-09-21T09:12:35.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.493337+0000", 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091213739999999998 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497756+0000", 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044193039999999998 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497856+0000", 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9838000000000002e-05 2024-09-21T09:12:35.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497952+0000", 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6047999999999999e-05 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1539 3.1f 3:f84f9343:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.164945114, 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017806683, 2024-09-21T09:12:35.770 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1539 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520593+0000", 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5760000000000002e-06 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524577+0000", 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039848710000000001 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524619+0000", 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1196000000000003e-05 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524638+0000", 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9219e-05 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524772+0000", 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013400400000000001 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.525057+0000", 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028520599999999998 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.525312+0000", 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025493400000000001 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.532161+0000", 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068492040000000002 2024-09-21T09:12:35.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538068+0000", 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059067579999999998 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538256+0000", 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000188285 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538396+0000", 2024-09-21T09:12:35.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013943000000000001 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1542 3.3d 3:bc2592c4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.133260054000001, 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019304961999999998, 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.776 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1542 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552277+0000", 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2160000000000002e-06 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556307+0000", 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040297140000000002 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556345+0000", 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7996e-05 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556381+0000", 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6121999999999997e-05 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556519+0000", 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013799999999999999 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556785+0000", 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026605299999999998 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557027+0000", 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241905 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.564209+0000", 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071818280000000003 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571404+0000", 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071951100000000002 2024-09-21T09:12:35.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571496+0000", 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2269999999999996e-05 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571579+0000", 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2748000000000001e-05 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.781 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1543 3.1e 3:7938dd95:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.123827217000001, 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020873849999999999, 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1543 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561710+0000", 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2499999999999998e-06 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567451+0000", 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005740864 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567493+0000", 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1851999999999998e-05 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567512+0000", 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-05 2024-09-21T09:12:35.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567654+0000", 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014127899999999999 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567918+0000", 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026440799999999999 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.568159+0000", 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240564 2024-09-21T09:12:35.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.577966+0000", 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098075639999999995 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582419+0000", 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044529060000000004 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582514+0000", 2024-09-21T09:12:35.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4438000000000006e-05 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582581+0000", 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7125000000000005e-05 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1594 3.1e 3:7b761948:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.4727179980000003, 2024-09-21T09:12:35.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.031784366000000001, 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1594 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212820+0000", 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0899999999999998e-06 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223204+0000", 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010383691 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223255+0000", 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1128000000000002e-05 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223283+0000", 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7523000000000001e-05 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223484+0000", 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149499999999999 2024-09-21T09:12:35.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223901+0000", 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000417334 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224303+0000", 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040194699999999999 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.242455+0000", 2024-09-21T09:12:35.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018151792999999999 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244504+0000", 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020487370000000001 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244559+0000", 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4959e-05 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244600+0000", 2024-09-21T09:12:35.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1668999999999997e-05 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1595 3.29 3:9443c179:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.4609967689999994, 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020426626, 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.793 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1595 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224539+0000", 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.607e-06 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228447+0000", 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003908412 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228476+0000", 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9155000000000001e-05 2024-09-21T09:12:35.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228488+0000", 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1274000000000001e-05 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228601+0000", 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113485 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228854+0000", 2024-09-21T09:12:35.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025256399999999999 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.229066+0000", 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000212322 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.241625+0000", 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012559130999999999 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244748+0000", 2024-09-21T09:12:35.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031230160000000002 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244898+0000", 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014988800000000001 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244964+0000", 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5772000000000007e-05 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1597 3.17 3:e845bb01:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.4194852329999996, 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022999776, 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1597 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:35.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266050+0000", 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.451e-06 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269917+0000", 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038665650000000002 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269941+0000", 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4465e-05 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269953+0000", 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2082000000000001e-05 2024-09-21T09:12:35.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270023+0000", 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9733000000000005e-05 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270183+0000", 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016033200000000001 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270338+0000", 2024-09-21T09:12:35.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015478399999999999 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.275262+0000", 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049237040000000001 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288908+0000", 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013646149 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288979+0000", 2024-09-21T09:12:35.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1227000000000001e-05 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289049+0000", 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9283999999999996e-05 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:35.804 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:35.805 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:35.806 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:35.804+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:35.907 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:35.904+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:35.982 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:35.982 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:35.982 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:35.982 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:35.997 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:36.008 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:36.003+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:36.108 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:36.108+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:36.168 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:36.169 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:36.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:36.237 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:36.236+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:36.314 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:36.311+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:36.369 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:36.370 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:36.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:36.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:36.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.370 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1235 3.18 e59/24 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:36.370 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:36.370 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.376608414, 2024-09-21T09:12:36.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020425276999999999, 2024-09-21T09:12:36.370 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:36.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988949+0000", 2024-09-21T09:12:36.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3659999999999999e-06 2024-09-21T09:12:36.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994552+0000", 2024-09-21T09:12:36.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056024719999999998 2024-09-21T09:12:36.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994598+0000", 2024-09-21T09:12:36.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6365000000000001e-05 2024-09-21T09:12:36.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994624+0000", 2024-09-21T09:12:36.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6132e-05 2024-09-21T09:12:36.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994804+0000", 2024-09-21T09:12:36.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180209 2024-09-21T09:12:36.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994849+0000", 2024-09-21T09:12:36.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4838e-05 2024-09-21T09:12:36.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009267+0000", 2024-09-21T09:12:36.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014417780999999999 2024-09-21T09:12:36.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009372+0000", 2024-09-21T09:12:36.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105114 2024-09-21T09:12:36.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.377 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.378 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1268 3.5 e60/24 3:a2dbcac0:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_25:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:36.378 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.257325+0000", 2024-09-21T09:12:36.378 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.10823008, 2024-09-21T09:12:36.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014256181, 2024-09-21T09:12:36.378 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.379 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.379 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.257325+0000", 2024-09-21T09:12:36.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.257325+0000", 2024-09-21T09:12:36.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.257326+0000", 2024-09-21T09:12:36.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8700000000000005e-07 2024-09-21T09:12:36.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261877+0000", 2024-09-21T09:12:36.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045506139999999997 2024-09-21T09:12:36.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261925+0000", 2024-09-21T09:12:36.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8118000000000002e-05 2024-09-21T09:12:36.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261944+0000", 2024-09-21T09:12:36.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9040000000000001e-05 2024-09-21T09:12:36.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.262128+0000", 2024-09-21T09:12:36.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184081 2024-09-21T09:12:36.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.262197+0000", 2024-09-21T09:12:36.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-21T09:12:36.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.271490+0000", 2024-09-21T09:12:36.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092929919999999999 2024-09-21T09:12:36.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.271581+0000", 2024-09-21T09:12:36.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1741000000000001e-05 2024-09-21T09:12:36.387 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.387 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.387 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.387 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1287 3.33 3:cd21f967:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:36.388 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:36.388 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.892057639000001, 2024-09-21T09:12:36.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015957355999999999, 2024-09-21T09:12:36.388 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.388 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.388 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.388 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.388 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.389 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1287 2024-09-21T09:12:36.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.389 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:36.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:36.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473503+0000", 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7479999999999999e-06 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477595+0000", 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040917059999999996 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477625+0000", 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9765e-05 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477637+0000", 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2439000000000001e-05 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477738+0000", 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010084 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477862+0000", 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124201 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477961+0000", 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8373000000000002e-05 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.484421+0000", 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064599890000000002 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489327+0000", 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049063270000000003 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489378+0000", 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0835999999999999e-05 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489455+0000", 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7132000000000006e-05 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1290 3.32 3:4ee3f10c:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.517176+0000", 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.848378954999999, 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014261803999999999, 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.395 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.396 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.396 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.396 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.396 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.396 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1290 2024-09-21T09:12:36.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.396 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.517176+0000", 2024-09-21T09:12:36.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.517176+0000", 2024-09-21T09:12:36.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.517196+0000", 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9323000000000001e-05 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.520982+0000", 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037866470000000002 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521012+0000", 2024-09-21T09:12:36.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9658999999999998e-05 2024-09-21T09:12:36.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521025+0000", 2024-09-21T09:12:36.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3183000000000001e-05 2024-09-21T09:12:36.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521128+0000", 2024-09-21T09:12:36.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103269 2024-09-21T09:12:36.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521249+0000", 2024-09-21T09:12:36.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012012599999999999 2024-09-21T09:12:36.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:36.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.521349+0000", 2024-09-21T09:12:36.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000100694 2024-09-21T09:12:36.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.530865+0000", 2024-09-21T09:12:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095156249999999998 2024-09-21T09:12:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.531347+0000", 2024-09-21T09:12:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00048167199999999999 2024-09-21T09:12:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.531395+0000", 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8760000000000001e-05 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.531438+0000", 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2846000000000003e-05 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1300 3.12 3:493715d7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.698333539, 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015508042999999999, 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1300 2024-09-21T09:12:36.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667225+0000", 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670749+0000", 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035240269999999999 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670777+0000", 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7506999999999999e-05 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670791+0000", 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4215e-05 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670930+0000", 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000138591 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.671163+0000", 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023348800000000001 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.671376+0000", 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021324700000000001 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.678083+0000", 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067063239999999996 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682605+0000", 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045220870000000002 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682672+0000", 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7238999999999998e-05 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682730+0000", 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7970999999999998e-05 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.414 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1302 3.25 3:a46cad48:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.691784+0000", 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.673771709, 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014564102000000001, 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1302 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.691784+0000", 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.691784+0000", 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.691787+0000", 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6839999999999998e-06 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695687+0000", 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038992430000000002 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695722+0000", 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5573e-05 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695741+0000", 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8887000000000001e-05 2024-09-21T09:12:36.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695837+0000", 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6032999999999993e-05 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.695992+0000", 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015526299999999999 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.696126+0000", 2024-09-21T09:12:36.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013412499999999999 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.701430+0000", 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053031049999999998 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706265+0000", 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004835743 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706310+0000", 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4255000000000002e-05 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706348+0000", 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8191000000000001e-05 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1312 3.b e60/24 3:d07beb3d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_69:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:36.420 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.478420760000001, 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015617013000000001, 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:36.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887136+0000", 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.578e-06 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.891977+0000", 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048406509999999996 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892015+0000", 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7722000000000002e-05 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892032+0000", 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7405999999999999e-05 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892152+0000", 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119757 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892194+0000", 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2002000000000002e-05 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902665+0000", 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010471543 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902752+0000", 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6353999999999993e-05 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1316 3.5 e60/24 3:a3fa7fee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_73:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.402511175000001, 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016060771000000001, 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963046+0000", 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8729999999999999e-06 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968897+0000", 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058507289999999998 2024-09-21T09:12:36.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968933+0000", 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6112000000000003e-05 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968953+0000", 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9763e-05 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.969113+0000", 2024-09-21T09:12:36.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016067800000000001 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.969185+0000", 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1761999999999995e-05 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.978989+0000", 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098042709999999998 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.979105+0000", 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011558299999999999 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1317 3.3e e60/24 3:7ff9933d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_74:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.985804+0000", 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.379751509, 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013205334000000001, 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.429 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985804+0000", 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985804+0000", 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985806+0000", 2024-09-21T09:12:36.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1830000000000001e-06 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990044+0000", 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042378559999999999 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990094+0000", 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0309000000000002e-05 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990122+0000", 2024-09-21T09:12:36.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7611999999999999e-05 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990285+0000", 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016361899999999999 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.990331+0000", 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5969e-05 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.998872+0000", 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085405559999999995 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999009+0000", 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013723000000000001 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1323 3.12 3:4a999ff4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.252651677999999, 2024-09-21T09:12:36.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019594209000000001, 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1323 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112907+0000", 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1e-06 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117323+0000", 2024-09-21T09:12:36.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044160229999999998 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117368+0000", 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5105000000000003e-05 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117387+0000", 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.931e-05 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117571+0000", 2024-09-21T09:12:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018423199999999999 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117976+0000", 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040424599999999998 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.118414+0000", 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043875199999999999 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.131859+0000", 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013444621 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132294+0000", 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043466199999999999 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132420+0000", 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012634699999999999 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132498+0000", 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7811000000000004e-05 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1332 3.33 3:cc16045e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.067685035, 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024640585, 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.439 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1332 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:36.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297873+0000", 2024-09-21T09:12:36.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9560000000000002e-06 2024-09-21T09:12:36.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302007+0000", 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041338299999999998 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302045+0000", 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7929000000000002e-05 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302062+0000", 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6844e-05 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302223+0000", 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000161232 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302631+0000", 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000408059 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.303057+0000", 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000425463 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.312222+0000", 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091652239999999996 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322385+0000", 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010163292000000001 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322455+0000", 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0104000000000005e-05 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322511+0000", 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5652000000000002e-05 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1340 3.24 3:244553ef:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:36.446 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.904965043000001, 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022132493999999999, 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1340 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460593+0000", 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7259999999999998e-06 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465499+0000", 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049057679999999996 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465546+0000", 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6692e-05 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465565+0000", 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9939e-05 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465709+0000", 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014318999999999999 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465937+0000", 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022867100000000001 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.466152+0000", 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000214637 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.473162+0000", 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070101199999999999 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482551+0000", 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093889520000000008 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482644+0000", 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2768000000000004e-05 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482723+0000", 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030999999999996e-05 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1347 3.25 3:a6a24497:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.758829455000001, 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017645750000000002, 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1347 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606730+0000", 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6069999999999999e-06 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611645+0000", 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049153929999999997 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611688+0000", 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2658999999999999e-05 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611708+0000", 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.031e-05 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611908+0000", 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020053399999999999 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612168+0000", 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025985100000000002 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612436+0000", 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026782899999999997 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.619627+0000", 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071906119999999999 2024-09-21T09:12:36.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624183+0000", 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045566000000000001 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624279+0000", 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6113000000000006e-05 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624372+0000", 2024-09-21T09:12:36.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2242000000000002e-05 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1348 3.5 e60/24 3:a2bfd640:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_105:head v 60'4, mlcod=60'2)", 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.634030+0000", 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.731525833999999, 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012882487999999999, 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.634030+0000", 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.634030+0000", 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.634031+0000", 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.877e-06 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639106+0000", 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005074126 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639148+0000", 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1989000000000001e-05 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639170+0000", 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2592e-05 2024-09-21T09:12:36.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639363+0000", 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019313199999999999 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.639408+0000", 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4569e-05 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.646846+0000", 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074385800000000002 2024-09-21T09:12:36.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.646912+0000", 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5623000000000005e-05 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1540 3.5 e61/24 3:a26ab227:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_9:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.834575836999999, 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018163744999999999, 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530982+0000", 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8169999999999999e-06 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538703+0000", 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077210630000000002 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538740+0000", 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6495000000000002e-05 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538759+0000", 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9259999999999999e-05 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538893+0000", 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013350999999999999 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538936+0000", 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3046000000000001e-05 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549057+0000", 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010120986 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549143+0000", 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6568000000000002e-05 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.466 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1550 3.1 3:83bb88f2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.733466269000001, 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884271000000001, 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1550 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632093+0000", 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9859999999999996e-06 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638741+0000", 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066476859999999999 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638784+0000", 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2982999999999998e-05 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638802+0000", 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8026e-05 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638971+0000", 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016929600000000001 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639309+0000", 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000338315 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639731+0000", 2024-09-21T09:12:36.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042143600000000002 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.652998+0000", 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013267187999999999 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654665+0000", 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001667106 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654849+0000", 2024-09-21T09:12:36.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184212 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654973+0000", 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012403699999999999 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1553 3.25 3:a4ab7629:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.701784109, 2024-09-21T09:12:36.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019797014000000002, 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1553 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663774+0000", 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7089999999999998e-06 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668592+0000", 2024-09-21T09:12:36.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048180580000000001 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668632+0000", 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9765999999999998e-05 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668648+0000", 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6460000000000002e-05 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668837+0000", 2024-09-21T09:12:36.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018921500000000001 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669259+0000", 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042197600000000001 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669691+0000", 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043113599999999999 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683148+0000", 2024-09-21T09:12:36.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013457184000000001 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683341+0000", 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019356899999999999 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683441+0000", 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9777000000000004e-05 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683568+0000", 2024-09-21T09:12:36.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127164 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1593 3.33 3:ccba01ee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.1658306459999999, 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034096062000000003, 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.478 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1593 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199727+0000", 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.616e-06 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210215+0000", 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010487918000000001 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210257+0000", 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1375999999999998e-05 2024-09-21T09:12:36.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210284+0000", 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7630000000000001e-05 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210450+0000", 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016565899999999999 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210824+0000", 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037435799999999998 2024-09-21T09:12:36.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.211233+0000", 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040886699999999999 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223360+0000", 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012127012 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233490+0000", 2024-09-21T09:12:36.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010129917 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233690+0000", 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019989199999999999 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233821+0000", 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000130817 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1601 3.1 3:80d10627:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.0528064629999996, 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018087450000000001, 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1601 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.484 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312751+0000", 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.503e-06 2024-09-21T09:12:36.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316621+0000", 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038693740000000001 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316644+0000", 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3617000000000001e-05 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316657+0000", 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2213e-05 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316721+0000", 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4871999999999998e-05 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316835+0000", 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113594 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:36.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316940+0000", 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010543 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.321841+0000", 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049003730000000004 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330736+0000", 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008894941 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330783+0000", 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6811000000000003e-05 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330836+0000", 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3721999999999998e-05 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1614 3.24 3:25a4f5f7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.483105+0000", 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.8824505980000001, 2024-09-21T09:12:36.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013360077, 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1614 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.483105+0000", 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.483105+0000", 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.483107+0000", 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3879999999999998e-06 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.486908+0000", 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038010359999999998 2024-09-21T09:12:36.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.486939+0000", 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1105000000000001e-05 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.486953+0000", 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.327e-05 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.487050+0000", 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7530999999999998e-05 2024-09-21T09:12:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.487217+0000", 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000166706 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.487359+0000", 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014268000000000001 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.493135+0000", 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057750259999999999 2024-09-21T09:12:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.496369+0000", 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032342030000000002 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.496420+0000", 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0939000000000001e-05 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.496465+0000", 2024-09-21T09:12:36.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5192999999999999e-05 2024-09-21T09:12:36.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.495 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:36.495 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:36.495 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:36.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:36.496 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:36.440+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:36.543 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:36.540+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:36.626 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:36.626 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:36.626 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:36.627 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:36.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:36.644 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:36.639+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:36.745 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:36.744+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:36.809 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:36.813 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:36.813 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:36.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:36.853 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:36.851+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:36.947 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:36.943+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:36.972 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:36.973 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:36.989 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:36.999 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1250 3.0 e59/24 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.935193341, 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019412175, 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062729+0000", 2024-09-21T09:12:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4399999999999999e-06 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068286+0000", 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055572190000000004 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068320+0000", 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4069000000000002e-05 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068339+0000", 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8433000000000001e-05 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068528+0000", 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018950099999999999 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068587+0000", 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8545999999999998e-05 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082000+0000", 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013412884999999999 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082139+0000", 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013908200000000001 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1255 3.23 e59/24 3:c447b817:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_12:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.115993+0000", 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.881926847000001, 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012099077, 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.115993+0000", 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.115993+0000", 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.115995+0000", 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1490000000000001e-06 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.118897+0000", 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029013730000000001 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.118938+0000", 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1346e-05 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.118963+0000", 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4833000000000001e-05 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.119142+0000", 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000178982 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.119198+0000", 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5860999999999999e-05 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.127938+0000", 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087402509999999992 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.128092+0000", 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000154282 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1257 3.2e 3:748eda2f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.864169016, 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.030777402999999998, 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1257 2024-09-21T09:12:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133755+0000", 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6890000000000002e-06 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.148913+0000", 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015158207 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.148973+0000", 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0424999999999998e-05 2024-09-21T09:12:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149005+0000", 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1588999999999999e-05 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149191+0000", 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000186391 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149587+0000", 2024-09-21T09:12:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039548900000000001 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149983+0000", 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000395929 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.163254+0000", 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013271173000000001 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164324+0000", 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010705039999999999 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164449+0000", 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012412600000000001 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164528+0000", 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9881000000000003e-05 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1271 3.2e 3:76653b78:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.711708499, 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021378690999999998, 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1271 2024-09-21T09:12:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286214+0000", 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7099999999999999e-06 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291359+0000", 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005144554 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291399+0000", 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9983e-05 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291427+0000", 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8152000000000001e-05 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291603+0000", 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176028 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291857+0000", 2024-09-21T09:12:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025373000000000003 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.292093+0000", 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023640999999999999 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.304468+0000", 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012374970000000001 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307321+0000", 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002852491 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307474+0000", 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015347900000000001 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307590+0000", 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116184 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1301 3.1d e60/43 3:ba8f96da:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_58:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.684157+0000", 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.313763460000001, 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012617124, 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.684157+0000", 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.684157+0000", 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.684158+0000", 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.607e-06 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.688893+0000", 2024-09-21T09:12:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047347539999999999 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.688916+0000", 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3484000000000001e-05 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.688928+0000", 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1695000000000001e-05 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.689106+0000", 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000178037 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.689151+0000", 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5058000000000001e-05 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.696680+0000", 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075291830000000001 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.696774+0000", 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3306000000000004e-05 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1312 3.b 3:d07beb3d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.115498739, 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020651398000000001, 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1312 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882425+0000", 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6600000000000001e-06 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886385+0000", 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039597679999999998 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886407+0000", 2024-09-21T09:12:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2143000000000001e-05 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886417+0000", 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9620000000000005e-06 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886510+0000", 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3453000000000001e-05 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886739+0000", 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022843599999999999 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886953+0000", 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021450000000000001 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892836+0000", 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058827300000000001 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902975+0000", 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010139426999999999 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.903028+0000", 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2608999999999997e-05 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.903073+0000", 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4709999999999997e-05 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1320 3.2e 3:75d4642b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.950489482, 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018026718000000001, 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1320 2024-09-21T09:12:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047434+0000", 2024-09-21T09:12:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051443+0000", 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040093439999999998 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051486+0000", 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3222000000000001e-05 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051513+0000", 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6401999999999999e-05 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051655+0000", 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014170400000000001 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051826+0000", 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017193500000000001 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051987+0000", 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016016000000000001 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.057648+0000", 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056618600000000003 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065327+0000", 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076783520000000003 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065398+0000", 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1675999999999996e-05 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065457+0000", 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8839999999999999e-05 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1324 3.2e 3:773eeeb4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.862394315, 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020230399, 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1324 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135529+0000", 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1700000000000001e-06 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139590+0000", 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040607860000000003 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139626+0000", 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6508999999999999e-05 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139651+0000", 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4692e-05 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139740+0000", 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8800000000000004e-05 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139853+0000", 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011372200000000001 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139948+0000", 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4049999999999996e-05 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.144662+0000", 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047143530000000001 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155681+0000", 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011019153 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155723+0000", 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2014000000000001e-05 2024-09-21T09:12:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155756+0000", 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3149999999999999e-05 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1330 3.1d e60/43 3:b940fb57:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_87:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.259536+0000", 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.738384481000001, 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011772704, 2024-09-21T09:12:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.259536+0000", 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.259536+0000", 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.259538+0000", 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.888e-06 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.264925+0000", 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053872599999999996 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.264965+0000", 2024-09-21T09:12:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0172000000000001e-05 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.264993+0000", 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8523000000000001e-05 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.265107+0000", 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113152 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.265136+0000", 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9417999999999999e-05 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.271220+0000", 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060836830000000003 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.271308+0000", 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8608000000000003e-05 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1344 3.b 3:d3ddf01f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.460194096, 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017394212999999999, 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1344 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537729+0000", 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.157e-06 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542421+0000", 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046917460000000001 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542457+0000", 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6396000000000002e-05 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542475+0000", 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7663e-05 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542621+0000", 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145943 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542894+0000", 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027341300000000002 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.543122+0000", 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227557 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.554640+0000", 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011517853999999999 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.554941+0000", 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030173899999999998 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.555035+0000", 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3640999999999993e-05 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.555120+0000", 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5104000000000004e-05 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1346 3.1d e60/43 3:b8511b4a:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_103:head v 60'4, mlcod=60'2)", 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.585868+0000", 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.412052556999999, 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013876803, 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.585868+0000", 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.585868+0000", 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.585869+0000", 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7770000000000001e-06 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.589784+0000", 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039150620000000004 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.589817+0000", 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2425999999999998e-05 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.589833+0000", 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5780000000000001e-05 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.589990+0000", 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015754899999999999 2024-09-21T09:12:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.590055+0000", 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5182e-05 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.599651+0000", 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095960000000000004 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.599744+0000", 2024-09-21T09:12:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3027000000000002e-05 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1357 3.b 3:d3617df9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.755144+0000", 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.242775787999999, 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014643844, 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1357 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.755144+0000", 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.755144+0000", 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.755147+0000", 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7470000000000001e-06 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759118+0000", 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039712580000000001 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759157+0000", 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8209e-05 2024-09-21T09:12:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759175+0000", 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8417e-05 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759334+0000", 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000159085 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759582+0000", 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024785999999999997 2024-09-21T09:12:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759809+0000", 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227178 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.768706+0000", 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0088965450000000005 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.769570+0000", 2024-09-21T09:12:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00086438699999999999 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.769671+0000", 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010083500000000001 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.769788+0000", 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000117323 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1368 3.2e 3:74fb0022:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.120607080999999, 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015885940000000001, 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1368 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877316+0000", 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5380000000000001e-06 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881169+0000", 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038535430000000001 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881196+0000", 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539000000000001e-05 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881208+0000", 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1919999999999999e-05 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881267+0000", 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9691999999999997e-05 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881393+0000", 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126129 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881508+0000", 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114156 2024-09-21T09:12:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.885968+0000", 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004460365 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893120+0000", 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007152538 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893162+0000", 2024-09-21T09:12:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1854000000000003e-05 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893199+0000", 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6665999999999998e-05 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1377 3.21 3:85925c47:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.013225498000001, 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016148349999999999, 2024-09-21T09:12:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1377 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984699+0000", 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0029999999999996e-06 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989011+0000", 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004312209 2024-09-21T09:12:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989050+0000", 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9496000000000003e-05 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989070+0000", 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9306000000000001e-05 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989244+0000", 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000173945 2024-09-21T09:12:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989640+0000", 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039646700000000001 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.990033+0000", 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039296300000000003 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.999277+0000", 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092444799999999994 2024-09-21T09:12:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000657+0000", 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013798059999999999 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000761+0000", 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103665 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000843+0000", 2024-09-21T09:12:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2009999999999996e-05 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1546 3.1d e61/43 3:b8116d35:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_15:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.403039864, 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018965064, 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594884+0000", 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3330000000000001e-06 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601862+0000", 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069784510000000001 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601909+0000", 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7052000000000003e-05 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601932+0000", 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2962000000000001e-05 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602065+0000", 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013274700000000001 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602106+0000", 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1625999999999998e-05 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.613748+0000", 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011642062 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.613845+0000", 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6830999999999995e-05 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1553 3.25 e61/24 3:a4ab7629:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_22:head v 61'5, mlcod=60'3)", 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.670014+0000", 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.327905708999999, 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0128381, 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.670014+0000", 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.670014+0000", 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.670017+0000", 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.96e-06 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.672691+0000", 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026740739999999998 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.672731+0000", 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9292999999999998e-05 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.672756+0000", 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4882999999999999e-05 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.672916+0000", 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016023200000000001 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.672963+0000", 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6992e-05 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.682736+0000", 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0097732089999999997 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.682852+0000", 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116457 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1557 3.2e 3:771f05bc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5_100Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.242115914999999, 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023866490000000001, 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1557 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755808+0000", 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3330000000000001e-06 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760408+0000", 2024-09-21T09:12:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046002960000000002 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760449+0000", 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1681999999999998e-05 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760469+0000", 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9809999999999998e-05 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760669+0000", 2024-09-21T09:12:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000200065 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.761108+0000", 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043852600000000001 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.762360+0000", 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001252555 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.778150+0000", 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015789290000000001 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779443+0000", 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012928289999999999 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779587+0000", 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014415900000000001 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779671+0000", 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3944999999999997e-05 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1596 3.21 3:8499e3d2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.7530740649999998, 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017352083000000001, 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1596 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244852+0000", 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8250000000000001e-06 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249499+0000", 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046469349999999996 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249527+0000", 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7767e-05 2024-09-21T09:12:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249538+0000", 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1138000000000001e-05 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249686+0000", 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148574 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249959+0000", 2024-09-21T09:12:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027321399999999998 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.250202+0000", 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000242864 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.260647+0000", 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010445060000000001 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262040+0000", 2024-09-21T09:12:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001392449 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262126+0000", 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6388e-05 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262198+0000", 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1868999999999999e-05 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1609 3.21 3:85d5ed9f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5895347659999999, 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016153879999999999, 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1609 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408387+0000", 2024-09-21T09:12:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.956e-06 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411460+0000", 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030725240000000001 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411478+0000", 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8286000000000001e-05 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411491+0000", 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.296e-05 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411695+0000", 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020357799999999999 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.412057+0000", 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000362402 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.412539+0000", 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000481528 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.419746+0000", 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072079359999999999 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424338+0000", 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045913780000000001 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424456+0000", 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118334 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424539+0000", 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2997999999999994e-05 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1612 3.c e62/24 3:33644f02:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_21:head v 62'5, mlcod=61'3)", 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.461095+0000", 2024-09-21T09:12:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5368253339999995, 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013751641, 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.461095+0000", 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.461095+0000", 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.461095+0000", 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.44e-07 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.467521+0000", 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006425437 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.467551+0000", 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0136000000000001e-05 2024-09-21T09:12:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.467565+0000", 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4347e-05 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.467711+0000", 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014588900000000001 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.467753+0000", 2024-09-21T09:12:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1598999999999999e-05 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.474733+0000", 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069799349999999996 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.474846+0000", 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011365400000000001 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:37.104 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:37.104 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:37.105 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:37.105 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:37.106 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:37.106 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:37.104+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:37.106 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:37.107 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:37.107 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:37.107 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:37.107 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:37.108 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:37.108 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:37.108 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:37.108 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:37.121 INFO:tasks.workunit.client.0.smithi007.stderr:100+0 records in 2024-09-21T09:12:37.122 INFO:tasks.workunit.client.0.smithi007.stderr:100+0 records out 2024-09-21T09:12:37.122 INFO:tasks.workunit.client.0.smithi007.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 7.00126 s, 150 MB/s 2024-09-21T09:12:37.206 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:37.203+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:37.240 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:37.240 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:37.256 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:37.341 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:37.339+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:37.407 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:37.404+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:37.411 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:37.412 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:37.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:37.517 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:37.515+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:37.596 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:37.596 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:37.608 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:37.603+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:37.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:37.709 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:37.708+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:37.777 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:37.778 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:37.791 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:37.810 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:37.808+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:37.911 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:37.907+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:37.911 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:37.911 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:37.925 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:38.012 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:38.008+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:38.086 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:38.086 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:38.099 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:38.112 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:38.112+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:38.212 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:38.212 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:38.213 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:38.212+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:38.225 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:38.313 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:38.311+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:38.350 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:38.350 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:38.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:38.414 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:38.412+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:38.498 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T09:12:38.536 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:38.536 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:38.536 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:38.531+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:38.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:38.637 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:38.635+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:38.709 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:38.709 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:38.716 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:38.711+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:38.722 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:38.817 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:38.816+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:38.855 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-09-21T09:12:38.896 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:38.896 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:38.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:38.918 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:38.916+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:39.020 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:39.016+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:39.065 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:39.066 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:39.079 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:39.122 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:39.128 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:39.128+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:39.215 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:39.215 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:39.221 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:39.220+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:39.230 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:39.260 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:39.261 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:39.279 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:39.316 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:39.321 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:39.320+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:39.351 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:39.351 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:39.374 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:39.398 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:39.398 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:39.422 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:39.420+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:39.422 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:39.423 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:39.423 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:39.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:39.443 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:39.532 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:39.532+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:39.625 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:39.625 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:39.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:39.626 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:39.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.626 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1265 3.3a e60/24 3:5cfa63b7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_22:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:39.627 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:39.627 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.390540794, 2024-09-21T09:12:39.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025518386000000001, 2024-09-21T09:12:39.627 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.627 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.628 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.628 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:39.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:39.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230289+0000", 2024-09-21T09:12:39.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1399999999999996e-07 2024-09-21T09:12:39.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239530+0000", 2024-09-21T09:12:39.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092409199999999997 2024-09-21T09:12:39.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239574+0000", 2024-09-21T09:12:39.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4301999999999997e-05 2024-09-21T09:12:39.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239594+0000", 2024-09-21T09:12:39.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9559999999999999e-05 2024-09-21T09:12:39.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239779+0000", 2024-09-21T09:12:39.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018548800000000001 2024-09-21T09:12:39.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239846+0000", 2024-09-21T09:12:39.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6897999999999995e-05 2024-09-21T09:12:39.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255678+0000", 2024-09-21T09:12:39.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015831548000000001 2024-09-21T09:12:39.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255807+0000", 2024-09-21T09:12:39.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000128856 2024-09-21T09:12:39.638 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.638 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.638 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.639 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1267 3.9 e60/24 3:931159eb:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_24:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:39.639 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:39.639 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.374686100000002, 2024-09-21T09:12:39.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014928096, 2024-09-21T09:12:39.640 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.640 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.640 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:39.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246143+0000", 2024-09-21T09:12:39.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.246144+0000", 2024-09-21T09:12:39.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0669999999999999e-06 2024-09-21T09:12:39.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252177+0000", 2024-09-21T09:12:39.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060330760000000001 2024-09-21T09:12:39.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252211+0000", 2024-09-21T09:12:39.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3822000000000002e-05 2024-09-21T09:12:39.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252228+0000", 2024-09-21T09:12:39.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7125999999999998e-05 2024-09-21T09:12:39.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252379+0000", 2024-09-21T09:12:39.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015065 2024-09-21T09:12:39.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252417+0000", 2024-09-21T09:12:39.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8665000000000003e-05 2024-09-21T09:12:39.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.260976+0000", 2024-09-21T09:12:39.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085584029999999992 2024-09-21T09:12:39.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.261071+0000", 2024-09-21T09:12:39.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5286999999999998e-05 2024-09-21T09:12:39.649 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.649 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.649 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.650 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1291 3.2 3:4203678b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:39.650 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:39.650 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.088000643000001, 2024-09-21T09:12:39.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015334344999999999, 2024-09-21T09:12:39.650 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.650 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.651 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.651 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.651 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.651 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.651 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1291 2024-09-21T09:12:39.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.652 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:39.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532828+0000", 2024-09-21T09:12:39.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.532834+0000", 2024-09-21T09:12:39.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8329999999999999e-06 2024-09-21T09:12:39.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537680+0000", 2024-09-21T09:12:39.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048457689999999998 2024-09-21T09:12:39.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537707+0000", 2024-09-21T09:12:39.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7364000000000001e-05 2024-09-21T09:12:39.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537721+0000", 2024-09-21T09:12:39.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3935e-05 2024-09-21T09:12:39.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.537860+0000", 2024-09-21T09:12:39.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000138646 2024-09-21T09:12:39.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.538194+0000", 2024-09-21T09:12:39.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033445799999999999 2024-09-21T09:12:39.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:39.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.538521+0000", 2024-09-21T09:12:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032673799999999997 2024-09-21T09:12:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.546553+0000", 2024-09-21T09:12:39.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080323600000000005 2024-09-21T09:12:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.547994+0000", 2024-09-21T09:12:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00144082 2024-09-21T09:12:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.548087+0000", 2024-09-21T09:12:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2627000000000006e-05 2024-09-21T09:12:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.548163+0000", 2024-09-21T09:12:39.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5795000000000002e-05 2024-09-21T09:12:39.662 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.662 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.662 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1303 3.2b 3:d7a32023:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.914470983000001, 2024-09-21T09:12:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017871702999999999, 2024-09-21T09:12:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.663 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1303 2024-09-21T09:12:39.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706362+0000", 2024-09-21T09:12:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1659999999999996e-06 2024-09-21T09:12:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712782+0000", 2024-09-21T09:12:39.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006419803 2024-09-21T09:12:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712817+0000", 2024-09-21T09:12:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5466000000000002e-05 2024-09-21T09:12:39.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712838+0000", 2024-09-21T09:12:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0919000000000001e-05 2024-09-21T09:12:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712933+0000", 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4452999999999998e-05 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713042+0000", 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109304 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713159+0000", 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011710299999999999 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.719777+0000", 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006617497 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724152+0000", 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043755240000000004 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724191+0000", 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8337999999999998e-05 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724230+0000", 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.913e-05 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1304 3.2 3:40da9a43:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.895277172, 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018044510999999999, 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.672 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1304 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:39.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725555+0000", 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.977e-06 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730352+0000", 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047973670000000003 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730394+0000", 2024-09-21T09:12:39.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2199e-05 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730412+0000", 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7679000000000001e-05 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730524+0000", 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011182400000000001 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730728+0000", 2024-09-21T09:12:39.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000204448 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730907+0000", 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000178753 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.736861+0000", 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059537629999999999 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743469+0000", 2024-09-21T09:12:39.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066083970000000002 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743539+0000", 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9387000000000005e-05 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743596+0000", 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7717000000000003e-05 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1306 3.3d e60/24 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.857699166, 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014663086000000001, 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:39.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763130+0000", 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.763131+0000", 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2500000000000001e-06 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766744+0000", 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003613256 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766796+0000", 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1907999999999998e-05 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766820+0000", 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4097e-05 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766950+0000", 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129436 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.766990+0000", 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9826000000000001e-05 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.777707+0000", 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010717232 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.777793+0000", 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6081000000000005e-05 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1319 3.1b 3:da10b4a0:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.596659320000001, 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020034222000000001, 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.682 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1319 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024172+0000", 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6639999999999998e-06 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028099+0000", 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039262639999999996 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028132+0000", 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3155999999999999e-05 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028146+0000", 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3835999999999999e-05 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028273+0000", 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127436 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028566+0000", 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029305899999999997 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028799+0000", 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023329399999999999 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.040586+0000", 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011786173 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044077+0000", 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034909429999999998 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044145+0000", 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8182000000000006e-05 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044204+0000", 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9215000000000001e-05 2024-09-21T09:12:39.687 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1331 3.2b 3:d6dd70dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.341207259000001, 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015879798000000001, 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.688 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1331 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279622+0000", 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.279625+0000", 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.932e-06 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283705+0000", 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040801630000000004 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283748+0000", 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3216000000000001e-05 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283766+0000", 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7717e-05 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.283929+0000", 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016334800000000001 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.284333+0000", 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000404013 2024-09-21T09:12:39.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.284775+0000", 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044202199999999998 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.293797+0000", 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0090219979999999998 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295202+0000", 2024-09-21T09:12:39.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001404977 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295378+0000", 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175656 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.295502+0000", 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012375600000000001 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1335 3.39 e60/24 3:9e12c6c8:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_92:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.254558568, 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014870665, 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366270+0000", 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.366273+0000", 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0130000000000002e-06 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371450+0000", 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051763310000000002 2024-09-21T09:12:39.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371486+0000", 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6684999999999999e-05 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371507+0000", 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0869999999999998e-05 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371672+0000", 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016454600000000001 2024-09-21T09:12:39.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.371712+0000", 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0045e-05 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.381006+0000", 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092941480000000003 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.381141+0000", 2024-09-21T09:12:39.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013502699999999999 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1360 3.19 3:9846b005:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.835072632999999, 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022976068999999998, 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.698 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1360 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785759+0000", 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0539999999999999e-06 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792174+0000", 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064142349999999999 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792218+0000", 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4759000000000003e-05 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792239+0000", 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0931999999999999e-05 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792401+0000", 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016128900000000001 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792724+0000", 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032341200000000003 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.793086+0000", 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000361751 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.800495+0000", 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074087129999999999 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808444+0000", 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079492120000000006 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808604+0000", 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015997900000000001 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808732+0000", 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012873299999999999 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1372 3.2b 3:d4d898f8:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:39.703 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:39.704 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.697099181999999, 2024-09-21T09:12:39.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017677609, 2024-09-21T09:12:39.704 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.704 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:39.624+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.705 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1372 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923732+0000", 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7489999999999999e-06 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927536+0000", 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038041720000000002 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927563+0000", 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7225000000000001e-05 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927578+0000", 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4955e-05 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927772+0000", 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019444199999999999 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.928019+0000", 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024669399999999999 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.928268+0000", 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024846999999999998 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.936113+0000", 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078454619999999992 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941192+0000", 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050785589999999999 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941307+0000", 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115364 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941407+0000", 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000100517 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.710 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1534 3.2b 3:d47ba0a2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.155331531, 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021807494, 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1534 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465501+0000", 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4860000000000002e-06 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473846+0000", 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083450369999999996 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473888+0000", 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2079000000000001e-05 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473915+0000", 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7214000000000001e-05 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474073+0000", 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015771900000000001 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474356+0000", 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028332999999999999 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474593+0000", 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023622000000000001 2024-09-21T09:12:39.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.486329+0000", 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011736483000000001 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487017+0000", 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068800299999999997 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487182+0000", 2024-09-21T09:12:39.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000164716 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487305+0000", 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012320699999999999 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1536 3.3a e61/24 3:5db53460:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_5:head v 61'4, mlcod=60'2)", 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:39.716 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.128618447999999, 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015410841999999999, 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492211+0000", 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.492212+0000", 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8929999999999999e-06 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497695+0000", 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054820720000000002 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497726+0000", 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0991999999999997e-05 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497746+0000", 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0786999999999999e-05 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497898+0000", 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151256 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497961+0000", 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3268000000000005e-05 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.507519+0000", 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095583869999999998 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.507621+0000", 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102187 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.720 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1545 3.2b 3:d625eaa7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.036041586, 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017872958000000001, 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.721 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1545 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584811+0000", 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3762000000000001e-05 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588898+0000", 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040866059999999996 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588937+0000", 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9439e-05 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588956+0000", 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8340000000000001e-05 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589073+0000", 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0001175 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589331+0000", 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025805000000000001 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589555+0000", 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223525 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.600733+0000", 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011178250000000001 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602354+0000", 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001621054 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602536+0000", 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018230500000000001 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602660+0000", 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124127 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1549 3.1b 3:dae9f2a4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:39.726 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.999231666, 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018896029000000002, 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1549 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:39.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621602+0000", 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9300000000000002e-06 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627034+0000", 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054319820000000001 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627076+0000", 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1492000000000002e-05 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627095+0000", 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9636e-05 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627245+0000", 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014983299999999999 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627542+0000", 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029642600000000002 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627779+0000", 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023740400000000001 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639133+0000", 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011353667 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640182+0000", 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010494510000000001 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640365+0000", 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018299500000000001 2024-09-21T09:12:39.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640493+0000", 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012821299999999999 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1599 3.7 3:e3ccd4a9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.331424627000001, 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017842754999999998, 2024-09-21T09:12:39.732 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1599 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289408+0000", 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2629999999999999e-06 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294631+0000", 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052238329999999998 2024-09-21T09:12:39.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294652+0000", 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0381e-05 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294663+0000", 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.095e-05 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294756+0000", 2024-09-21T09:12:39.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3329e-05 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294975+0000", 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000219256 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.295187+0000", 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021132400000000001 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.306696+0000", 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011508846 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307149+0000", 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000453306 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307191+0000", 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2106e-05 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307247+0000", 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6161e-05 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1607 3.2b 3:d67827bf:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.240903346, 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019045075000000002, 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.738 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1607 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379929+0000", 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0589999999999998e-06 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383914+0000", 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039857199999999999 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383957+0000", 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2962e-05 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383977+0000", 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9436000000000002e-05 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384091+0000", 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0001138 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384275+0000", 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000183983 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384458+0000", 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000183723 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.390465+0000", 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060069199999999998 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398837+0000", 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083720530000000008 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398915+0000", 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8108999999999994e-05 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398971+0000", 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5309999999999997e-05 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.743 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1617 3.2 3:43f6ae7e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6_100Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.508282+0000", 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.112547104000001, 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01523673, 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1617 2024-09-21T09:12:39.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.508282+0000", 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.508282+0000", 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.508285+0000", 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6129999999999998e-06 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512338+0000", 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040529880000000004 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512395+0000", 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7741999999999997e-05 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512414+0000", 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9165999999999999e-05 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512504+0000", 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9506000000000007e-05 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.512653+0000", 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014948399999999999 2024-09-21T09:12:39.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.513208+0000", 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055438299999999998 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.522213+0000", 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0090056010000000002 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.523412+0000", 2024-09-21T09:12:39.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011987009999999999 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.523475+0000", 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2593000000000002e-05 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.523519+0000", 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3952999999999997e-05 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1744 3.2d e66/24 3:b645c81b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_11:head v 66'4, mlcod=60'2)", 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.403425+0000", 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.21740438600000001, 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016115437, 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.403425+0000", 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.403425+0000", 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.403425+0000", 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1200000000000003e-07 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.412946+0000", 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095213399999999997 2024-09-21T09:12:39.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.412981+0000", 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4023999999999998e-05 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.413003+0000", 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2044000000000001e-05 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.413093+0000", 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0832e-05 2024-09-21T09:12:39.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.413116+0000", 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2538e-05 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.419478+0000", 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063622269999999998 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.419540+0000", 2024-09-21T09:12:39.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1920000000000003e-05 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1762 3.2 3:419781b7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.588453+0000", 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.032376229999999999, 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021968516, 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:39.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1762 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.588453+0000", 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.588453+0000", 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:39.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.588456+0000", 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8700000000000001e-06 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.596459+0000", 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080037479999999998 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.596502+0000", 2024-09-21T09:12:39.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3027e-05 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.596537+0000", 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4480999999999997e-05 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.596645+0000", 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107648 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.596771+0000", 2024-09-21T09:12:39.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126725 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.597005+0000", 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023416499999999999 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.604029+0000", 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070236969999999998 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:39.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.610135+0000", 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061059720000000003 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.610306+0000", 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017128 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.610421+0000", 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011490299999999999 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.760 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:39.760 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:39.760 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:39.760 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:39.761 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:39.759+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:39.862 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:39.859+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:39.896 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:39.896 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:39.896 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:39.896 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:39.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:39.962 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:39.960+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:40.052 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:40.052 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:40.063 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:40.059+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:40.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:40.164 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:40.159+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:40.252 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1163 3.17 3:eb0740dd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.336443989999999, 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019360854, 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.253 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1163 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:40.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911569+0000", 2024-09-21T09:12:40.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6460000000000002e-06 2024-09-21T09:12:40.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917121+0000", 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005551846 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917164+0000", 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2916e-05 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917183+0000", 2024-09-21T09:12:40.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8508999999999998e-05 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917318+0000", 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013504200000000001 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917572+0000", 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025395300000000001 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917798+0000", 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022648300000000001 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.929367+0000", 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011568729999999999 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930809+0000", 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014424730000000001 2024-09-21T09:12:40.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930883+0000", 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3910000000000002e-05 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930928+0000", 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4345999999999999e-05 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1235 3.18 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.266250273000001, 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028152907000000001, 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1235 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981763+0000", 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7700000000000002e-06 2024-09-21T09:12:40.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988006+0000", 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062426979999999997 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988042+0000", 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6461999999999998e-05 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988067+0000", 2024-09-21T09:12:40.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4372999999999999e-05 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988210+0000", 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014307299999999999 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988480+0000", 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026992500000000002 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:40.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988718+0000", 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023859400000000001 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.002159+0000", 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01344091 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009749+0000", 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075900769999999998 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009840+0000", 2024-09-21T09:12:40.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0736999999999995e-05 2024-09-21T09:12:40.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009913+0000", 2024-09-21T09:12:40.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3287999999999994e-05 2024-09-21T09:12:40.266 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.266 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.266 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.266 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1246 3.31 3:8d902261:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:40.266 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:40.266 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.24732083, 2024-09-21T09:12:40.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022053738, 2024-09-21T09:12:40.267 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.267 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.267 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.267 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.267 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.267 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.267 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1246 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000694+0000", 2024-09-21T09:12:40.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2599999999999999e-06 2024-09-21T09:12:40.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004867+0000", 2024-09-21T09:12:40.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041723300000000001 2024-09-21T09:12:40.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004920+0000", 2024-09-21T09:12:40.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2985000000000002e-05 2024-09-21T09:12:40.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004948+0000", 2024-09-21T09:12:40.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8362999999999999e-05 2024-09-21T09:12:40.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005091+0000", 2024-09-21T09:12:40.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000142903 2024-09-21T09:12:40.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005381+0000", 2024-09-21T09:12:40.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029025500000000001 2024-09-21T09:12:40.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005674+0000", 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000292878 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.017583+0000", 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011908981000000001 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022585+0000", 2024-09-21T09:12:40.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050024179999999998 2024-09-21T09:12:40.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022674+0000", 2024-09-21T09:12:40.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8486999999999995e-05 2024-09-21T09:12:40.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022744+0000", 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9877999999999997e-05 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1250 3.0 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:40.274 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.191513969999999, 2024-09-21T09:12:40.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026211538999999999, 2024-09-21T09:12:40.275 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.275 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.275 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.275 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.275 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.275 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.275 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1250 2024-09-21T09:12:40.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.276 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:40.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:40.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056500+0000", 2024-09-21T09:12:40.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.18e-06 2024-09-21T09:12:40.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061414+0000", 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049142930000000001 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061455+0000", 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0689000000000003e-05 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061475+0000", 2024-09-21T09:12:40.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9760000000000001e-05 2024-09-21T09:12:40.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061649+0000", 2024-09-21T09:12:40.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000174308 2024-09-21T09:12:40.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062062+0000", 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041290199999999998 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062448+0000", 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038618600000000001 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.075288+0000", 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012839623999999999 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082540+0000", 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072523489999999999 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082633+0000", 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3200000000000002e-05 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082708+0000", 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5048000000000004e-05 2024-09-21T09:12:40.281 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1258 3.17 3:e9fd25dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.101786230999998, 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025293568999999998, 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.282 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1258 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146228+0000", 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8130000000000002e-06 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151893+0000", 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056641929999999997 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151937+0000", 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4768999999999998e-05 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151978+0000", 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0844999999999999e-05 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152239+0000", 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026088000000000001 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152546+0000", 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000306905 2024-09-21T09:12:40.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:40.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152815+0000", 2024-09-21T09:12:40.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268912 2024-09-21T09:12:40.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.165057+0000", 2024-09-21T09:12:40.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012242368 2024-09-21T09:12:40.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171206+0000", 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006148349 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171389+0000", 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018327799999999999 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171518+0000", 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129257 2024-09-21T09:12:40.287 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1260 3.17 3:eb13e7c3:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.076859771999999, 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021083792000000001, 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.288 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1260 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171154+0000", 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9040000000000001e-06 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176055+0000", 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049010299999999998 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176092+0000", 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6662000000000002e-05 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176109+0000", 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7042999999999999e-05 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176228+0000", 2024-09-21T09:12:40.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119747 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176521+0000", 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029217499999999999 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176753+0000", 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023253299999999999 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.187711+0000", 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010958324 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192068+0000", 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043564989999999998 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192163+0000", 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.48e-05 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192235+0000", 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2075000000000004e-05 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1266 3.38 3:1db25443:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.013241538999999, 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018278652999999999, 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1266 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234769+0000", 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.234772+0000", 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5730000000000002e-06 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240589+0000", 2024-09-21T09:12:40.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058167760000000001 2024-09-21T09:12:40.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240661+0000", 2024-09-21T09:12:40.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2358000000000001e-05 2024-09-21T09:12:40.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240687+0000", 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5522000000000001e-05 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.240897+0000", 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021069799999999999 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.241146+0000", 2024-09-21T09:12:40.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024912600000000001 2024-09-21T09:12:40.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:40.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.241373+0000", 2024-09-21T09:12:40.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022685399999999999 2024-09-21T09:12:40.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.248615+0000", 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072417089999999998 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252728+0000", 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041126729999999998 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.252915+0000", 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018731100000000001 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.253048+0000", 2024-09-21T09:12:40.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000133053 2024-09-21T09:12:40.301 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.301 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.301 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.301 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1272 3.29 3:963d269b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.301 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.950482451999999, 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019343672999999999, 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1272 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:40.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:40.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297532+0000", 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-06 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300259+0000", 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027266579999999999 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300306+0000", 2024-09-21T09:12:40.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6748e-05 2024-09-21T09:12:40.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300325+0000", 2024-09-21T09:12:40.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9752999999999999e-05 2024-09-21T09:12:40.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300489+0000", 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016374200000000001 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300746+0000", 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025647300000000001 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:40.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300967+0000", 2024-09-21T09:12:40.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022157700000000001 2024-09-21T09:12:40.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.309603+0000", 2024-09-21T09:12:40.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086360010000000008 2024-09-21T09:12:40.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316784+0000", 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071809450000000002 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316833+0000", 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8949999999999997e-05 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316872+0000", 2024-09-21T09:12:40.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-21T09:12:40.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.309 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.310 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1283 3.29 3:97ed8f1e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.310 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:40.310 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.834535715000001, 2024-09-21T09:12:40.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02166881, 2024-09-21T09:12:40.310 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.310 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.310 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.310 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.311 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.311 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.311 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1283 2024-09-21T09:12:40.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.311 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413478+0000", 2024-09-21T09:12:40.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417497+0000", 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004018822 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417541+0000", 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3961999999999997e-05 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417568+0000", 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6452999999999999e-05 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417777+0000", 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020961499999999999 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418024+0000", 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000247159 2024-09-21T09:12:40.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:40.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418257+0000", 2024-09-21T09:12:40.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023203000000000001 2024-09-21T09:12:40.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.427160+0000", 2024-09-21T09:12:40.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089031600000000002 2024-09-21T09:12:40.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435069+0000", 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079094850000000008 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435111+0000", 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1959000000000003e-05 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435144+0000", 2024-09-21T09:12:40.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2815999999999999e-05 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1306 3.3d 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.489839546999999, 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020194347000000001, 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.317 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1306 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758174+0000", 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762157+0000", 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039825770000000002 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762201+0000", 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4245000000000001e-05 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762220+0000", 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8808999999999999e-05 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762324+0000", 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104033 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762588+0000", 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026391700000000001 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762811+0000", 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000222957 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.771599+0000", 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087878469999999997 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778144+0000", 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065449810000000001 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778244+0000", 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9901000000000005e-05 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778366+0000", 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012201000000000001 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1311 3.27 3:e6d5d281:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.388955359000001, 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024501067000000001, 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1311 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859057+0000", 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5149999999999999e-06 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862830+0000", 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037728620000000001 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862850+0000", 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0264000000000001e-05 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862859+0000", 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2189999999999993e-06 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863041+0000", 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018214899999999999 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863291+0000", 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024963299999999997 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:40.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863529+0000", 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023759000000000001 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.870237+0000", 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067083170000000001 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883389+0000", 2024-09-21T09:12:40.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013151532 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883486+0000", 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7640999999999996e-05 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883557+0000", 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0345000000000005e-05 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1317 3.3e 3:7ff9933d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.267264586, 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018704327, 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1317 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.330 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980746+0000", 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.980750+0000", 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0929999999999996e-06 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984763+0000", 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040130219999999998 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984810+0000", 2024-09-21T09:12:40.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6579000000000002e-05 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.984831+0000", 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1115999999999999e-05 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985053+0000", 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022203699999999999 2024-09-21T09:12:40.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985323+0000", 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026964900000000001 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.985563+0000", 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023996299999999999 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.995589+0000", 2024-09-21T09:12:40.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010026372 2024-09-21T09:12:40.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999270+0000", 2024-09-21T09:12:40.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036809500000000001 2024-09-21T09:12:40.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999369+0000", 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9048000000000004e-05 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.999451+0000", 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1497999999999998e-05 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1359 3.3d 3:bc104684:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:40.336 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.471500258999999, 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020340127, 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1359 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:40.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776514+0000", 2024-09-21T09:12:40.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8770000000000003e-06 2024-09-21T09:12:40.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783654+0000", 2024-09-21T09:12:40.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071395319999999996 2024-09-21T09:12:40.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783702+0000", 2024-09-21T09:12:40.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8449000000000003e-05 2024-09-21T09:12:40.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783722+0000", 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9398999999999998e-05 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783892+0000", 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017003 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784158+0000", 2024-09-21T09:12:40.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026600899999999999 2024-09-21T09:12:40.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:40.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784416+0000", 2024-09-21T09:12:40.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025767999999999999 2024-09-21T09:12:40.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795150+0000", 2024-09-21T09:12:40.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010734321 2024-09-21T09:12:40.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795847+0000", 2024-09-21T09:12:40.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00069705199999999998 2024-09-21T09:12:40.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796516+0000", 2024-09-21T09:12:40.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066950600000000005 2024-09-21T09:12:40.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796851+0000", 2024-09-21T09:12:40.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033427199999999999 2024-09-21T09:12:40.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.344 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.344 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1535 3.29 3:94169add:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:40.344 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:40.344 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.771425636, 2024-09-21T09:12:40.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021366508999999999, 2024-09-21T09:12:40.345 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.345 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.345 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1535 2024-09-21T09:12:40.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.346 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:40.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:40.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476590+0000", 2024-09-21T09:12:40.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7269999999999998e-06 2024-09-21T09:12:40.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483098+0000", 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065085480000000003 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483149+0000", 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0726000000000002e-05 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483171+0000", 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1622999999999999e-05 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483359+0000", 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018774199999999999 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483790+0000", 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000431915 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.484215+0000", 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000424664 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.493337+0000", 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091213739999999998 2024-09-21T09:12:40.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497756+0000", 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044193039999999998 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497856+0000", 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9838000000000002e-05 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497952+0000", 2024-09-21T09:12:40.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6047999999999999e-05 2024-09-21T09:12:40.352 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.352 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.352 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.352 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1539 3.1f 3:f84f9343:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:40.352 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:40.352 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.72742188, 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017806683, 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1539 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520589+0000", 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.520593+0000", 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5760000000000002e-06 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524577+0000", 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039848710000000001 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524619+0000", 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1196000000000003e-05 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524638+0000", 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9219e-05 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.524772+0000", 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013400400000000001 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.525057+0000", 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028520599999999998 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.525312+0000", 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025493400000000001 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.532161+0000", 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068492040000000002 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538068+0000", 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059067579999999998 2024-09-21T09:12:40.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538256+0000", 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000188285 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538396+0000", 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013943000000000001 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1542 3.3d 3:bc2592c4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.69573682, 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019304961999999998, 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1542 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552277+0000", 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2160000000000002e-06 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556307+0000", 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040297140000000002 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556345+0000", 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7996e-05 2024-09-21T09:12:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556381+0000", 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6121999999999997e-05 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556519+0000", 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013799999999999999 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556785+0000", 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026605299999999998 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557027+0000", 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241905 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.564209+0000", 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071818280000000003 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571404+0000", 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071951100000000002 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571496+0000", 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2269999999999996e-05 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571579+0000", 2024-09-21T09:12:40.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2748000000000001e-05 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1543 3.1e 3:7938dd95:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.686303983, 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020873849999999999, 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.365 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1543 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:40.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561710+0000", 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2499999999999998e-06 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567451+0000", 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005740864 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567493+0000", 2024-09-21T09:12:40.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1851999999999998e-05 2024-09-21T09:12:40.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567512+0000", 2024-09-21T09:12:40.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-05 2024-09-21T09:12:40.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567654+0000", 2024-09-21T09:12:40.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014127899999999999 2024-09-21T09:12:40.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567918+0000", 2024-09-21T09:12:40.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026440799999999999 2024-09-21T09:12:40.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.568159+0000", 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240564 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.577966+0000", 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098075639999999995 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582419+0000", 2024-09-21T09:12:40.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044529060000000004 2024-09-21T09:12:40.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582514+0000", 2024-09-21T09:12:40.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4438000000000006e-05 2024-09-21T09:12:40.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582581+0000", 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7125000000000005e-05 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1594 3.1e 3:7b761948:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.035194764, 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.031784366000000001, 2024-09-21T09:12:40.372 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.373 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.373 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.373 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.373 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1594 2024-09-21T09:12:40.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.373 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:40.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:40.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212820+0000", 2024-09-21T09:12:40.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0899999999999998e-06 2024-09-21T09:12:40.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223204+0000", 2024-09-21T09:12:40.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010383691 2024-09-21T09:12:40.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223255+0000", 2024-09-21T09:12:40.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1128000000000002e-05 2024-09-21T09:12:40.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223283+0000", 2024-09-21T09:12:40.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7523000000000001e-05 2024-09-21T09:12:40.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223484+0000", 2024-09-21T09:12:40.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149499999999999 2024-09-21T09:12:40.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223901+0000", 2024-09-21T09:12:40.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000417334 2024-09-21T09:12:40.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:40.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224303+0000", 2024-09-21T09:12:40.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040194699999999999 2024-09-21T09:12:40.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.242455+0000", 2024-09-21T09:12:40.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018151792999999999 2024-09-21T09:12:40.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244504+0000", 2024-09-21T09:12:40.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020487370000000001 2024-09-21T09:12:40.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244559+0000", 2024-09-21T09:12:40.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4959e-05 2024-09-21T09:12:40.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244600+0000", 2024-09-21T09:12:40.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1668999999999997e-05 2024-09-21T09:12:40.381 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1595 3.29 3:9443c179:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.023473535000001, 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020426626, 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.382 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1595 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224539+0000", 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.607e-06 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228447+0000", 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003908412 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228476+0000", 2024-09-21T09:12:40.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9155000000000001e-05 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228488+0000", 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1274000000000001e-05 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228601+0000", 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113485 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228854+0000", 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025256399999999999 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.229066+0000", 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000212322 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.241625+0000", 2024-09-21T09:12:40.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012559130999999999 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244748+0000", 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031230160000000002 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244898+0000", 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014988800000000001 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244964+0000", 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5772000000000007e-05 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1597 3.17 3:e845bb01:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.981961998999999, 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022999776, 2024-09-21T09:12:40.388 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1597 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266050+0000", 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.451e-06 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269917+0000", 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038665650000000002 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269941+0000", 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4465e-05 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269953+0000", 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2082000000000001e-05 2024-09-21T09:12:40.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270023+0000", 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9733000000000005e-05 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270183+0000", 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016033200000000001 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270338+0000", 2024-09-21T09:12:40.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015478399999999999 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.275262+0000", 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049237040000000001 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288908+0000", 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013646149 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288979+0000", 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1227000000000001e-05 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289049+0000", 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9283999999999996e-05 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.394 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:40.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:40.396 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:40.391+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:40.496 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:40.496+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:40.537 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:40.537 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:40.537 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:40.537 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:40.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:40.597 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:40.591+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:40.698 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:40.696+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:40.730 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:40.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:40.731 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:40.731 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:40.731 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:40.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:40.840 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:40.840+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:40.883 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T09:12:40.900 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:40.900+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:40.932 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:40.932 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:40.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1235 3.18 e59/24 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.938109111999999, 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020425276999999999, 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988949+0000", 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3659999999999999e-06 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994552+0000", 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056024719999999998 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994598+0000", 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6365000000000001e-05 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994624+0000", 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6132e-05 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994804+0000", 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180209 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994849+0000", 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4838e-05 2024-09-21T09:12:40.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009267+0000", 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014417780999999999 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009372+0000", 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105114 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1287 3.33 3:cd21f967:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.453558337, 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015957355999999999, 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1287 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:40.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473498+0000", 2024-09-21T09:12:40.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.473503+0000", 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7479999999999999e-06 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477595+0000", 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040917059999999996 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477625+0000", 2024-09-21T09:12:40.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9765e-05 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477637+0000", 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2439000000000001e-05 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477738+0000", 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010084 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477862+0000", 2024-09-21T09:12:40.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124201 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.477961+0000", 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8373000000000002e-05 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.484421+0000", 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064599890000000002 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489327+0000", 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049063270000000003 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489378+0000", 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0835999999999999e-05 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.489455+0000", 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7132000000000006e-05 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.943 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1300 3.12 3:493715d7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.259834237, 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015508042999999999, 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.944 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.945 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1300 2024-09-21T09:12:40.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.945 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:40.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667222+0000", 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.667225+0000", 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3469999999999999e-06 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670749+0000", 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035240269999999999 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670777+0000", 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7506999999999999e-05 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670791+0000", 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4215e-05 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.670930+0000", 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000138591 2024-09-21T09:12:40.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.671163+0000", 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023348800000000001 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.671376+0000", 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021324700000000001 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.678083+0000", 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067063239999999996 2024-09-21T09:12:40.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682605+0000", 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045220870000000002 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682672+0000", 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7238999999999998e-05 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.682730+0000", 2024-09-21T09:12:40.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7970999999999998e-05 2024-09-21T09:12:40.950 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.950 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.950 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.950 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1312 3.b e60/24 3:d07beb3d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_69:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:40.950 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:40.950 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.039921457999998, 2024-09-21T09:12:40.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015617013000000001, 2024-09-21T09:12:40.950 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887135+0000", 2024-09-21T09:12:40.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.887136+0000", 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.578e-06 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.891977+0000", 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048406509999999996 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892015+0000", 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7722000000000002e-05 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892032+0000", 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7405999999999999e-05 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892152+0000", 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119757 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892194+0000", 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2002000000000002e-05 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902665+0000", 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010471543 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902752+0000", 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6353999999999993e-05 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.954 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1316 3.5 e60/24 3:a3fa7fee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_73:head v 60'2, mlcod=0'0)", 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.964011873, 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016060771000000001, 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:40.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963044+0000", 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.963046+0000", 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8729999999999999e-06 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968897+0000", 2024-09-21T09:12:40.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058507289999999998 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968933+0000", 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6112000000000003e-05 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.968953+0000", 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9763e-05 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.969113+0000", 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016067800000000001 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.969185+0000", 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1761999999999995e-05 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.978989+0000", 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098042709999999998 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.979105+0000", 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011558299999999999 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1323 3.12 3:4a999ff4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.814152375999999, 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019594209000000001, 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.959 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.960 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.960 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.960 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.960 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1323 2024-09-21T09:12:40.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.960 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:40.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:40.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112907+0000", 2024-09-21T09:12:40.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1e-06 2024-09-21T09:12:40.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117323+0000", 2024-09-21T09:12:40.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044160229999999998 2024-09-21T09:12:40.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117368+0000", 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5105000000000003e-05 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117387+0000", 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.931e-05 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117571+0000", 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018423199999999999 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117976+0000", 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040424599999999998 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.118414+0000", 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043875199999999999 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.131859+0000", 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013444621 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132294+0000", 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043466199999999999 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132420+0000", 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012634699999999999 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132498+0000", 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7811000000000004e-05 2024-09-21T09:12:40.965 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1332 3.33 3:cc16045e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.629185733, 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024640585, 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.966 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1332 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297873+0000", 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9560000000000002e-06 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302007+0000", 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041338299999999998 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302045+0000", 2024-09-21T09:12:40.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7929000000000002e-05 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302062+0000", 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6844e-05 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302223+0000", 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000161232 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302631+0000", 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000408059 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.303057+0000", 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000425463 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.312222+0000", 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091652239999999996 2024-09-21T09:12:40.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322385+0000", 2024-09-21T09:12:40.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010163292000000001 2024-09-21T09:12:40.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322455+0000", 2024-09-21T09:12:40.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0104000000000005e-05 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322511+0000", 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5652000000000002e-05 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1340 3.24 3:244553ef:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.466465741, 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022132493999999999, 2024-09-21T09:12:40.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1340 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460593+0000", 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7259999999999998e-06 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465499+0000", 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049057679999999996 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465546+0000", 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6692e-05 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465565+0000", 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9939e-05 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465709+0000", 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014318999999999999 2024-09-21T09:12:40.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465937+0000", 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022867100000000001 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.466152+0000", 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000214637 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.473162+0000", 2024-09-21T09:12:40.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070101199999999999 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482551+0000", 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093889520000000008 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482644+0000", 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2768000000000004e-05 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482723+0000", 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030999999999996e-05 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1347 3.25 3:a6a24497:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.320330153, 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017645750000000002, 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.978 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1347 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606730+0000", 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6069999999999999e-06 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611645+0000", 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049153929999999997 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611688+0000", 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2658999999999999e-05 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611708+0000", 2024-09-21T09:12:40.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.031e-05 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611908+0000", 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020053399999999999 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612168+0000", 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025985100000000002 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:40.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612436+0000", 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026782899999999997 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.619627+0000", 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071906119999999999 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624183+0000", 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045566000000000001 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624279+0000", 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6113000000000006e-05 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624372+0000", 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2242000000000002e-05 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1540 3.5 e61/24 3:a26ab227:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_9:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:40.984 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.396076535000001, 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018163744999999999, 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530982+0000", 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8169999999999999e-06 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538703+0000", 2024-09-21T09:12:40.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077210630000000002 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538740+0000", 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6495000000000002e-05 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538759+0000", 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9259999999999999e-05 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538893+0000", 2024-09-21T09:12:40.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013350999999999999 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538936+0000", 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3046000000000001e-05 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549057+0000", 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010120986 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549143+0000", 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6568000000000002e-05 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1550 3.1 3:83bb88f2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.294966967000001, 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884271000000001, 2024-09-21T09:12:40.989 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1550 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632093+0000", 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9859999999999996e-06 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638741+0000", 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066476859999999999 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638784+0000", 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2982999999999998e-05 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638802+0000", 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8026e-05 2024-09-21T09:12:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638971+0000", 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016929600000000001 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639309+0000", 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000338315 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639731+0000", 2024-09-21T09:12:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042143600000000002 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.652998+0000", 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013267187999999999 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654665+0000", 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001667106 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654849+0000", 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184212 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654973+0000", 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012403699999999999 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1553 3.25 3:a4ab7629:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.263284807, 2024-09-21T09:12:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019797014000000002, 2024-09-21T09:12:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1553 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663774+0000", 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7089999999999998e-06 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668592+0000", 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048180580000000001 2024-09-21T09:12:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668632+0000", 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9765999999999998e-05 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668648+0000", 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6460000000000002e-05 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668837+0000", 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018921500000000001 2024-09-21T09:12:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669259+0000", 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042197600000000001 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669691+0000", 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043113599999999999 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683148+0000", 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013457184000000001 2024-09-21T09:12:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683341+0000", 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019356899999999999 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683441+0000", 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9777000000000004e-05 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683568+0000", 2024-09-21T09:12:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127164 2024-09-21T09:12:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1593 3.33 3:ccba01ee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.727331344, 2024-09-21T09:12:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034096062000000003, 2024-09-21T09:12:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1593 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199727+0000", 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.616e-06 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210215+0000", 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010487918000000001 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210257+0000", 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1375999999999998e-05 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210284+0000", 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7630000000000001e-05 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210450+0000", 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016565899999999999 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210824+0000", 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037435799999999998 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.211233+0000", 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040886699999999999 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223360+0000", 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012127012 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233490+0000", 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010129917 2024-09-21T09:12:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233690+0000", 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019989199999999999 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233821+0000", 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000130817 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1601 3.1 3:80d10627:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.614307160999999, 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018087450000000001, 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1601 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312751+0000", 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.503e-06 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316621+0000", 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038693740000000001 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316644+0000", 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3617000000000001e-05 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316657+0000", 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2213e-05 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316721+0000", 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4871999999999998e-05 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316835+0000", 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113594 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316940+0000", 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010543 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.321841+0000", 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049003730000000004 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330736+0000", 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008894941 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330783+0000", 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6811000000000003e-05 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330836+0000", 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3721999999999998e-05 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1779 3.33 3:cf2f93e7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.105614868, 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018811553000000002, 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1779 2024-09-21T09:12:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821446+0000", 2024-09-21T09:12:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999999e-06 2024-09-21T09:12:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825426+0000", 2024-09-21T09:12:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039806329999999999 2024-09-21T09:12:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825466+0000", 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9860999999999997e-05 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825486+0000", 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9802000000000001e-05 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825623+0000", 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013701499999999999 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825875+0000", 2024-09-21T09:12:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000252224 2024-09-21T09:12:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.826117+0000", 2024-09-21T09:12:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024205799999999999 2024-09-21T09:12:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.832983+0000", 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068659560000000003 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840056+0000", 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070724200000000003 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840166+0000", 2024-09-21T09:12:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110423 2024-09-21T09:12:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840253+0000", 2024-09-21T09:12:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6730999999999993e-05 2024-09-21T09:12:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1786 3.24 3:26afb083:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.0169951930000001, 2024-09-21T09:12:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017381338, 2024-09-21T09:12:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1786 2024-09-21T09:12:41.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.026 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:41.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910071+0000", 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0083e-05 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915610+0000", 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055387580000000004 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915654+0000", 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4527999999999998e-05 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915674+0000", 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0191999999999999e-05 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915777+0000", 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102301 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915933+0000", 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015625700000000001 2024-09-21T09:12:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.916070+0000", 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000137236 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.924065+0000", 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079951290000000001 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927320+0000", 2024-09-21T09:12:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032548210000000002 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927388+0000", 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7847000000000003e-05 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927442+0000", 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4185999999999999e-05 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1787 3.1 3:83374f15:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.920631+0000", 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.0064254189999999, 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016424268999999998, 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1787 2024-09-21T09:12:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.920631+0000", 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.920631+0000", 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.920633+0000", 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8490000000000002e-06 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.924685+0000", 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040515029999999997 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.924719+0000", 2024-09-21T09:12:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4143999999999997e-05 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.924736+0000", 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7093000000000001e-05 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.924878+0000", 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014143099999999999 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.925115+0000", 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000237018 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.925343+0000", 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022814600000000001 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.934817+0000", 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0094740529999999996 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.936870+0000", 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020528730000000002 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.936963+0000", 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3317000000000001e-05 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.937055+0000", 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1842000000000006e-05 2024-09-21T09:12:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1798 3.32 3:4e55114b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.061370+0000", 2024-09-21T09:12:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.865686187, 2024-09-21T09:12:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015437835, 2024-09-21T09:12:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1798 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.061370+0000", 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.061370+0000", 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.061373+0000", 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6160000000000002e-06 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.065316+0000", 2024-09-21T09:12:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039423870000000003 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.065360+0000", 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3850000000000002e-05 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.065380+0000", 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9925999999999999e-05 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.065556+0000", 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175866 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.066011+0000", 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00045506300000000002 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.066430+0000", 2024-09-21T09:12:41.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041943999999999998 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.075775+0000", 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093454809999999992 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.076635+0000", 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00085988000000000004 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.076737+0000", 2024-09-21T09:12:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101888 2024-09-21T09:12:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.076808+0000", 2024-09-21T09:12:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0438000000000006e-05 2024-09-21T09:12:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1821 3.4 3:220bbc7d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.53685874099999997, 2024-09-21T09:12:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884436000000001, 2024-09-21T09:12:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1821 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390201+0000", 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4359999999999998e-06 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.394951+0000", 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047500119999999996 2024-09-21T09:12:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.394993+0000", 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2573e-05 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395011+0000", 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7782999999999999e-05 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395212+0000", 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000200848 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395467+0000", 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025509699999999997 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395699+0000", 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023194900000000001 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.403439+0000", 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077395509999999999 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.412978+0000", 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095393089999999993 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.413031+0000", 2024-09-21T09:12:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3498999999999997e-05 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.413082+0000", 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0379e-05 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1833 3.1 3:817b0a89:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.581312+0000", 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.345744514, 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01537352, 2024-09-21T09:12:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1833 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.581312+0000", 2024-09-21T09:12:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.581312+0000", 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.581314+0000", 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0449999999999999e-06 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.585051+0000", 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037369230000000001 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.585074+0000", 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3241999999999999e-05 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.585088+0000", 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4221e-05 2024-09-21T09:12:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.585155+0000", 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7107000000000006e-05 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.585287+0000", 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013194300000000001 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.585383+0000", 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6064999999999996e-05 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.590595+0000", 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052119480000000001 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.596566+0000", 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059707689999999999 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.596628+0000", 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2576999999999994e-05 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.596685+0000", 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6679999999999999e-05 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.057 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:41.059 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:41.059 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:41.055+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:41.160 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:41.156+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:41.250 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:41.250 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:41.250 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:41.250 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:41.260 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:41.255+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:41.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:41.362 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:41.360+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:41.453 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:41.453 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:41.453 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:41.453 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:41.453 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:41.462 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:41.459+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:41.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:41.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:41.564 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:41.560+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:41.652 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:41.652 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:41.660 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1250 3.0 e59/24 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.595068441999999, 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019412175, 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062729+0000", 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4399999999999999e-06 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068286+0000", 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055572190000000004 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068320+0000", 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4069000000000002e-05 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068339+0000", 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8433000000000001e-05 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068528+0000", 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018950099999999999 2024-09-21T09:12:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068587+0000", 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8545999999999998e-05 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082000+0000", 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013412884999999999 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082139+0000", 2024-09-21T09:12:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013908200000000001 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1257 3.2e 3:748eda2f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.524044116999999, 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.030777402999999998, 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1257 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133755+0000", 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6890000000000002e-06 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.148913+0000", 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015158207 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.148973+0000", 2024-09-21T09:12:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0424999999999998e-05 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149005+0000", 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1588999999999999e-05 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149191+0000", 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000186391 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149587+0000", 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039548900000000001 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149983+0000", 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000395929 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.163254+0000", 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013271173000000001 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164324+0000", 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010705039999999999 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164449+0000", 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012412600000000001 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164528+0000", 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9881000000000003e-05 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1271 3.2e 3:76653b78:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.371583600000001, 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021378690999999998, 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1271 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286214+0000", 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7099999999999999e-06 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291359+0000", 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005144554 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291399+0000", 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9983e-05 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291427+0000", 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8152000000000001e-05 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291603+0000", 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176028 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291857+0000", 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025373000000000003 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.292093+0000", 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023640999999999999 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.304468+0000", 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012374970000000001 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307321+0000", 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002852491 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307474+0000", 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015347900000000001 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307590+0000", 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116184 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1312 3.b 3:d07beb3d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.77537384, 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020651398000000001, 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1312 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882425+0000", 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6600000000000001e-06 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886385+0000", 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039597679999999998 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886407+0000", 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2143000000000001e-05 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886417+0000", 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9620000000000005e-06 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886510+0000", 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3453000000000001e-05 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886739+0000", 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022843599999999999 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886953+0000", 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021450000000000001 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892836+0000", 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058827300000000001 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902975+0000", 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010139426999999999 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.903028+0000", 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2608999999999997e-05 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.903073+0000", 2024-09-21T09:12:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4709999999999997e-05 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1320 3.2e 3:75d4642b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.610364582999999, 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018026718000000001, 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1320 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047434+0000", 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051443+0000", 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040093439999999998 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051486+0000", 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3222000000000001e-05 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051513+0000", 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6401999999999999e-05 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051655+0000", 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014170400000000001 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051826+0000", 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017193500000000001 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051987+0000", 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016016000000000001 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.057648+0000", 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056618600000000003 2024-09-21T09:12:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065327+0000", 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076783520000000003 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065398+0000", 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1675999999999996e-05 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065457+0000", 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8839999999999999e-05 2024-09-21T09:12:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1324 3.2e 3:773eeeb4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.522269416, 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020230399, 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1324 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135529+0000", 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1700000000000001e-06 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139590+0000", 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040607860000000003 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139626+0000", 2024-09-21T09:12:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6508999999999999e-05 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139651+0000", 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4692e-05 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139740+0000", 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8800000000000004e-05 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139853+0000", 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011372200000000001 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139948+0000", 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4049999999999996e-05 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.144662+0000", 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047143530000000001 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155681+0000", 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011019153 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155723+0000", 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2014000000000001e-05 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155756+0000", 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3149999999999999e-05 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1344 3.b 3:d3ddf01f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.120069196999999, 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017394212999999999, 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1344 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537729+0000", 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.157e-06 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542421+0000", 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046917460000000001 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542457+0000", 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6396000000000002e-05 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542475+0000", 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7663e-05 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542621+0000", 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145943 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542894+0000", 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027341300000000002 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.543122+0000", 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227557 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.554640+0000", 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011517853999999999 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.554941+0000", 2024-09-21T09:12:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030173899999999998 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.555035+0000", 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3640999999999993e-05 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.555120+0000", 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5104000000000004e-05 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1357 3.b 3:d3617df9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.755144+0000", 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.902650889, 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014643844, 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1357 2024-09-21T09:12:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.755144+0000", 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.755144+0000", 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.755147+0000", 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7470000000000001e-06 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759118+0000", 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039712580000000001 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759157+0000", 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8209e-05 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759175+0000", 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8417e-05 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759334+0000", 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000159085 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759582+0000", 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024785999999999997 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.759809+0000", 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227178 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.768706+0000", 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0088965450000000005 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.769570+0000", 2024-09-21T09:12:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00086438699999999999 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.769671+0000", 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010083500000000001 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.769788+0000", 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000117323 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1368 3.2e 3:74fb0022:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.780482182, 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015885940000000001, 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1368 2024-09-21T09:12:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877316+0000", 2024-09-21T09:12:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5380000000000001e-06 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881169+0000", 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038535430000000001 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881196+0000", 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539000000000001e-05 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881208+0000", 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1919999999999999e-05 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881267+0000", 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9691999999999997e-05 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881393+0000", 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126129 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881508+0000", 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114156 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.885968+0000", 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004460365 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893120+0000", 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007152538 2024-09-21T09:12:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893162+0000", 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1854000000000003e-05 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893199+0000", 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6665999999999998e-05 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1377 3.21 3:85925c47:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.673100599000001, 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016148349999999999, 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1377 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984699+0000", 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0029999999999996e-06 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989011+0000", 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004312209 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989050+0000", 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9496000000000003e-05 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989070+0000", 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9306000000000001e-05 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989244+0000", 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000173945 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989640+0000", 2024-09-21T09:12:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039646700000000001 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.990033+0000", 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039296300000000003 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.999277+0000", 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092444799999999994 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000657+0000", 2024-09-21T09:12:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013798059999999999 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000761+0000", 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103665 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000843+0000", 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2009999999999996e-05 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1546 3.1d e61/43 3:b8116d35:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_15:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.062914965000001, 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018965064, 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594884+0000", 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3330000000000001e-06 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601862+0000", 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069784510000000001 2024-09-21T09:12:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601909+0000", 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7052000000000003e-05 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601932+0000", 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2962000000000001e-05 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602065+0000", 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013274700000000001 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602106+0000", 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1625999999999998e-05 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.613748+0000", 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011642062 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.613845+0000", 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6830999999999995e-05 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1557 3.2e 3:771f05bc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5_100Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.901991016, 2024-09-21T09:12:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023866490000000001, 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1557 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755808+0000", 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3330000000000001e-06 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760408+0000", 2024-09-21T09:12:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046002960000000002 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760449+0000", 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1681999999999998e-05 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760469+0000", 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9809999999999998e-05 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760669+0000", 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000200065 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.761108+0000", 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043852600000000001 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.762360+0000", 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001252555 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.778150+0000", 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015789290000000001 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779443+0000", 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012928289999999999 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779587+0000", 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014415900000000001 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779671+0000", 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3944999999999997e-05 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1596 3.21 3:8499e3d2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.412949166000001, 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017352083000000001, 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1596 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244852+0000", 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8250000000000001e-06 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249499+0000", 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046469349999999996 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249527+0000", 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7767e-05 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249538+0000", 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1138000000000001e-05 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249686+0000", 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148574 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249959+0000", 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027321399999999998 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.250202+0000", 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000242864 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.260647+0000", 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010445060000000001 2024-09-21T09:12:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262040+0000", 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001392449 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262126+0000", 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6388e-05 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262198+0000", 2024-09-21T09:12:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1868999999999999e-05 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1609 3.21 3:85d5ed9f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.249409867000001, 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016153879999999999, 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1609 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408387+0000", 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.956e-06 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411460+0000", 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030725240000000001 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411478+0000", 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8286000000000001e-05 2024-09-21T09:12:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411491+0000", 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.296e-05 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411695+0000", 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020357799999999999 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.412057+0000", 2024-09-21T09:12:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000362402 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.412539+0000", 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000481528 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.419746+0000", 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072079359999999999 2024-09-21T09:12:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424338+0000", 2024-09-21T09:12:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045913780000000001 2024-09-21T09:12:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424456+0000", 2024-09-21T09:12:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118334 2024-09-21T09:12:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424539+0000", 2024-09-21T09:12:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2997999999999994e-05 2024-09-21T09:12:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1765 3.21 3:871ca5b6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.0340248980000002, 2024-09-21T09:12:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022099173999999999, 2024-09-21T09:12:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1765 2024-09-21T09:12:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623775+0000", 2024-09-21T09:12:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4730000000000002e-06 2024-09-21T09:12:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.628965+0000", 2024-09-21T09:12:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051900050000000001 2024-09-21T09:12:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629006+0000", 2024-09-21T09:12:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1533999999999999e-05 2024-09-21T09:12:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629025+0000", 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8196e-05 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629157+0000", 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132781 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629415+0000", 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025730399999999997 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629647+0000", 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023241200000000001 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.641959+0000", 2024-09-21T09:12:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012311767 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645546+0000", 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035869560000000001 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645731+0000", 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018504200000000001 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645869+0000", 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013870399999999999 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1777 3.2e 3:74182f8a:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.860563843, 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019532442000000001, 2024-09-21T09:12:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1777 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797235+0000", 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3110000000000001e-06 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801081+0000", 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038459890000000002 2024-09-21T09:12:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801112+0000", 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1514999999999999e-05 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801129+0000", 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6934000000000001e-05 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801227+0000", 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7442999999999995e-05 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801430+0000", 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020329300000000001 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801614+0000", 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184525 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.807398+0000", 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057833529999999998 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816627+0000", 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092296080000000003 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816706+0000", 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8294999999999995e-05 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816764+0000", 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8176e-05 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1817 3.b 3:d1dcc069:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.31865396, 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017632233000000001, 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1817 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339144+0000", 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.328e-06 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343186+0000", 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040426910000000002 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343218+0000", 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2183e-05 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343233+0000", 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4430000000000001e-05 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343425+0000", 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019234499999999999 2024-09-21T09:12:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343871+0000", 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000445659 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.344300+0000", 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042892100000000002 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356373+0000", 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012073406 2024-09-21T09:12:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356567+0000", 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019390999999999999 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356680+0000", 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011297 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356773+0000", 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3389999999999999e-05 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1847 3.21 3:841376c9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.81507217799999998, 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02309464, 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1847 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842726+0000", 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7159999999999999e-06 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846655+0000", 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039289329999999999 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846681+0000", 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.635e-05 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846695+0000", 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3988999999999999e-05 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846786+0000", 2024-09-21T09:12:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0605000000000004e-05 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.847020+0000", 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000234458 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.847233+0000", 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021297699999999999 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.853208+0000", 2024-09-21T09:12:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059752599999999996 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865654+0000", 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012445289999999999 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865746+0000", 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2262000000000005e-05 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865818+0000", 2024-09-21T09:12:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1799999999999997e-05 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1885 3.b 3:d37941b6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.42653902999999999, 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017285139000000001, 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1885 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231259+0000", 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7779999999999999e-06 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235037+0000", 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037777710000000001 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235064+0000", 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7509e-05 2024-09-21T09:12:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235079+0000", 2024-09-21T09:12:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.432e-05 2024-09-21T09:12:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235199+0000", 2024-09-21T09:12:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120555 2024-09-21T09:12:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235451+0000", 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025202200000000002 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235673+0000", 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221547 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.243413+0000", 2024-09-21T09:12:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077399119999999998 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248203+0000", 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004790239 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248405+0000", 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020200099999999999 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248541+0000", 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013648499999999999 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1913 3.21 3:87dbe7e5:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.098337565000000002, 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016018510999999999, 2024-09-21T09:12:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1913 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559460+0000", 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0540000000000002e-06 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563313+0000", 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038530679999999999 2024-09-21T09:12:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563342+0000", 2024-09-21T09:12:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8765e-05 2024-09-21T09:12:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563355+0000", 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3217000000000001e-05 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563446+0000", 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1229000000000004e-05 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563625+0000", 2024-09-21T09:12:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017948000000000001 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563784+0000", 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015840099999999999 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.572444+0000", 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086599659999999998 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575327+0000", 2024-09-21T09:12:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028827639999999999 2024-09-21T09:12:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575407+0000", 2024-09-21T09:12:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0838000000000001e-05 2024-09-21T09:12:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575476+0000", 2024-09-21T09:12:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8728999999999999e-05 2024-09-21T09:12:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:41.783 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:41.784 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:41.784 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:41.785 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:41.785 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:41.783+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:41.786 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:41.786 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:41.787 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:41.787 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:41.787 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:41.788 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:41.795 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:41.796 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:41.839 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:41.865 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:41.866 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:41.885 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:41.883+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:41.986 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:41.983+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:41.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:42.071 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-09-21T09:12:42.086 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:42.083+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:42.187 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:42.183+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:42.195 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:42.196 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:42.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:42.289 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:42.287+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:42.390 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:42.387+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:42.407 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:42.407 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:42.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:42.459 INFO:tasks.workunit.client.0.smithi007.stdout:quota enabled for the user 0.403462817051576 2024-09-21T09:12:42.460 INFO:tasks.workunit.client.0.smithi007.stdout:adding file to bucket buck_2024_08_21_09_12_29: 1Gb. 2024-09-21T09:12:42.460 INFO:tasks.workunit.client.0.smithi007.stdout:upload file successful 2024-09-21T09:12:42.490 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:42.487+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:42.541 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:42.541 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:42.554 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:42.591 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:42.587+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:42.630 INFO:tasks.workunit.client.0.smithi007.stdout:Bucket Created: buck_2024_08_21_09_12_42 2024-09-21T09:12:42.691 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:42.687+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:42.720 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:42.720 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:42.734 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:42.792 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:42.787+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:42.892 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:42.892 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:42.893 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:42.887+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:42.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:42.994 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:42.991+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:43.077 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:43.077 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:43.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:43.095 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:43.091+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:43.196 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:43.191+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:43.260 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:43.260 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:43.277 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:43.296 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:43.295+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:43.393 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:43.393 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:43.397 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:43.395+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:43.410 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:43.498 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:43.495+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:43.571 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:43.571 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:43.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:43.598 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:43.595+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:43.692 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:43.693 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:43.699 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:43.695+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:43.705 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:43.800 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:43.799+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:43.824 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:43.824 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:43.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:43.897 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:43.901 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:43.895+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:43.974 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:43.974 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:43.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:44.002 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:43.999+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:44.053 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:44.053 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:44.071 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:44.088 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:44.088 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:44.102 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:44.099+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:44.104 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:44.104 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:44.107 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T09:12:44.109 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:44.109 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:44.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:44.125 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:44.125 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:44.144 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:44.145 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:44.162 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:44.162 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:44.181 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:44.181 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:44.245 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:44.243+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:44.257 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:44.257 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:44.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1265 3.3a e60/24 3:5cfa63b7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_22:head v 60'1, mlcod=0'0)", 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.022664847000001, 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025518386000000001, 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230288+0000", 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.230289+0000", 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1399999999999996e-07 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239530+0000", 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092409199999999997 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239574+0000", 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4301999999999997e-05 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239594+0000", 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9559999999999999e-05 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239779+0000", 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018548800000000001 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.239846+0000", 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6897999999999995e-05 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255678+0000", 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015831548000000001 2024-09-21T09:12:44.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.255807+0000", 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000128856 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1303 3.2b 3:d7a32023:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.546595035999999, 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017871702999999999, 2024-09-21T09:12:44.262 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1303 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706358+0000", 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.706362+0000", 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1659999999999996e-06 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712782+0000", 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006419803 2024-09-21T09:12:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712817+0000", 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5466000000000002e-05 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712838+0000", 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0919000000000001e-05 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.712933+0000", 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4452999999999998e-05 2024-09-21T09:12:44.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713042+0000", 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109304 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.713159+0000", 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011710299999999999 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.719777+0000", 2024-09-21T09:12:44.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006617497 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724152+0000", 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043755240000000004 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724191+0000", 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8337999999999998e-05 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.724230+0000", 2024-09-21T09:12:44.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.913e-05 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1304 3.2 3:40da9a43:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.527401224999998, 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018044510999999999, 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.268 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1304 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725552+0000", 2024-09-21T09:12:44.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.725555+0000", 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.977e-06 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730352+0000", 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047973670000000003 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730394+0000", 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2199e-05 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730412+0000", 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7679000000000001e-05 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730524+0000", 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011182400000000001 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730728+0000", 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000204448 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.730907+0000", 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000178753 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.736861+0000", 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059537629999999999 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743469+0000", 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066083970000000002 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743539+0000", 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9387000000000005e-05 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.743596+0000", 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7717000000000003e-05 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.273 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1319 3.1b 3:da10b4a0:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.228783372999999, 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020034222000000001, 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.274 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1319 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024170+0000", 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.024172+0000", 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6639999999999998e-06 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028099+0000", 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039262639999999996 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028132+0000", 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3155999999999999e-05 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028146+0000", 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3835999999999999e-05 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028273+0000", 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127436 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028566+0000", 2024-09-21T09:12:44.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029305899999999997 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.028799+0000", 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023329399999999999 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.040586+0000", 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011786173 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044077+0000", 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034909429999999998 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044145+0000", 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8182000000000006e-05 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.044204+0000", 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9215000000000001e-05 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.279 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1360 3.19 3:9846b005:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.467196686000001, 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022976068999999998, 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1360 2024-09-21T09:12:44.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785756+0000", 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.785759+0000", 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0539999999999999e-06 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792174+0000", 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064142349999999999 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792218+0000", 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4759000000000003e-05 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792239+0000", 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0931999999999999e-05 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792401+0000", 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016128900000000001 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.792724+0000", 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032341200000000003 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.793086+0000", 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000361751 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.800495+0000", 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074087129999999999 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808444+0000", 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079492120000000006 2024-09-21T09:12:44.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808604+0000", 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015997900000000001 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.808732+0000", 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012873299999999999 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1372 3.2b 3:d4d898f8:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.329223235000001, 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017677609, 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1372 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923730+0000", 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.923732+0000", 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7489999999999999e-06 2024-09-21T09:12:44.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927536+0000", 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038041720000000002 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927563+0000", 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7225000000000001e-05 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927578+0000", 2024-09-21T09:12:44.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4955e-05 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.927772+0000", 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019444199999999999 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.928019+0000", 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024669399999999999 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.928268+0000", 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024846999999999998 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.936113+0000", 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078454619999999992 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941192+0000", 2024-09-21T09:12:44.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050785589999999999 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941307+0000", 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115364 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.941407+0000", 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000100517 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1534 3.2b 3:d47ba0a2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.787455584, 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021807494, 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1534 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465497+0000", 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.465501+0000", 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4860000000000002e-06 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473846+0000", 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083450369999999996 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473888+0000", 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2079000000000001e-05 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.473915+0000", 2024-09-21T09:12:44.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7214000000000001e-05 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474073+0000", 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015771900000000001 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474356+0000", 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028332999999999999 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.474593+0000", 2024-09-21T09:12:44.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023622000000000001 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.486329+0000", 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011736483000000001 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487017+0000", 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068800299999999997 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487182+0000", 2024-09-21T09:12:44.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000164716 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.487305+0000", 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012320699999999999 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1545 3.2b 3:d625eaa7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.668165639000001, 2024-09-21T09:12:44.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017872958000000001, 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1545 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584787+0000", 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.584811+0000", 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3762000000000001e-05 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588898+0000", 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040866059999999996 2024-09-21T09:12:44.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588937+0000", 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9439e-05 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.588956+0000", 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8340000000000001e-05 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589073+0000", 2024-09-21T09:12:44.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0001175 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589331+0000", 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025805000000000001 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.589555+0000", 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223525 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.600733+0000", 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011178250000000001 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602354+0000", 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001621054 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602536+0000", 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018230500000000001 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602660+0000", 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124127 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1549 3.1b 3:dae9f2a4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.631355718999998, 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018896029000000002, 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.303 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1549 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621597+0000", 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.621602+0000", 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9300000000000002e-06 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627034+0000", 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054319820000000001 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627076+0000", 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1492000000000002e-05 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627095+0000", 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9636e-05 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627245+0000", 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014983299999999999 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627542+0000", 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029642600000000002 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.627779+0000", 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023740400000000001 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639133+0000", 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011353667 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640182+0000", 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010494510000000001 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640365+0000", 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018299500000000001 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.640493+0000", 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012821299999999999 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.308 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1599 3.7 3:e3ccd4a9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.963548679999999, 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017842754999999998, 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1599 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.309 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289404+0000", 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289408+0000", 2024-09-21T09:12:44.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2629999999999999e-06 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294631+0000", 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052238329999999998 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294652+0000", 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0381e-05 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294663+0000", 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.095e-05 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294756+0000", 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3329e-05 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.294975+0000", 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000219256 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.295187+0000", 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021132400000000001 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.306696+0000", 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011508846 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307149+0000", 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000453306 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307191+0000", 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2106e-05 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.307247+0000", 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6161e-05 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1607 3.2b 3:d67827bf:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:44.314 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.873027399000001, 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019045075000000002, 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1607 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379926+0000", 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.379929+0000", 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0589999999999998e-06 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383914+0000", 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039857199999999999 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383957+0000", 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2962e-05 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.383977+0000", 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9436000000000002e-05 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384091+0000", 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0001138 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384275+0000", 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000183983 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.384458+0000", 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000183723 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.390465+0000", 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060069199999999998 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398837+0000", 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0083720530000000008 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398915+0000", 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8108999999999994e-05 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.398971+0000", 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5309999999999997e-05 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1762 3.2 3:419781b7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.588453+0000", 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6645002829999997, 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021968516, 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.320 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1762 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.588453+0000", 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.588453+0000", 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.588456+0000", 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8700000000000001e-06 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.596459+0000", 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080037479999999998 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.596502+0000", 2024-09-21T09:12:44.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3027e-05 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.596537+0000", 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4480999999999997e-05 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.596645+0000", 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107648 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.596771+0000", 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126725 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.597005+0000", 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023416499999999999 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.604029+0000", 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070236969999999998 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.610135+0000", 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061059720000000003 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.610306+0000", 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017128 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.610421+0000", 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011490299999999999 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.325 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1776 3.1b 3:dbeb71e0:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.784421+0000", 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.4685316860000004, 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021678685, 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.326 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1776 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.784421+0000", 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.784421+0000", 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.784437+0000", 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5977999999999998e-05 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.789782+0000", 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053445080000000004 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.789815+0000", 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3482000000000002e-05 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.789830+0000", 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4234e-05 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.789951+0000", 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121264 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.790098+0000", 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000146887 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.790229+0000", 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013121500000000001 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.795577+0000", 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053476660000000001 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.805983+0000", 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010406307 2024-09-21T09:12:44.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.806041+0000", 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8455000000000002e-05 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.806100+0000", 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8689e-05 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1841 3.3c e66/24 3:3cd9c85f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_108:head v 66'11, mlcod=66'9)", 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.717545+0000", 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.5354079039999999, 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017311165999999999, 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.717545+0000", 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.717545+0000", 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.717547+0000", 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0470000000000001e-06 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.722325+0000", 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047781200000000003 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.722367+0000", 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2091000000000001e-05 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.722385+0000", 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7595999999999999e-05 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.722559+0000", 2024-09-21T09:12:44.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017439899999999999 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.722630+0000", 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0345999999999994e-05 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.734766+0000", 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012135849000000001 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.734856+0000", 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0717999999999994e-05 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1842 3.1b 3:d9ccba5d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.733648+0000", 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.5193054240000001, 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017422654999999999, 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.336 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1842 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.733648+0000", 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.733648+0000", 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.733650+0000", 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5890000000000001e-06 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.739184+0000", 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055335439999999996 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.739220+0000", 2024-09-21T09:12:44.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6003000000000001e-05 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.739234+0000", 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4062e-05 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.739392+0000", 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015851999999999999 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.739635+0000", 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024263799999999999 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.739866+0000", 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023059299999999999 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.746775+0000", 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069094600000000001 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.750973+0000", 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041982720000000003 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.751028+0000", 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4205e-05 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.751070+0000", 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2769000000000003e-05 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1886 3.19 3:9bcd268f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.242188+0000", 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.010764767, 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016754633000000001, 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1886 2024-09-21T09:12:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.242188+0000", 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.242188+0000", 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.242192+0000", 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7359999999999999e-06 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.246199+0000", 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040069379999999998 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.246240+0000", 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1247e-05 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.246259+0000", 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8788999999999999e-05 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.246438+0000", 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000179264 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.246706+0000", 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000267917 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.246924+0000", 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021786700000000001 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.253956+0000", 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070321480000000002 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.258722+0000", 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004766083 2024-09-21T09:12:44.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.258822+0000", 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9650999999999998e-05 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.258943+0000", 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120993 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.347 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1901 3.2b 3:d4e6805c:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.426741+0000", 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.826212451, 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016624053999999999, 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1901 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.426741+0000", 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.426741+0000", 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.426744+0000", 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.016e-06 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.430763+0000", 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040191309999999996 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.430801+0000", 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8118000000000003e-05 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.430819+0000", 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8572000000000001e-05 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.430967+0000", 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014745099999999999 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.431215+0000", 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024786300000000002 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.431451+0000", 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000236369 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.440129+0000", 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086782969999999997 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.443144+0000", 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030149830000000002 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.443250+0000", 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010559400000000001 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.443365+0000", 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011466 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1902 3.6 3:6306d919:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.436133+0000", 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.8168204060000002, 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020202187, 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.353 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1902 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.436133+0000", 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.436133+0000", 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.436136+0000", 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.54e-06 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.440281+0000", 2024-09-21T09:12:44.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041444239999999999 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.440311+0000", 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0385000000000001e-05 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.440327+0000", 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6291999999999999e-05 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.440469+0000", 2024-09-21T09:12:44.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014130100000000001 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.440708+0000", 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023954299999999999 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.440939+0000", 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000230557 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.448014+0000", 2024-09-21T09:12:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070754399999999997 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.455994+0000", 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079799090000000003 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.456164+0000", 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017003299999999999 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.456335+0000", 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017076299999999999 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1923 3.1b 3:d8a1ab79:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.669750+0000", 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.5832028519999999, 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017015489000000002, 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1923 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.669750+0000", 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.669750+0000", 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.669753+0000", 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.886e-06 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.674298+0000", 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045445349999999997 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.674327+0000", 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9692999999999998e-05 2024-09-21T09:12:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.674342+0000", 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4800000000000001e-05 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.674431+0000", 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9182000000000001e-05 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.674657+0000", 2024-09-21T09:12:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022613000000000001 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.674837+0000", 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017942699999999999 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.679681+0000", 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048436989999999999 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.686688+0000", 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070074880000000001 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.686726+0000", 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8062000000000003e-05 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.686766+0000", 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9586999999999999e-05 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1929 3.19 3:9b3465d6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.737323+0000", 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.5156296729999998, 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016572890999999999, 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1929 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.737323+0000", 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.737323+0000", 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.737326+0000", 2024-09-21T09:12:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-06 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.741108+0000", 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037814580000000001 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.741147+0000", 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9708e-05 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.741166+0000", 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9236e-05 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.741304+0000", 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013722499999999999 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.741544+0000", 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240459 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.741773+0000", 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000228867 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.751486+0000", 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0097129799999999995 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.753719+0000", 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002233329 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.753822+0000", 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010298699999999999 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.753896+0000", 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3992000000000006e-05 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.370 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:44.372 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:44.372 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:44.367+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:44.473 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:44.467+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:44.502 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:44.502 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:44.502 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:44.502 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:44.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:44.574 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:44.571+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:44.643 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:44.643 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:44.643 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:44.643 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:44.643 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:44.657 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:44.700 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:44.699+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:44.775 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:44.771+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:44.832 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1163 3.17 3:eb0740dd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.916334584000001, 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019360854, 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1163 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911569+0000", 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6460000000000002e-06 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917121+0000", 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005551846 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917164+0000", 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2916e-05 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917183+0000", 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8508999999999998e-05 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917318+0000", 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013504200000000001 2024-09-21T09:12:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917572+0000", 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025395300000000001 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917798+0000", 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022648300000000001 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.929367+0000", 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011568729999999999 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930809+0000", 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014424730000000001 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930883+0000", 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3910000000000002e-05 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930928+0000", 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4345999999999999e-05 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1235 3.18 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.846140866999999, 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028152907000000001, 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1235 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981763+0000", 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7700000000000002e-06 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988006+0000", 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062426979999999997 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988042+0000", 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6461999999999998e-05 2024-09-21T09:12:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988067+0000", 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4372999999999999e-05 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988210+0000", 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014307299999999999 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988480+0000", 2024-09-21T09:12:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026992500000000002 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988718+0000", 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023859400000000001 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.002159+0000", 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01344091 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009749+0000", 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075900769999999998 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009840+0000", 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0736999999999995e-05 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009913+0000", 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3287999999999994e-05 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1246 3.31 3:8d902261:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.827211424000001, 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022053738, 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1246 2024-09-21T09:12:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000694+0000", 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2599999999999999e-06 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004867+0000", 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041723300000000001 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004920+0000", 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2985000000000002e-05 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004948+0000", 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8362999999999999e-05 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005091+0000", 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000142903 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005381+0000", 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029025500000000001 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005674+0000", 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000292878 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.017583+0000", 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011908981000000001 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022585+0000", 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050024179999999998 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022674+0000", 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8486999999999995e-05 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022744+0000", 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9877999999999997e-05 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1250 3.0 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.771404564000001, 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026211538999999999, 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1250 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056500+0000", 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.18e-06 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061414+0000", 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049142930000000001 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061455+0000", 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0689000000000003e-05 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061475+0000", 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9760000000000001e-05 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061649+0000", 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000174308 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062062+0000", 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041290199999999998 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062448+0000", 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038618600000000001 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.075288+0000", 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012839623999999999 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082540+0000", 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072523489999999999 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082633+0000", 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3200000000000002e-05 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082708+0000", 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5048000000000004e-05 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1258 3.17 3:e9fd25dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.681676825, 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025293568999999998, 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1258 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146228+0000", 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8130000000000002e-06 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151893+0000", 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056641929999999997 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151937+0000", 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4768999999999998e-05 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151978+0000", 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0844999999999999e-05 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152239+0000", 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026088000000000001 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152546+0000", 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000306905 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152815+0000", 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268912 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.165057+0000", 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012242368 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171206+0000", 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006148349 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171389+0000", 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018327799999999999 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171518+0000", 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129257 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1260 3.17 3:eb13e7c3:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.656750366000001, 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021083792000000001, 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1260 2024-09-21T09:12:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171154+0000", 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9040000000000001e-06 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176055+0000", 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049010299999999998 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176092+0000", 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6662000000000002e-05 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176109+0000", 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7042999999999999e-05 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176228+0000", 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119747 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176521+0000", 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029217499999999999 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176753+0000", 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023253299999999999 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.187711+0000", 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010958324 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192068+0000", 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043564989999999998 2024-09-21T09:12:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192163+0000", 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.48e-05 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192235+0000", 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2075000000000004e-05 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1272 3.29 3:963d269b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.530373046000001, 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019343672999999999, 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1272 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297532+0000", 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-06 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300259+0000", 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027266579999999999 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300306+0000", 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6748e-05 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300325+0000", 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9752999999999999e-05 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300489+0000", 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016374200000000001 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300746+0000", 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025647300000000001 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300967+0000", 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022157700000000001 2024-09-21T09:12:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.309603+0000", 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086360010000000008 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316784+0000", 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071809450000000002 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316833+0000", 2024-09-21T09:12:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8949999999999997e-05 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316872+0000", 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1283 3.29 3:97ed8f1e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.414426309, 2024-09-21T09:12:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02166881, 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1283 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413478+0000", 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417497+0000", 2024-09-21T09:12:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004018822 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417541+0000", 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3961999999999997e-05 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417568+0000", 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6452999999999999e-05 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417777+0000", 2024-09-21T09:12:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020961499999999999 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418024+0000", 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000247159 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418257+0000", 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023203000000000001 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.427160+0000", 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089031600000000002 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435069+0000", 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079094850000000008 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435111+0000", 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1959000000000003e-05 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435144+0000", 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2815999999999999e-05 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1306 3.3d 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.069730141000001, 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020194347000000001, 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1306 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758174+0000", 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762157+0000", 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039825770000000002 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762201+0000", 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4245000000000001e-05 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762220+0000", 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8808999999999999e-05 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762324+0000", 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104033 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762588+0000", 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026391700000000001 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762811+0000", 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000222957 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.771599+0000", 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087878469999999997 2024-09-21T09:12:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778144+0000", 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065449810000000001 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778244+0000", 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9901000000000005e-05 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778366+0000", 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012201000000000001 2024-09-21T09:12:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1311 3.27 3:e6d5d281:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.968845952999999, 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024501067000000001, 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1311 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859057+0000", 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5149999999999999e-06 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862830+0000", 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037728620000000001 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862850+0000", 2024-09-21T09:12:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0264000000000001e-05 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862859+0000", 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2189999999999993e-06 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863041+0000", 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018214899999999999 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863291+0000", 2024-09-21T09:12:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024963299999999997 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863529+0000", 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023759000000000001 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.870237+0000", 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067083170000000001 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883389+0000", 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013151532 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883486+0000", 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7640999999999996e-05 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883557+0000", 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0345000000000005e-05 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1359 3.3d 3:bc104684:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.051390853000001, 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020340127, 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.891 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1359 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776514+0000", 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8770000000000003e-06 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783654+0000", 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071395319999999996 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783702+0000", 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8449000000000003e-05 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783722+0000", 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9398999999999998e-05 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783892+0000", 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017003 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784158+0000", 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026600899999999999 2024-09-21T09:12:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784416+0000", 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025767999999999999 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795150+0000", 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010734321 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795847+0000", 2024-09-21T09:12:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00069705199999999998 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796516+0000", 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066950600000000005 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796851+0000", 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033427199999999999 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1535 3.29 3:94169add:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.351316229999998, 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021366508999999999, 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1535 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476590+0000", 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7269999999999998e-06 2024-09-21T09:12:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483098+0000", 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065085480000000003 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483149+0000", 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0726000000000002e-05 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483171+0000", 2024-09-21T09:12:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1622999999999999e-05 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483359+0000", 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018774199999999999 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483790+0000", 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000431915 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.484215+0000", 2024-09-21T09:12:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000424664 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.493337+0000", 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091213739999999998 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497756+0000", 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044193039999999998 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497856+0000", 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9838000000000002e-05 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497952+0000", 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6047999999999999e-05 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1542 3.3d 3:bc2592c4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.275627413999999, 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019304961999999998, 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1542 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552277+0000", 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2160000000000002e-06 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556307+0000", 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040297140000000002 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556345+0000", 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7996e-05 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556381+0000", 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6121999999999997e-05 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556519+0000", 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013799999999999999 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556785+0000", 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026605299999999998 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557027+0000", 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241905 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.564209+0000", 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071818280000000003 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571404+0000", 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071951100000000002 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571496+0000", 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2269999999999996e-05 2024-09-21T09:12:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571579+0000", 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2748000000000001e-05 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1543 3.1e 3:7938dd95:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.266194577, 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020873849999999999, 2024-09-21T09:12:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1543 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561710+0000", 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2499999999999998e-06 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567451+0000", 2024-09-21T09:12:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005740864 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567493+0000", 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1851999999999998e-05 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567512+0000", 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-05 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567654+0000", 2024-09-21T09:12:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014127899999999999 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567918+0000", 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026440799999999999 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.568159+0000", 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240564 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.577966+0000", 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098075639999999995 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582419+0000", 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044529060000000004 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582514+0000", 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4438000000000006e-05 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582581+0000", 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7125000000000005e-05 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1594 3.1e 3:7b761948:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.615085358000002, 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.031784366000000001, 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1594 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212820+0000", 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0899999999999998e-06 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223204+0000", 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010383691 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223255+0000", 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1128000000000002e-05 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223283+0000", 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7523000000000001e-05 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223484+0000", 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149499999999999 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223901+0000", 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000417334 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224303+0000", 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040194699999999999 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.242455+0000", 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018151792999999999 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244504+0000", 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020487370000000001 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244559+0000", 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4959e-05 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244600+0000", 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1668999999999997e-05 2024-09-21T09:12:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1595 3.29 3:9443c179:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.603364128999999, 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020426626, 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1595 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224539+0000", 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.607e-06 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228447+0000", 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003908412 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228476+0000", 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9155000000000001e-05 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228488+0000", 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1274000000000001e-05 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228601+0000", 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113485 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228854+0000", 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025256399999999999 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.229066+0000", 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000212322 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.241625+0000", 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012559130999999999 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244748+0000", 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031230160000000002 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244898+0000", 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014988800000000001 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244964+0000", 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5772000000000007e-05 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1597 3.17 3:e845bb01:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.561852593000001, 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022999776, 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1597 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266050+0000", 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.451e-06 2024-09-21T09:12:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269917+0000", 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038665650000000002 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269941+0000", 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4465e-05 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269953+0000", 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2082000000000001e-05 2024-09-21T09:12:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270023+0000", 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9733000000000005e-05 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270183+0000", 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016033200000000001 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270338+0000", 2024-09-21T09:12:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015478399999999999 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.275262+0000", 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049237040000000001 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288908+0000", 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013646149 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288979+0000", 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1227000000000001e-05 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289049+0000", 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9283999999999996e-05 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1848 3.31 3:8ef6a1f2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.857660+0000", 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.9702413070000002, 2024-09-21T09:12:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019587855000000001, 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1848 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.857660+0000", 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.857660+0000", 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.857662+0000", 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7150000000000001e-06 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.861909+0000", 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042469049999999996 2024-09-21T09:12:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.861935+0000", 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5984000000000001e-05 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.861951+0000", 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6293000000000001e-05 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.862053+0000", 2024-09-21T09:12:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010244800000000001 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.862298+0000", 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024417299999999998 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.862525+0000", 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022785000000000001 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.869065+0000", 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065390500000000002 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.877159+0000", 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080948180000000002 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.877207+0000", 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7888e-05 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.877248+0000", 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0731e-05 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1904 3.3e 3:7dbd3d00:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.459879+0000", 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.3680225620000002, 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022385276999999999, 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1904 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.459879+0000", 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.459879+0000", 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.459882+0000", 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.196e-06 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.463893+0000", 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040105519999999997 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.463938+0000", 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5827e-05 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.463958+0000", 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9738999999999999e-05 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.464097+0000", 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013885500000000001 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.464347+0000", 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024990899999999998 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.464606+0000", 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025865799999999999 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.477859+0000", 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013253558 2024-09-21T09:12:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.481961+0000", 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041022039999999999 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.482101+0000", 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000139849 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.482264+0000", 2024-09-21T09:12:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016292999999999999 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1905 3.1e 3:7a089feb:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.471226+0000", 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.3566749580000002, 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021597684999999998, 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1905 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.471226+0000", 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.471226+0000", 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.471229+0000", 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475465+0000", 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042360540000000004 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475486+0000", 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1495e-05 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475502+0000", 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6039999999999999e-05 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475643+0000", 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141135 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475947+0000", 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030371899999999998 2024-09-21T09:12:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.476280+0000", 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033269300000000001 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.483111+0000", 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068314320000000001 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.492654+0000", 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095427589999999996 2024-09-21T09:12:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.492750+0000", 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5933000000000005e-05 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.492824+0000", 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4221999999999995e-05 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:44.948 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:44.950 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:44.950 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:44.947+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:45.050 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:45.047+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2024-09-21T09:12:45.130 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:45.130 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:45.130 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:45.130 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:45.144 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:45.151 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:45.147+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:45.252 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:45.247+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:45.316 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:45.317 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:45.331 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:45.353 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:45.351+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:45.454 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:45.451+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:45.462 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1235 3.18 e59/24 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.468420273, 2024-09-21T09:12:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020425276999999999, 2024-09-21T09:12:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988949+0000", 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3659999999999999e-06 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994552+0000", 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056024719999999998 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994598+0000", 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6365000000000001e-05 2024-09-21T09:12:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994624+0000", 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6132e-05 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994804+0000", 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180209 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994849+0000", 2024-09-21T09:12:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4838e-05 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009267+0000", 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014417780999999999 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009372+0000", 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105114 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1323 3.12 3:4a999ff4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.344463536999999, 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019594209000000001, 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1323 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112907+0000", 2024-09-21T09:12:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1e-06 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117323+0000", 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044160229999999998 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117368+0000", 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5105000000000003e-05 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117387+0000", 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.931e-05 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117571+0000", 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018423199999999999 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117976+0000", 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040424599999999998 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.118414+0000", 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043875199999999999 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.131859+0000", 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013444621 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132294+0000", 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043466199999999999 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132420+0000", 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012634699999999999 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132498+0000", 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7811000000000004e-05 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1332 3.33 3:cc16045e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.159496894, 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024640585, 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1332 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297873+0000", 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9560000000000002e-06 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302007+0000", 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041338299999999998 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302045+0000", 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7929000000000002e-05 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302062+0000", 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6844e-05 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302223+0000", 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000161232 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302631+0000", 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000408059 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.303057+0000", 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000425463 2024-09-21T09:12:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.312222+0000", 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091652239999999996 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322385+0000", 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010163292000000001 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322455+0000", 2024-09-21T09:12:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0104000000000005e-05 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322511+0000", 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5652000000000002e-05 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1340 3.24 3:244553ef:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.996776902000001, 2024-09-21T09:12:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022132493999999999, 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1340 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460593+0000", 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7259999999999998e-06 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465499+0000", 2024-09-21T09:12:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049057679999999996 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465546+0000", 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6692e-05 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465565+0000", 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9939e-05 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465709+0000", 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014318999999999999 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465937+0000", 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022867100000000001 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.466152+0000", 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000214637 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.473162+0000", 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070101199999999999 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482551+0000", 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093889520000000008 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482644+0000", 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2768000000000004e-05 2024-09-21T09:12:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482723+0000", 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030999999999996e-05 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1347 3.25 3:a6a24497:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.850641314000001, 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017645750000000002, 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1347 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606730+0000", 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6069999999999999e-06 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611645+0000", 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049153929999999997 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611688+0000", 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2658999999999999e-05 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611708+0000", 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.031e-05 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611908+0000", 2024-09-21T09:12:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020053399999999999 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612168+0000", 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025985100000000002 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612436+0000", 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026782899999999997 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.619627+0000", 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071906119999999999 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624183+0000", 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045566000000000001 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624279+0000", 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6113000000000006e-05 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624372+0000", 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2242000000000002e-05 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1540 3.5 e61/24 3:a26ab227:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_9:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.926387695999999, 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018163744999999999, 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530982+0000", 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8169999999999999e-06 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538703+0000", 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077210630000000002 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538740+0000", 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6495000000000002e-05 2024-09-21T09:12:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538759+0000", 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9259999999999999e-05 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538893+0000", 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013350999999999999 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538936+0000", 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3046000000000001e-05 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549057+0000", 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010120986 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549143+0000", 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6568000000000002e-05 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1550 3.1 3:83bb88f2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.825278128000001, 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884271000000001, 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1550 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632093+0000", 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9859999999999996e-06 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638741+0000", 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066476859999999999 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638784+0000", 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2982999999999998e-05 2024-09-21T09:12:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638802+0000", 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8026e-05 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638971+0000", 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016929600000000001 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639309+0000", 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000338315 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639731+0000", 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042143600000000002 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.652998+0000", 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013267187999999999 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654665+0000", 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001667106 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654849+0000", 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184212 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654973+0000", 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012403699999999999 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1553 3.25 3:a4ab7629:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.793595967999998, 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019797014000000002, 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1553 2024-09-21T09:12:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663774+0000", 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7089999999999998e-06 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668592+0000", 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048180580000000001 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668632+0000", 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9765999999999998e-05 2024-09-21T09:12:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668648+0000", 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6460000000000002e-05 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668837+0000", 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018921500000000001 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669259+0000", 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042197600000000001 2024-09-21T09:12:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669691+0000", 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043113599999999999 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683148+0000", 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013457184000000001 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683341+0000", 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019356899999999999 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683441+0000", 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9777000000000004e-05 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683568+0000", 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127164 2024-09-21T09:12:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1593 3.33 3:ccba01ee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.257642505, 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034096062000000003, 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1593 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199727+0000", 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.616e-06 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210215+0000", 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010487918000000001 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210257+0000", 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1375999999999998e-05 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210284+0000", 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7630000000000001e-05 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210450+0000", 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016565899999999999 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210824+0000", 2024-09-21T09:12:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037435799999999998 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.211233+0000", 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040886699999999999 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223360+0000", 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012127012 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233490+0000", 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010129917 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233690+0000", 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019989199999999999 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233821+0000", 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000130817 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1601 3.1 3:80d10627:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.144618321999999, 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018087450000000001, 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1601 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312751+0000", 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.503e-06 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316621+0000", 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038693740000000001 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316644+0000", 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3617000000000001e-05 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316657+0000", 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2213e-05 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316721+0000", 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4871999999999998e-05 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316835+0000", 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113594 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316940+0000", 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010543 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.321841+0000", 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049003730000000004 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330736+0000", 2024-09-21T09:12:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008894941 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330783+0000", 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6811000000000003e-05 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330836+0000", 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3721999999999998e-05 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1779 3.33 3:cf2f93e7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.6359260290000002, 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018811553000000002, 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1779 2024-09-21T09:12:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821446+0000", 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999999e-06 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825426+0000", 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039806329999999999 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825466+0000", 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9860999999999997e-05 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825486+0000", 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9802000000000001e-05 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825623+0000", 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013701499999999999 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825875+0000", 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000252224 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.826117+0000", 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024205799999999999 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.832983+0000", 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068659560000000003 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840056+0000", 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070724200000000003 2024-09-21T09:12:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840166+0000", 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110423 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840253+0000", 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6730999999999993e-05 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1786 3.24 3:26afb083:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.5473063539999998, 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017381338, 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1786 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910071+0000", 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0083e-05 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915610+0000", 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055387580000000004 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915654+0000", 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4527999999999998e-05 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915674+0000", 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0191999999999999e-05 2024-09-21T09:12:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915777+0000", 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102301 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915933+0000", 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015625700000000001 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.916070+0000", 2024-09-21T09:12:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000137236 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.924065+0000", 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079951290000000001 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927320+0000", 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032548210000000002 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927388+0000", 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7847000000000003e-05 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927442+0000", 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4185999999999999e-05 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1821 3.4 3:220bbc7d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.0671699019999998, 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884436000000001, 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1821 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390201+0000", 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4359999999999998e-06 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.394951+0000", 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047500119999999996 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.394993+0000", 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2573e-05 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395011+0000", 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7782999999999999e-05 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395212+0000", 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000200848 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395467+0000", 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025509699999999997 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395699+0000", 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023194900000000001 2024-09-21T09:12:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.403439+0000", 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077395509999999999 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.412978+0000", 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095393089999999993 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.413031+0000", 2024-09-21T09:12:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3498999999999997e-05 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.413082+0000", 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0379e-05 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1845 3.1 3:83de2a14:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.801729+0000", 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6556380720000003, 2024-09-21T09:12:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021697627000000001, 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1845 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.801729+0000", 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.801729+0000", 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.801739+0000", 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0121e-05 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805691+0000", 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039520409999999999 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805723+0000", 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2153000000000002e-05 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805737+0000", 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3913999999999999e-05 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805823+0000", 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6102999999999999e-05 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805984+0000", 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016028599999999999 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.806122+0000", 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013851 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.810930+0000", 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048081590000000002 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.823296+0000", 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012365665 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.823352+0000", 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5940999999999999e-05 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.823427+0000", 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4734000000000006e-05 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1873 3.12 3:4955beba:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.087650+0000", 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.369717326, 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018306975, 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1873 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.087650+0000", 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.087650+0000", 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.087653+0000", 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3340000000000002e-06 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091588+0000", 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039349989999999998 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091631+0000", 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2740000000000001e-05 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091671+0000", 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0250999999999998e-05 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091853+0000", 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000181936 2024-09-21T09:12:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.092278+0000", 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042514799999999998 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.092717+0000", 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043888800000000002 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.102005+0000", 2024-09-21T09:12:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092876320000000005 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.105847+0000", 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038424269999999998 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.105908+0000", 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0992000000000002e-05 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.105957+0000", 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8628000000000003e-05 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1916 3.24 3:278f10aa:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.591627+0000", 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.8657398679999999, 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018567160999999999, 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1916 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.591627+0000", 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.591627+0000", 2024-09-21T09:12:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.591630+0000", 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6769999999999999e-06 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595380+0000", 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003750265 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595409+0000", 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8535e-05 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595423+0000", 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4299e-05 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595516+0000", 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3241999999999999e-05 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595677+0000", 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016073899999999999 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595826+0000", 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148839 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.601944+0000", 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061175860000000004 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.610085+0000", 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0081411350000000007 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.610152+0000", 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7138999999999995e-05 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.610195+0000", 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2704999999999999e-05 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1930 3.25 3:a48e38fc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.749346+0000", 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.7080209979999998, 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019726848000000002, 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1930 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.749346+0000", 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.749346+0000", 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.749390+0000", 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3881000000000002e-05 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.753954+0000", 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045636349999999999 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.753994+0000", 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0682000000000001e-05 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754020+0000", 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5981000000000001e-05 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754157+0000", 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013675499999999999 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754398+0000", 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241153 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754644+0000", 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024586600000000002 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.763986+0000", 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093414110000000009 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.768763+0000", 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047770989999999999 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.768944+0000", 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018164 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.769073+0000", 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012874499999999999 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1931 3.24 3:26cd634c:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.760522+0000", 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.6968451240000002, 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021060718999999999, 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1931 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.760522+0000", 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.760522+0000", 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.760526+0000", 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7929999999999999e-06 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.764987+0000", 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044612209999999996 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765033+0000", 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6241e-05 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765061+0000", 2024-09-21T09:12:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7418000000000001e-05 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765222+0000", 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016105399999999999 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765569+0000", 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034681700000000002 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765797+0000", 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022870200000000001 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.780465+0000", 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014667695999999999 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781292+0000", 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00082726399999999997 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781456+0000", 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163898 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781583+0000", 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012661500000000001 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1934 3.7 e66/24 3:e2d55273:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_191:head v 66'4, mlcod=62'2)", 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.800593+0000", 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.6567745600000001, 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023533157999999998, 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.800593+0000", 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.800593+0000", 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.800595+0000", 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3259999999999998e-06 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807173+0000", 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065779369999999998 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807224+0000", 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0794000000000002e-05 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807251+0000", 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6868000000000001e-05 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807435+0000", 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184916 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807495+0000", 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9679999999999998e-05 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.823968+0000", 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016472992999999998 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.824126+0000", 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000157644 2024-09-21T09:12:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1935 3.4 3:23c8af85:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.804040+0000", 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.6533277100000001, 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025977671000000001, 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1935 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.804040+0000", 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.804040+0000", 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.804042+0000", 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7829999999999999e-06 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810574+0000", 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065318269999999996 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810623+0000", 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8649999999999997e-05 2024-09-21T09:12:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810648+0000", 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5128999999999999e-05 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810833+0000", 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018524599999999999 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.811283+0000", 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00045005300000000001 2024-09-21T09:12:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.811770+0000", 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000486689 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.827600+0000", 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015830462999999999 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.829839+0000", 2024-09-21T09:12:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022383289999999998 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.829933+0000", 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4310999999999999e-05 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.830017+0000", 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4190999999999994e-05 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:45.576 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:45.576 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:45.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:45.577 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:45.571+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:45.677 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:45.675+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:45.753 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:45.753 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:45.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:45.809 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:45.807+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:45.879 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:45.875+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:45.938 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:45.938 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:45.938 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:45.938 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:45.938 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:45.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:45.997 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:45.995+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:46.081 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:46.079+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:46.131 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1250 3.0 e59/24 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.064029757, 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019412175, 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062729+0000", 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4399999999999999e-06 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068286+0000", 2024-09-21T09:12:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055572190000000004 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068320+0000", 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4069000000000002e-05 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068339+0000", 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8433000000000001e-05 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068528+0000", 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018950099999999999 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068587+0000", 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8545999999999998e-05 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082000+0000", 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013412884999999999 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082139+0000", 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013908200000000001 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1257 3.2e 3:748eda2f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.993005432, 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.030777402999999998, 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1257 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133755+0000", 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6890000000000002e-06 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.148913+0000", 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015158207 2024-09-21T09:12:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.148973+0000", 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0424999999999998e-05 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149005+0000", 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1588999999999999e-05 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149191+0000", 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000186391 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149587+0000", 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039548900000000001 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149983+0000", 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000395929 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.163254+0000", 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013271173000000001 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164324+0000", 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010705039999999999 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164449+0000", 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012412600000000001 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164528+0000", 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9881000000000003e-05 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1271 3.2e 3:76653b78:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.840544914999999, 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021378690999999998, 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1271 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286214+0000", 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7099999999999999e-06 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291359+0000", 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005144554 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291399+0000", 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9983e-05 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291427+0000", 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8152000000000001e-05 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291603+0000", 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176028 2024-09-21T09:12:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291857+0000", 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025373000000000003 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.292093+0000", 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023640999999999999 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.304468+0000", 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012374970000000001 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307321+0000", 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002852491 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307474+0000", 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015347900000000001 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307590+0000", 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116184 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1312 3.b 3:d07beb3d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.244335155000002, 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020651398000000001, 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1312 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882425+0000", 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6600000000000001e-06 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886385+0000", 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039597679999999998 2024-09-21T09:12:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886407+0000", 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2143000000000001e-05 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886417+0000", 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9620000000000005e-06 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886510+0000", 2024-09-21T09:12:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3453000000000001e-05 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886739+0000", 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022843599999999999 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886953+0000", 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021450000000000001 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892836+0000", 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058827300000000001 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902975+0000", 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010139426999999999 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.903028+0000", 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2608999999999997e-05 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.903073+0000", 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4709999999999997e-05 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1320 3.2e 3:75d4642b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.079325898, 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018026718000000001, 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1320 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047434+0000", 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051443+0000", 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040093439999999998 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051486+0000", 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3222000000000001e-05 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051513+0000", 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6401999999999999e-05 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051655+0000", 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014170400000000001 2024-09-21T09:12:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051826+0000", 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017193500000000001 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051987+0000", 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016016000000000001 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.057648+0000", 2024-09-21T09:12:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056618600000000003 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065327+0000", 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076783520000000003 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065398+0000", 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1675999999999996e-05 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065457+0000", 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8839999999999999e-05 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1324 3.2e 3:773eeeb4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.991230731000002, 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020230399, 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1324 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135529+0000", 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1700000000000001e-06 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139590+0000", 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040607860000000003 2024-09-21T09:12:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139626+0000", 2024-09-21T09:12:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6508999999999999e-05 2024-09-21T09:12:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139651+0000", 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4692e-05 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139740+0000", 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8800000000000004e-05 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139853+0000", 2024-09-21T09:12:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011372200000000001 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139948+0000", 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4049999999999996e-05 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.144662+0000", 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047143530000000001 2024-09-21T09:12:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155681+0000", 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011019153 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155723+0000", 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2014000000000001e-05 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155756+0000", 2024-09-21T09:12:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3149999999999999e-05 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1344 3.b 3:d3ddf01f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.589030512000001, 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017394212999999999, 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1344 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537729+0000", 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.157e-06 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542421+0000", 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046917460000000001 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542457+0000", 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6396000000000002e-05 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542475+0000", 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7663e-05 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542621+0000", 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145943 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542894+0000", 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027341300000000002 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.543122+0000", 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227557 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.554640+0000", 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011517853999999999 2024-09-21T09:12:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.554941+0000", 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030173899999999998 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.555035+0000", 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3640999999999993e-05 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.555120+0000", 2024-09-21T09:12:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5104000000000004e-05 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1368 3.2e 3:74fb0022:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.249443497000001, 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015885940000000001, 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1368 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877316+0000", 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5380000000000001e-06 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881169+0000", 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038535430000000001 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881196+0000", 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539000000000001e-05 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881208+0000", 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1919999999999999e-05 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881267+0000", 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9691999999999997e-05 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881393+0000", 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126129 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881508+0000", 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114156 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.885968+0000", 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004460365 2024-09-21T09:12:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893120+0000", 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007152538 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893162+0000", 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1854000000000003e-05 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893199+0000", 2024-09-21T09:12:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6665999999999998e-05 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1377 3.21 3:85925c47:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.142061913999999, 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016148349999999999, 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1377 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984699+0000", 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0029999999999996e-06 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989011+0000", 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004312209 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989050+0000", 2024-09-21T09:12:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9496000000000003e-05 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989070+0000", 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9306000000000001e-05 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989244+0000", 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000173945 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989640+0000", 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039646700000000001 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.990033+0000", 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039296300000000003 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.999277+0000", 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092444799999999994 2024-09-21T09:12:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000657+0000", 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013798059999999999 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000761+0000", 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103665 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000843+0000", 2024-09-21T09:12:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2009999999999996e-05 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1546 3.1d e61/43 3:b8116d35:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_15:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.531876279999999, 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018965064, 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594884+0000", 2024-09-21T09:12:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3330000000000001e-06 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601862+0000", 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069784510000000001 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601909+0000", 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7052000000000003e-05 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601932+0000", 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2962000000000001e-05 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602065+0000", 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013274700000000001 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602106+0000", 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1625999999999998e-05 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.613748+0000", 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011642062 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.613845+0000", 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6830999999999995e-05 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1557 3.2e 3:771f05bc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5_100Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.370952331000002, 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023866490000000001, 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1557 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755808+0000", 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3330000000000001e-06 2024-09-21T09:12:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760408+0000", 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046002960000000002 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760449+0000", 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1681999999999998e-05 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760469+0000", 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9809999999999998e-05 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760669+0000", 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000200065 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.761108+0000", 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043852600000000001 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.762360+0000", 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001252555 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.778150+0000", 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015789290000000001 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779443+0000", 2024-09-21T09:12:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012928289999999999 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779587+0000", 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014415900000000001 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779671+0000", 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3944999999999997e-05 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1596 3.21 3:8499e3d2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.881910480999998, 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017352083000000001, 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1596 2024-09-21T09:12:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244852+0000", 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8250000000000001e-06 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249499+0000", 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046469349999999996 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249527+0000", 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7767e-05 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249538+0000", 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1138000000000001e-05 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249686+0000", 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148574 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249959+0000", 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027321399999999998 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.250202+0000", 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000242864 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.260647+0000", 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010445060000000001 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262040+0000", 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001392449 2024-09-21T09:12:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262126+0000", 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6388e-05 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262198+0000", 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1868999999999999e-05 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1609 3.21 3:85d5ed9f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.718371181999998, 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016153879999999999, 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1609 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408387+0000", 2024-09-21T09:12:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.956e-06 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411460+0000", 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030725240000000001 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411478+0000", 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8286000000000001e-05 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411491+0000", 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.296e-05 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411695+0000", 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020357799999999999 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.412057+0000", 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000362402 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.412539+0000", 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000481528 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.419746+0000", 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072079359999999999 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424338+0000", 2024-09-21T09:12:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045913780000000001 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424456+0000", 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118334 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424539+0000", 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2997999999999994e-05 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1765 3.21 3:871ca5b6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.5029862129999998, 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022099173999999999, 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1765 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623775+0000", 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4730000000000002e-06 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.628965+0000", 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051900050000000001 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629006+0000", 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1533999999999999e-05 2024-09-21T09:12:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629025+0000", 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8196e-05 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629157+0000", 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132781 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629415+0000", 2024-09-21T09:12:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025730399999999997 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629647+0000", 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023241200000000001 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.641959+0000", 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012311767 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645546+0000", 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035869560000000001 2024-09-21T09:12:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645731+0000", 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018504200000000001 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645869+0000", 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013870399999999999 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1777 3.2e 3:74182f8a:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.329525158, 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019532442000000001, 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1777 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797235+0000", 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3110000000000001e-06 2024-09-21T09:12:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801081+0000", 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038459890000000002 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801112+0000", 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1514999999999999e-05 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801129+0000", 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6934000000000001e-05 2024-09-21T09:12:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801227+0000", 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7442999999999995e-05 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801430+0000", 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020329300000000001 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801614+0000", 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184525 2024-09-21T09:12:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.807398+0000", 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057833529999999998 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816627+0000", 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092296080000000003 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816706+0000", 2024-09-21T09:12:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8294999999999995e-05 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816764+0000", 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8176e-05 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1817 3.b 3:d1dcc069:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7876152750000003, 2024-09-21T09:12:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017632233000000001, 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1817 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339144+0000", 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.328e-06 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343186+0000", 2024-09-21T09:12:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040426910000000002 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343218+0000", 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2183e-05 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343233+0000", 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4430000000000001e-05 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343425+0000", 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019234499999999999 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343871+0000", 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000445659 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.344300+0000", 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042892100000000002 2024-09-21T09:12:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356373+0000", 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012073406 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356567+0000", 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019390999999999999 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356680+0000", 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011297 2024-09-21T09:12:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356773+0000", 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3389999999999999e-05 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1847 3.21 3:841376c9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2840334929999999, 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02309464, 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1847 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842726+0000", 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7159999999999999e-06 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846655+0000", 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039289329999999999 2024-09-21T09:12:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846681+0000", 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.635e-05 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846695+0000", 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3988999999999999e-05 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846786+0000", 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0605000000000004e-05 2024-09-21T09:12:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.847020+0000", 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000234458 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.847233+0000", 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021297699999999999 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.853208+0000", 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059752599999999996 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865654+0000", 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012445289999999999 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865746+0000", 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2262000000000005e-05 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865818+0000", 2024-09-21T09:12:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1799999999999997e-05 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1885 3.b 3:d37941b6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.8955003450000003, 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017285139000000001, 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1885 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231259+0000", 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7779999999999999e-06 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235037+0000", 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037777710000000001 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235064+0000", 2024-09-21T09:12:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7509e-05 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235079+0000", 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.432e-05 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235199+0000", 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120555 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235451+0000", 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025202200000000002 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235673+0000", 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221547 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.243413+0000", 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077399119999999998 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248203+0000", 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004790239 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248405+0000", 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020200099999999999 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248541+0000", 2024-09-21T09:12:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013648499999999999 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1913 3.21 3:87dbe7e5:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5672988800000001, 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016018510999999999, 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1913 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559460+0000", 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0540000000000002e-06 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563313+0000", 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038530679999999999 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563342+0000", 2024-09-21T09:12:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8765e-05 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563355+0000", 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3217000000000001e-05 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563446+0000", 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1229000000000004e-05 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563625+0000", 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017948000000000001 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563784+0000", 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015840099999999999 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.572444+0000", 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086599659999999998 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575327+0000", 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028827639999999999 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575407+0000", 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0838000000000001e-05 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575476+0000", 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8728999999999999e-05 2024-09-21T09:12:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1932 3.1d e66/43 3:ba4e63e7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_189:head v 66'13, mlcod=66'11)", 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.773715+0000", 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3530419599999997, 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017760706000000001, 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.773715+0000", 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.773715+0000", 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.773717+0000", 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:12:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781583+0000", 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078659739999999995 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781627+0000", 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4246999999999998e-05 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781646+0000", 2024-09-21T09:12:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9539e-05 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781760+0000", 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011317 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781802+0000", 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2543999999999998e-05 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.791376+0000", 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095742450000000003 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.791475+0000", 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8844000000000004e-05 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:46.247 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:46.248 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:46.249 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:46.250 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:46.247+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:46.351 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:46.347+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:46.379 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:46.379 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:46.380 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:46.380 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:46.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:46.408 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:46.426 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T09:12:46.426 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T09:12:46.426 INFO:tasks.thrashosds.thrasher:Removing osd 2, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T09:12:46.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 2 2024-09-21T09:12:46.428 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:46.428 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:46.461 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:46.461 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:46.461 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:46.455+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:46.494 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:46.495 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:46.524 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:46.525 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:46.545 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:46.552 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:46.547+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:46.556 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:46.556 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:46.567 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:46.567 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:46.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:46.588 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:46.589 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:46.652 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:46.651+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:46.707 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:46.707 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:46.722 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:46.737 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-09-21T09:12:46.735+0000 7f640a5ef640 -1 mon.a@0(leader).osd e68 definitely_dead 0 2024-09-21T09:12:46.753 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:46.747+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:46.841 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:46.842 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:46.854 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:46.851+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:46.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:46.955 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:46.951+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:47.025 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:47.025 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:47.040 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:marked out osd.2. 2024-09-21T09:12:47.078 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:47.075+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:47.102 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T09:12:47.169 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:47.167+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:47.184 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:47.184 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:47.199 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:47.285 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:47.283+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:47.359 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:47.359 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:47.359 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:47.355+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:47.374 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:47.461 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:47.459+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:47.535 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:47.535 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:47.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:47.560 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:47.559+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:47.661 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:47.659+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:47.713 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:47.714 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:47.728 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:47.773 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:47.771+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:47.855 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:47.863 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:47.859+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:47.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:47.963 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:47.959+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:48.042 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:48.042 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:48.057 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:48.064 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:48.059+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-09-21T09:12:48.197 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:48.195+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:48.233 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:48.233 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:48.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:48.300 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:48.299+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:48.366 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:48.363+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:48.415 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:48.416 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:48.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:48.477 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:48.475+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:48.569 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:48.563+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:48.609 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:48.623 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:48.623 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:48.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:48.689 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:48.687+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:48.770 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:48.767+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:48.789 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:48.806 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:48.830 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:48.855 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:48.855 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:48.876 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:48.875+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:48.877 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:48.878 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:48.900 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:48.901 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:48.925 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:48.925 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:48.946 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:48.967 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:48.968 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:48.972 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:48.967+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:48.993 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:48.993 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:48.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:48.993 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGPushReply(3.1e 70/69 [PushReplyOp(3:7b7fabe6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_79:head)])", 2024-09-21T09:12:48.993 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:48.991304+0000", 2024-09-21T09:12:48.993 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.001182603, 2024-09-21T09:12:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001210944, 2024-09-21T09:12:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-21T09:12:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:48.991304+0000", 2024-09-21T09:12:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:48.991304+0000", 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:48.991304+0000", 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7000000000000003e-07 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:48.991311+0000", 2024-09-21T09:12:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0449999999999997e-06 2024-09-21T09:12:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:48.991331+0000", 2024-09-21T09:12:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0760000000000001e-05 2024-09-21T09:12:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:48.991340+0000", 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0780000000000002e-06 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:48.991405+0000", 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4309999999999999e-05 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-21T09:12:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 1 2024-09-21T09:12:48.998 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:49.017 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:49.104 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:49.103+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:49.174 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:49.171+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:49.193 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:49.193 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:49.193 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:49.193 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:49.193 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:49.210 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:49.274 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:49.271+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:49.375 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:49.371+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:49.379 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:49.379 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:49.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:49.379 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:49.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.379 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1163 3.17 3:eb0740dd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.465257387999998, 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019360854, 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1163 2024-09-21T09:12:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911569+0000", 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6460000000000002e-06 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917121+0000", 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005551846 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917164+0000", 2024-09-21T09:12:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2916e-05 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917183+0000", 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8508999999999998e-05 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917318+0000", 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013504200000000001 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917572+0000", 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025395300000000001 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917798+0000", 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022648300000000001 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.929367+0000", 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011568729999999999 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930809+0000", 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014424730000000001 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930883+0000", 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3910000000000002e-05 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930928+0000", 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4345999999999999e-05 2024-09-21T09:12:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1235 3.18 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.395063670999999, 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028152907000000001, 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1235 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981763+0000", 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7700000000000002e-06 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988006+0000", 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062426979999999997 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988042+0000", 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6461999999999998e-05 2024-09-21T09:12:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988067+0000", 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4372999999999999e-05 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988210+0000", 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014307299999999999 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988480+0000", 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026992500000000002 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988718+0000", 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023859400000000001 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.002159+0000", 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01344091 2024-09-21T09:12:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009749+0000", 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075900769999999998 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009840+0000", 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0736999999999995e-05 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009913+0000", 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3287999999999994e-05 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1246 3.31 3:8d902261:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.376134228000002, 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022053738, 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1246 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000694+0000", 2024-09-21T09:12:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2599999999999999e-06 2024-09-21T09:12:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004867+0000", 2024-09-21T09:12:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041723300000000001 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004920+0000", 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2985000000000002e-05 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004948+0000", 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8362999999999999e-05 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005091+0000", 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000142903 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005381+0000", 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029025500000000001 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005674+0000", 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000292878 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.017583+0000", 2024-09-21T09:12:49.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011908981000000001 2024-09-21T09:12:49.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022585+0000", 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050024179999999998 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022674+0000", 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8486999999999995e-05 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022744+0000", 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9877999999999997e-05 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1250 3.0 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.320327368000001, 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026211538999999999, 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1250 2024-09-21T09:12:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056500+0000", 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.18e-06 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061414+0000", 2024-09-21T09:12:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049142930000000001 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061455+0000", 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0689000000000003e-05 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061475+0000", 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9760000000000001e-05 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061649+0000", 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000174308 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062062+0000", 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041290199999999998 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062448+0000", 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038618600000000001 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.075288+0000", 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012839623999999999 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082540+0000", 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072523489999999999 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082633+0000", 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3200000000000002e-05 2024-09-21T09:12:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082708+0000", 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5048000000000004e-05 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1258 3.17 3:e9fd25dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.230599629, 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025293568999999998, 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1258 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146228+0000", 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8130000000000002e-06 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151893+0000", 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056641929999999997 2024-09-21T09:12:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151937+0000", 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4768999999999998e-05 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151978+0000", 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0844999999999999e-05 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152239+0000", 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026088000000000001 2024-09-21T09:12:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152546+0000", 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000306905 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152815+0000", 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268912 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.165057+0000", 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012242368 2024-09-21T09:12:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171206+0000", 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006148349 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171389+0000", 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018327799999999999 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171518+0000", 2024-09-21T09:12:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129257 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1260 3.17 3:eb13e7c3:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.205673170000001, 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021083792000000001, 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1260 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171154+0000", 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9040000000000001e-06 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176055+0000", 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049010299999999998 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176092+0000", 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6662000000000002e-05 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176109+0000", 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7042999999999999e-05 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176228+0000", 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119747 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176521+0000", 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029217499999999999 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176753+0000", 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023253299999999999 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.187711+0000", 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010958324 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192068+0000", 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043564989999999998 2024-09-21T09:12:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192163+0000", 2024-09-21T09:12:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.48e-05 2024-09-21T09:12:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192235+0000", 2024-09-21T09:12:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2075000000000004e-05 2024-09-21T09:12:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1272 3.29 3:963d269b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.079295850000001, 2024-09-21T09:12:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019343672999999999, 2024-09-21T09:12:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1272 2024-09-21T09:12:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297532+0000", 2024-09-21T09:12:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-06 2024-09-21T09:12:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300259+0000", 2024-09-21T09:12:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027266579999999999 2024-09-21T09:12:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300306+0000", 2024-09-21T09:12:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6748e-05 2024-09-21T09:12:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300325+0000", 2024-09-21T09:12:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9752999999999999e-05 2024-09-21T09:12:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300489+0000", 2024-09-21T09:12:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016374200000000001 2024-09-21T09:12:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300746+0000", 2024-09-21T09:12:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025647300000000001 2024-09-21T09:12:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300967+0000", 2024-09-21T09:12:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022157700000000001 2024-09-21T09:12:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.309603+0000", 2024-09-21T09:12:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086360010000000008 2024-09-21T09:12:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316784+0000", 2024-09-21T09:12:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071809450000000002 2024-09-21T09:12:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316833+0000", 2024-09-21T09:12:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8949999999999997e-05 2024-09-21T09:12:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316872+0000", 2024-09-21T09:12:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-21T09:12:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1283 3.29 3:97ed8f1e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.963349113, 2024-09-21T09:12:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02166881, 2024-09-21T09:12:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1283 2024-09-21T09:12:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.432 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413478+0000", 2024-09-21T09:12:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417497+0000", 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004018822 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417541+0000", 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3961999999999997e-05 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417568+0000", 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6452999999999999e-05 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417777+0000", 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020961499999999999 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418024+0000", 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000247159 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418257+0000", 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023203000000000001 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.427160+0000", 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089031600000000002 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435069+0000", 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079094850000000008 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435111+0000", 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1959000000000003e-05 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435144+0000", 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2815999999999999e-05 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1306 3.3d 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.618652945000001, 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020194347000000001, 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1306 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758174+0000", 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762157+0000", 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039825770000000002 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762201+0000", 2024-09-21T09:12:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4245000000000001e-05 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762220+0000", 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8808999999999999e-05 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762324+0000", 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104033 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762588+0000", 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026391700000000001 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762811+0000", 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000222957 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.771599+0000", 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087878469999999997 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778144+0000", 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065449810000000001 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778244+0000", 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9901000000000005e-05 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778366+0000", 2024-09-21T09:12:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012201000000000001 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1311 3.27 3:e6d5d281:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.517768756999999, 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024501067000000001, 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1311 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859057+0000", 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5149999999999999e-06 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862830+0000", 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037728620000000001 2024-09-21T09:12:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862850+0000", 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0264000000000001e-05 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862859+0000", 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2189999999999993e-06 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863041+0000", 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018214899999999999 2024-09-21T09:12:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863291+0000", 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024963299999999997 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863529+0000", 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023759000000000001 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.870237+0000", 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067083170000000001 2024-09-21T09:12:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883389+0000", 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013151532 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883486+0000", 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7640999999999996e-05 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883557+0000", 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0345000000000005e-05 2024-09-21T09:12:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1359 3.3d 3:bc104684:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 26.600313657000001, 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020340127, 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1359 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776514+0000", 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8770000000000003e-06 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783654+0000", 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071395319999999996 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783702+0000", 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8449000000000003e-05 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783722+0000", 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9398999999999998e-05 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783892+0000", 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017003 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784158+0000", 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026600899999999999 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784416+0000", 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025767999999999999 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795150+0000", 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010734321 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795847+0000", 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00069705199999999998 2024-09-21T09:12:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796516+0000", 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066950600000000005 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796851+0000", 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033427199999999999 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1535 3.29 3:94169add:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.900239033999998, 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021366508999999999, 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1535 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476590+0000", 2024-09-21T09:12:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7269999999999998e-06 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483098+0000", 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065085480000000003 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483149+0000", 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0726000000000002e-05 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483171+0000", 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1622999999999999e-05 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483359+0000", 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018774199999999999 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483790+0000", 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000431915 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.484215+0000", 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000424664 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.493337+0000", 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091213739999999998 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497756+0000", 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044193039999999998 2024-09-21T09:12:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497856+0000", 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9838000000000002e-05 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497952+0000", 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6047999999999999e-05 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1542 3.3d 3:bc2592c4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.824550217999999, 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019304961999999998, 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1542 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552277+0000", 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2160000000000002e-06 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556307+0000", 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040297140000000002 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556345+0000", 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7996e-05 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556381+0000", 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6121999999999997e-05 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556519+0000", 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013799999999999999 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556785+0000", 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026605299999999998 2024-09-21T09:12:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557027+0000", 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241905 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.564209+0000", 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071818280000000003 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571404+0000", 2024-09-21T09:12:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071951100000000002 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571496+0000", 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2269999999999996e-05 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571579+0000", 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2748000000000001e-05 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1543 3.1e 3:7938dd95:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.815117381, 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020873849999999999, 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1543 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561710+0000", 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2499999999999998e-06 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567451+0000", 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005740864 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567493+0000", 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1851999999999998e-05 2024-09-21T09:12:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567512+0000", 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-05 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567654+0000", 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014127899999999999 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567918+0000", 2024-09-21T09:12:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026440799999999999 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.568159+0000", 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240564 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.577966+0000", 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098075639999999995 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582419+0000", 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044529060000000004 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582514+0000", 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4438000000000006e-05 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582581+0000", 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7125000000000005e-05 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1594 3.1e 3:7b761948:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.164008162000002, 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.031784366000000001, 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1594 2024-09-21T09:12:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212820+0000", 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0899999999999998e-06 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223204+0000", 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010383691 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223255+0000", 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1128000000000002e-05 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223283+0000", 2024-09-21T09:12:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7523000000000001e-05 2024-09-21T09:12:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223484+0000", 2024-09-21T09:12:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149499999999999 2024-09-21T09:12:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223901+0000", 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000417334 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224303+0000", 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040194699999999999 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.242455+0000", 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018151792999999999 2024-09-21T09:12:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244504+0000", 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020487370000000001 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244559+0000", 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4959e-05 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244600+0000", 2024-09-21T09:12:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1668999999999997e-05 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1595 3.29 3:9443c179:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.152286932999999, 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020426626, 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1595 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224539+0000", 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.607e-06 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228447+0000", 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003908412 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228476+0000", 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9155000000000001e-05 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228488+0000", 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1274000000000001e-05 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228601+0000", 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113485 2024-09-21T09:12:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228854+0000", 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025256399999999999 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.229066+0000", 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000212322 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.241625+0000", 2024-09-21T09:12:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012559130999999999 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244748+0000", 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031230160000000002 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244898+0000", 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014988800000000001 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244964+0000", 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5772000000000007e-05 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1597 3.17 3:e845bb01:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.110775397000001, 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022999776, 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1597 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266050+0000", 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.451e-06 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269917+0000", 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038665650000000002 2024-09-21T09:12:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269941+0000", 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4465e-05 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269953+0000", 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2082000000000001e-05 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270023+0000", 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9733000000000005e-05 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270183+0000", 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016033200000000001 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270338+0000", 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015478399999999999 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.275262+0000", 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049237040000000001 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288908+0000", 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013646149 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288979+0000", 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1227000000000001e-05 2024-09-21T09:12:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289049+0000", 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9283999999999996e-05 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1848 3.31 3:8ef6a1f2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.857660+0000", 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.5191641110000003, 2024-09-21T09:12:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019587855000000001, 2024-09-21T09:12:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1848 2024-09-21T09:12:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.857660+0000", 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.857660+0000", 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.857662+0000", 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7150000000000001e-06 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.861909+0000", 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042469049999999996 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.861935+0000", 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5984000000000001e-05 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.861951+0000", 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6293000000000001e-05 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.862053+0000", 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010244800000000001 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.862298+0000", 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024417299999999998 2024-09-21T09:12:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.862525+0000", 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022785000000000001 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.869065+0000", 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065390500000000002 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.877159+0000", 2024-09-21T09:12:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080948180000000002 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.877207+0000", 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7888e-05 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.877248+0000", 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0731e-05 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1904 3.3e 3:7dbd3d00:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.459879+0000", 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.9169453660000002, 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022385276999999999, 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1904 2024-09-21T09:12:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.459879+0000", 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.459879+0000", 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.459882+0000", 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.196e-06 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.463893+0000", 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040105519999999997 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.463938+0000", 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5827e-05 2024-09-21T09:12:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.463958+0000", 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9738999999999999e-05 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.464097+0000", 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013885500000000001 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.464347+0000", 2024-09-21T09:12:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024990899999999998 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.464606+0000", 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025865799999999999 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.477859+0000", 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013253558 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.481961+0000", 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041022039999999999 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.482101+0000", 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000139849 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.482264+0000", 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016292999999999999 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1905 3.1e 3:7a089feb:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.471226+0000", 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.9055977620000002, 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021597684999999998, 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1905 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.471226+0000", 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.471226+0000", 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.471229+0000", 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:12:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475465+0000", 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042360540000000004 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475486+0000", 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1495e-05 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475502+0000", 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6039999999999999e-05 2024-09-21T09:12:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475643+0000", 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141135 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475947+0000", 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030371899999999998 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.476280+0000", 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033269300000000001 2024-09-21T09:12:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.483111+0000", 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068314320000000001 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.492654+0000", 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095427589999999996 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.492750+0000", 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5933000000000005e-05 2024-09-21T09:12:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.492824+0000", 2024-09-21T09:12:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4221999999999995e-05 2024-09-21T09:12:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.510 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:49.511 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:49.512 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:49.507+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:49.613 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:49.611+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:49.653 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:49.654 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:49.654 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:49.654 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:49.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:49.713 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:49.711+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:49.815 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:49.811+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:49.839 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:49.839 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:49.839 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:49.839 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:49.839 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:49.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:49.916 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:49.911+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:49.977 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1235 3.18 e59/24 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.983744455, 2024-09-21T09:12:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020425276999999999, 2024-09-21T09:12:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988949+0000", 2024-09-21T09:12:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3659999999999999e-06 2024-09-21T09:12:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994552+0000", 2024-09-21T09:12:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056024719999999998 2024-09-21T09:12:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994598+0000", 2024-09-21T09:12:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6365000000000001e-05 2024-09-21T09:12:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994624+0000", 2024-09-21T09:12:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6132e-05 2024-09-21T09:12:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994804+0000", 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180209 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994849+0000", 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4838e-05 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009267+0000", 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014417780999999999 2024-09-21T09:12:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009372+0000", 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105114 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1323 3.12 3:4a999ff4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.859787719, 2024-09-21T09:12:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019594209000000001, 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1323 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112907+0000", 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1e-06 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117323+0000", 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044160229999999998 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117368+0000", 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5105000000000003e-05 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117387+0000", 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.931e-05 2024-09-21T09:12:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117571+0000", 2024-09-21T09:12:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018423199999999999 2024-09-21T09:12:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117976+0000", 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040424599999999998 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.118414+0000", 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043875199999999999 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.131859+0000", 2024-09-21T09:12:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013444621 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132294+0000", 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043466199999999999 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132420+0000", 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012634699999999999 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132498+0000", 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7811000000000004e-05 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1332 3.33 3:cc16045e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.674821076000001, 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024640585, 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1332 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297873+0000", 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9560000000000002e-06 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302007+0000", 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041338299999999998 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302045+0000", 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7929000000000002e-05 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302062+0000", 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6844e-05 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302223+0000", 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000161232 2024-09-21T09:12:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302631+0000", 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000408059 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.303057+0000", 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000425463 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.312222+0000", 2024-09-21T09:12:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091652239999999996 2024-09-21T09:12:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322385+0000", 2024-09-21T09:12:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010163292000000001 2024-09-21T09:12:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322455+0000", 2024-09-21T09:12:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0104000000000005e-05 2024-09-21T09:12:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322511+0000", 2024-09-21T09:12:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5652000000000002e-05 2024-09-21T09:12:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1340 3.24 3:244553ef:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.512101084000001, 2024-09-21T09:12:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022132493999999999, 2024-09-21T09:12:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1340 2024-09-21T09:12:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460593+0000", 2024-09-21T09:12:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7259999999999998e-06 2024-09-21T09:12:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465499+0000", 2024-09-21T09:12:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049057679999999996 2024-09-21T09:12:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465546+0000", 2024-09-21T09:12:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6692e-05 2024-09-21T09:12:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465565+0000", 2024-09-21T09:12:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9939e-05 2024-09-21T09:12:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465709+0000", 2024-09-21T09:12:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014318999999999999 2024-09-21T09:12:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465937+0000", 2024-09-21T09:12:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022867100000000001 2024-09-21T09:12:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.466152+0000", 2024-09-21T09:12:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000214637 2024-09-21T09:12:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.473162+0000", 2024-09-21T09:12:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070101199999999999 2024-09-21T09:12:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482551+0000", 2024-09-21T09:12:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093889520000000008 2024-09-21T09:12:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482644+0000", 2024-09-21T09:12:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2768000000000004e-05 2024-09-21T09:12:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482723+0000", 2024-09-21T09:12:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030999999999996e-05 2024-09-21T09:12:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1347 3.25 3:a6a24497:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.365965496000001, 2024-09-21T09:12:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017645750000000002, 2024-09-21T09:12:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1347 2024-09-21T09:12:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606730+0000", 2024-09-21T09:12:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6069999999999999e-06 2024-09-21T09:12:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611645+0000", 2024-09-21T09:12:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049153929999999997 2024-09-21T09:12:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611688+0000", 2024-09-21T09:12:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2658999999999999e-05 2024-09-21T09:12:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611708+0000", 2024-09-21T09:12:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.031e-05 2024-09-21T09:12:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611908+0000", 2024-09-21T09:12:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020053399999999999 2024-09-21T09:12:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612168+0000", 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025985100000000002 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612436+0000", 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026782899999999997 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.619627+0000", 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071906119999999999 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624183+0000", 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045566000000000001 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624279+0000", 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6113000000000006e-05 2024-09-21T09:12:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624372+0000", 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2242000000000002e-05 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1540 3.5 e61/24 3:a26ab227:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_9:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.441711878, 2024-09-21T09:12:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018163744999999999, 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530982+0000", 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8169999999999999e-06 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538703+0000", 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077210630000000002 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538740+0000", 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6495000000000002e-05 2024-09-21T09:12:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538759+0000", 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9259999999999999e-05 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538893+0000", 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013350999999999999 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538936+0000", 2024-09-21T09:12:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3046000000000001e-05 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549057+0000", 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010120986 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549143+0000", 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6568000000000002e-05 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1550 3.1 3:83bb88f2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.340602310000001, 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884271000000001, 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.027 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1550 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632093+0000", 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9859999999999996e-06 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638741+0000", 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066476859999999999 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638784+0000", 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2982999999999998e-05 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638802+0000", 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8026e-05 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638971+0000", 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016929600000000001 2024-09-21T09:12:50.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639309+0000", 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000338315 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639731+0000", 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042143600000000002 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.652998+0000", 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013267187999999999 2024-09-21T09:12:50.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654665+0000", 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001667106 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654849+0000", 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184212 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654973+0000", 2024-09-21T09:12:50.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012403699999999999 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1553 3.25 3:a4ab7629:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.308920149999999, 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019797014000000002, 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.033 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1553 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:50.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663774+0000", 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7089999999999998e-06 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668592+0000", 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048180580000000001 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668632+0000", 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9765999999999998e-05 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668648+0000", 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6460000000000002e-05 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668837+0000", 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018921500000000001 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669259+0000", 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042197600000000001 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669691+0000", 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043113599999999999 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683148+0000", 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013457184000000001 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683341+0000", 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019356899999999999 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683441+0000", 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9777000000000004e-05 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683568+0000", 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127164 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1593 3.33 3:ccba01ee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.772966687, 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034096062000000003, 2024-09-21T09:12:50.039 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1593 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199727+0000", 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.616e-06 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210215+0000", 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010487918000000001 2024-09-21T09:12:50.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210257+0000", 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1375999999999998e-05 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210284+0000", 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7630000000000001e-05 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210450+0000", 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016565899999999999 2024-09-21T09:12:50.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210824+0000", 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037435799999999998 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.211233+0000", 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040886699999999999 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223360+0000", 2024-09-21T09:12:50.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012127012 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233490+0000", 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010129917 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233690+0000", 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019989199999999999 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233821+0000", 2024-09-21T09:12:50.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000130817 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1601 3.1 3:80d10627:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 22.659942504, 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018087450000000001, 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1601 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312751+0000", 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.503e-06 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316621+0000", 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038693740000000001 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316644+0000", 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3617000000000001e-05 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316657+0000", 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2213e-05 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316721+0000", 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4871999999999998e-05 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316835+0000", 2024-09-21T09:12:50.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113594 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316940+0000", 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010543 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.321841+0000", 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049003730000000004 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330736+0000", 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008894941 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330783+0000", 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6811000000000003e-05 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330836+0000", 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3721999999999998e-05 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.050 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1779 3.33 3:cf2f93e7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.151250211000001, 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018811553000000002, 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.051 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1779 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821446+0000", 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999999e-06 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825426+0000", 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039806329999999999 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825466+0000", 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9860999999999997e-05 2024-09-21T09:12:50.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825486+0000", 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9802000000000001e-05 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825623+0000", 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013701499999999999 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825875+0000", 2024-09-21T09:12:50.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000252224 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.826117+0000", 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024205799999999999 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.832983+0000", 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068659560000000003 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840056+0000", 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070724200000000003 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840166+0000", 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110423 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840253+0000", 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6730999999999993e-05 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.056 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1786 3.24 3:26afb083:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.062630536, 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017381338, 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1786 2024-09-21T09:12:50.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910071+0000", 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0083e-05 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915610+0000", 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055387580000000004 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915654+0000", 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4527999999999998e-05 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915674+0000", 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0191999999999999e-05 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915777+0000", 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102301 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915933+0000", 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015625700000000001 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.916070+0000", 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000137236 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.924065+0000", 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079951290000000001 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927320+0000", 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032548210000000002 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927388+0000", 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7847000000000003e-05 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927442+0000", 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4185999999999999e-05 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1821 3.4 3:220bbc7d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.062 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5824940840000004, 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884436000000001, 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1821 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390201+0000", 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4359999999999998e-06 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.394951+0000", 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047500119999999996 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.394993+0000", 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2573e-05 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395011+0000", 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7782999999999999e-05 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395212+0000", 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000200848 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395467+0000", 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025509699999999997 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395699+0000", 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023194900000000001 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.403439+0000", 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077395509999999999 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.412978+0000", 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095393089999999993 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.413031+0000", 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3498999999999997e-05 2024-09-21T09:12:50.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.413082+0000", 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0379e-05 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1845 3.1 3:83de2a14:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.801729+0000", 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.1709622540000009, 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021697627000000001, 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.068 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1845 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.801729+0000", 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.801729+0000", 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.801739+0000", 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0121e-05 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805691+0000", 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039520409999999999 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805723+0000", 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2153000000000002e-05 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805737+0000", 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3913999999999999e-05 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805823+0000", 2024-09-21T09:12:50.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6102999999999999e-05 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805984+0000", 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016028599999999999 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.806122+0000", 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013851 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.810930+0000", 2024-09-21T09:12:50.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048081590000000002 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.823296+0000", 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012365665 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.823352+0000", 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5940999999999999e-05 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.823427+0000", 2024-09-21T09:12:50.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4734000000000006e-05 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1873 3.12 3:4955beba:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.087650+0000", 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.8850415080000005, 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018306975, 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1873 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.087650+0000", 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.087650+0000", 2024-09-21T09:12:50.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.087653+0000", 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3340000000000002e-06 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091588+0000", 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039349989999999998 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091631+0000", 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2740000000000001e-05 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091671+0000", 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0250999999999998e-05 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091853+0000", 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000181936 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.092278+0000", 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042514799999999998 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.092717+0000", 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043888800000000002 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.102005+0000", 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092876320000000005 2024-09-21T09:12:50.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.105847+0000", 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038424269999999998 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.105908+0000", 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0992000000000002e-05 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.105957+0000", 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8628000000000003e-05 2024-09-21T09:12:50.079 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1916 3.24 3:278f10aa:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.591627+0000", 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.3810640499999991, 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018567160999999999, 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.080 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1916 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.591627+0000", 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.591627+0000", 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.591630+0000", 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6769999999999999e-06 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595380+0000", 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003750265 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595409+0000", 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8535e-05 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595423+0000", 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4299e-05 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595516+0000", 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3241999999999999e-05 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595677+0000", 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016073899999999999 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595826+0000", 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148839 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.601944+0000", 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061175860000000004 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.610085+0000", 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0081411350000000007 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.610152+0000", 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7138999999999995e-05 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.610195+0000", 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2704999999999999e-05 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.085 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1930 3.25 3:a48e38fc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.749346+0000", 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.2233451800000008, 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019726848000000002, 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1930 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.749346+0000", 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.749346+0000", 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.749390+0000", 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3881000000000002e-05 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.753954+0000", 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045636349999999999 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.753994+0000", 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0682000000000001e-05 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754020+0000", 2024-09-21T09:12:50.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5981000000000001e-05 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754157+0000", 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013675499999999999 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754398+0000", 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241153 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:50.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754644+0000", 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024586600000000002 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.763986+0000", 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093414110000000009 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.768763+0000", 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047770989999999999 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.768944+0000", 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018164 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.769073+0000", 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012874499999999999 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1931 3.24 3:26cd634c:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.091 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.760522+0000", 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.2121693059999998, 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021060718999999999, 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1931 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.760522+0000", 2024-09-21T09:12:50.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.760522+0000", 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.760526+0000", 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7929999999999999e-06 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.764987+0000", 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044612209999999996 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765033+0000", 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6241e-05 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765061+0000", 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7418000000000001e-05 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765222+0000", 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016105399999999999 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765569+0000", 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034681700000000002 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765797+0000", 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022870200000000001 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.780465+0000", 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014667695999999999 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781292+0000", 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00082726399999999997 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781456+0000", 2024-09-21T09:12:50.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163898 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781583+0000", 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012661500000000001 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1934 3.7 e66/24 3:e2d55273:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_191:head v 66'4, mlcod=62'2)", 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.800593+0000", 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.1720987419999993, 2024-09-21T09:12:50.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023533157999999998, 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.800593+0000", 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.800593+0000", 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.800595+0000", 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3259999999999998e-06 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807173+0000", 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065779369999999998 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807224+0000", 2024-09-21T09:12:50.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0794000000000002e-05 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807251+0000", 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6868000000000001e-05 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807435+0000", 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184916 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807495+0000", 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9679999999999998e-05 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.823968+0000", 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016472992999999998 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.824126+0000", 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000157644 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1935 3.4 3:23c8af85:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.804040+0000", 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.1686518919999997, 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025977671000000001, 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.102 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1935 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.804040+0000", 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.804040+0000", 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.804042+0000", 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7829999999999999e-06 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810574+0000", 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065318269999999996 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810623+0000", 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8649999999999997e-05 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810648+0000", 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5128999999999999e-05 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810833+0000", 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018524599999999999 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.811283+0000", 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00045005300000000001 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.811770+0000", 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000486689 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.827600+0000", 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015830462999999999 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.829839+0000", 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022383289999999998 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.829933+0000", 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4310999999999999e-05 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.830017+0000", 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4190999999999994e-05 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.107 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:50.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:50.109 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:50.103+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:50.152 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T09:12:50.209 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:50.207+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:50.280 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:50.280 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:50.280 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:50.281 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:50.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:50.310 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:50.307+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:50.412 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:50.407+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:50.417 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:50.417 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:50.417 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:50.417 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:50.417 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:50.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:50.513 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:50.507+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:50.605 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:50.605 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:50.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:50.605 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:50.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.605 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1250 3.0 e59/24 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:50.605 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:50.605 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.537642680000001, 2024-09-21T09:12:50.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019412175, 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062729+0000", 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4399999999999999e-06 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068286+0000", 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055572190000000004 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068320+0000", 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4069000000000002e-05 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068339+0000", 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8433000000000001e-05 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068528+0000", 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018950099999999999 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068587+0000", 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8545999999999998e-05 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082000+0000", 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013412884999999999 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082139+0000", 2024-09-21T09:12:50.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013908200000000001 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1257 3.2e 3:748eda2f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.466618355000001, 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.030777402999999998, 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1257 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:50.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133755+0000", 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6890000000000002e-06 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.148913+0000", 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015158207 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.148973+0000", 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0424999999999998e-05 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149005+0000", 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1588999999999999e-05 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149191+0000", 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000186391 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149587+0000", 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039548900000000001 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149983+0000", 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000395929 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.163254+0000", 2024-09-21T09:12:50.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013271173000000001 2024-09-21T09:12:50.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164324+0000", 2024-09-21T09:12:50.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010705039999999999 2024-09-21T09:12:50.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164449+0000", 2024-09-21T09:12:50.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012412600000000001 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164528+0000", 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9881000000000003e-05 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1271 3.2e 3:76653b78:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:50.616 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.314157838, 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021378690999999998, 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1271 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286214+0000", 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7099999999999999e-06 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291359+0000", 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005144554 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291399+0000", 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9983e-05 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291427+0000", 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8152000000000001e-05 2024-09-21T09:12:50.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291603+0000", 2024-09-21T09:12:50.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176028 2024-09-21T09:12:50.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291857+0000", 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025373000000000003 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.292093+0000", 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023640999999999999 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.304468+0000", 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012374970000000001 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307321+0000", 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002852491 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307474+0000", 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015347900000000001 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307590+0000", 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116184 2024-09-21T09:12:50.622 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1312 3.b 3:d07beb3d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.717948077999999, 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020651398000000001, 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.623 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.624 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1312 2024-09-21T09:12:50.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.624 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:50.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882425+0000", 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6600000000000001e-06 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886385+0000", 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039597679999999998 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886407+0000", 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2143000000000001e-05 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886417+0000", 2024-09-21T09:12:50.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9620000000000005e-06 2024-09-21T09:12:50.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886510+0000", 2024-09-21T09:12:50.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3453000000000001e-05 2024-09-21T09:12:50.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886739+0000", 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022843599999999999 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886953+0000", 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021450000000000001 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892836+0000", 2024-09-21T09:12:50.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058827300000000001 2024-09-21T09:12:50.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902975+0000", 2024-09-21T09:12:50.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010139426999999999 2024-09-21T09:12:50.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.903028+0000", 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2608999999999997e-05 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.903073+0000", 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4709999999999997e-05 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.632 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1320 3.2e 3:75d4642b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:50.632 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:50.632 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.552938821000001, 2024-09-21T09:12:50.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018026718000000001, 2024-09-21T09:12:50.632 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.632 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.632 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.632 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.632 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1320 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:50.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047434+0000", 2024-09-21T09:12:50.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:12:50.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051443+0000", 2024-09-21T09:12:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040093439999999998 2024-09-21T09:12:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051486+0000", 2024-09-21T09:12:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3222000000000001e-05 2024-09-21T09:12:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051513+0000", 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6401999999999999e-05 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051655+0000", 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014170400000000001 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051826+0000", 2024-09-21T09:12:50.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017193500000000001 2024-09-21T09:12:50.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:50.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051987+0000", 2024-09-21T09:12:50.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016016000000000001 2024-09-21T09:12:50.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.057648+0000", 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056618600000000003 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065327+0000", 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076783520000000003 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065398+0000", 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1675999999999996e-05 2024-09-21T09:12:50.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065457+0000", 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8839999999999999e-05 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1324 3.2e 3:773eeeb4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.464843653999999, 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020230399, 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.639 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1324 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135529+0000", 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1700000000000001e-06 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139590+0000", 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040607860000000003 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139626+0000", 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6508999999999999e-05 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139651+0000", 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4692e-05 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139740+0000", 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8800000000000004e-05 2024-09-21T09:12:50.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139853+0000", 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011372200000000001 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139948+0000", 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4049999999999996e-05 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.144662+0000", 2024-09-21T09:12:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047143530000000001 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155681+0000", 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011019153 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155723+0000", 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2014000000000001e-05 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155756+0000", 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3149999999999999e-05 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1344 3.b 3:d3ddf01f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.062643434999998, 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017394212999999999, 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.645 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1344 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537729+0000", 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.157e-06 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542421+0000", 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046917460000000001 2024-09-21T09:12:50.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542457+0000", 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6396000000000002e-05 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542475+0000", 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7663e-05 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542621+0000", 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145943 2024-09-21T09:12:50.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542894+0000", 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027341300000000002 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.543122+0000", 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227557 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.554640+0000", 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011517853999999999 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.554941+0000", 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030173899999999998 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.555035+0000", 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3640999999999993e-05 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.555120+0000", 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5104000000000004e-05 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1368 3.2e 3:74fb0022:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.723056419999999, 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015885940000000001, 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.651 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1368 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877316+0000", 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5380000000000001e-06 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881169+0000", 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038535430000000001 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881196+0000", 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539000000000001e-05 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881208+0000", 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1919999999999999e-05 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881267+0000", 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9691999999999997e-05 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881393+0000", 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126129 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881508+0000", 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114156 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.885968+0000", 2024-09-21T09:12:50.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004460365 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893120+0000", 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007152538 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893162+0000", 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1854000000000003e-05 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893199+0000", 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6665999999999998e-05 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1377 3.21 3:85925c47:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.615674837, 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016148349999999999, 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.657 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1377 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984699+0000", 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0029999999999996e-06 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989011+0000", 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004312209 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989050+0000", 2024-09-21T09:12:50.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9496000000000003e-05 2024-09-21T09:12:50.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989070+0000", 2024-09-21T09:12:50.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9306000000000001e-05 2024-09-21T09:12:50.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989244+0000", 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000173945 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989640+0000", 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039646700000000001 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.990033+0000", 2024-09-21T09:12:50.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039296300000000003 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.999277+0000", 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092444799999999994 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000657+0000", 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013798059999999999 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000761+0000", 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103665 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000843+0000", 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2009999999999996e-05 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1546 3.1d e61/43 3:b8116d35:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_15:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.005489203, 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018965064, 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:50.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594884+0000", 2024-09-21T09:12:50.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3330000000000001e-06 2024-09-21T09:12:50.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601862+0000", 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069784510000000001 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601909+0000", 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7052000000000003e-05 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601932+0000", 2024-09-21T09:12:50.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2962000000000001e-05 2024-09-21T09:12:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602065+0000", 2024-09-21T09:12:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013274700000000001 2024-09-21T09:12:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602106+0000", 2024-09-21T09:12:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1625999999999998e-05 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.613748+0000", 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011642062 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.613845+0000", 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6830999999999995e-05 2024-09-21T09:12:50.668 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1557 3.2e 3:771f05bc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5_100Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.844565253999999, 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023866490000000001, 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.669 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1557 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755808+0000", 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3330000000000001e-06 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760408+0000", 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046002960000000002 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760449+0000", 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1681999999999998e-05 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760469+0000", 2024-09-21T09:12:50.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9809999999999998e-05 2024-09-21T09:12:50.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760669+0000", 2024-09-21T09:12:50.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000200065 2024-09-21T09:12:50.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.761108+0000", 2024-09-21T09:12:50.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043852600000000001 2024-09-21T09:12:50.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:50.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.762360+0000", 2024-09-21T09:12:50.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001252555 2024-09-21T09:12:50.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.778150+0000", 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015789290000000001 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779443+0000", 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012928289999999999 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779587+0000", 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014415900000000001 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779671+0000", 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3944999999999997e-05 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1596 3.21 3:8499e3d2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:50.676 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.355523403999999, 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017352083000000001, 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1596 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244852+0000", 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8250000000000001e-06 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249499+0000", 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046469349999999996 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249527+0000", 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7767e-05 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249538+0000", 2024-09-21T09:12:50.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1138000000000001e-05 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249686+0000", 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148574 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249959+0000", 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027321399999999998 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.250202+0000", 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000242864 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.260647+0000", 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010445060000000001 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262040+0000", 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001392449 2024-09-21T09:12:50.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262126+0000", 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6388e-05 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262198+0000", 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1868999999999999e-05 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1609 3.21 3:85d5ed9f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.191984105, 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016153879999999999, 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1609 2024-09-21T09:12:50.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408387+0000", 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.956e-06 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411460+0000", 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030725240000000001 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411478+0000", 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8286000000000001e-05 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411491+0000", 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.296e-05 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411695+0000", 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020357799999999999 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.412057+0000", 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000362402 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.412539+0000", 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000481528 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.419746+0000", 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072079359999999999 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424338+0000", 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045913780000000001 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424456+0000", 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118334 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424539+0000", 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2997999999999994e-05 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.688 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1765 3.21 3:871ca5b6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.976599136000001, 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022099173999999999, 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1765 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623775+0000", 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4730000000000002e-06 2024-09-21T09:12:50.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.628965+0000", 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051900050000000001 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629006+0000", 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1533999999999999e-05 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629025+0000", 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8196e-05 2024-09-21T09:12:50.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629157+0000", 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132781 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629415+0000", 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025730399999999997 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629647+0000", 2024-09-21T09:12:50.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023241200000000001 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.641959+0000", 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012311767 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645546+0000", 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035869560000000001 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645731+0000", 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018504200000000001 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645869+0000", 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013870399999999999 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1777 3.2e 3:74182f8a:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.694 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.803138081, 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019532442000000001, 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1777 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797235+0000", 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3110000000000001e-06 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801081+0000", 2024-09-21T09:12:50.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038459890000000002 2024-09-21T09:12:50.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801112+0000", 2024-09-21T09:12:50.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1514999999999999e-05 2024-09-21T09:12:50.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801129+0000", 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6934000000000001e-05 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801227+0000", 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7442999999999995e-05 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801430+0000", 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020329300000000001 2024-09-21T09:12:50.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801614+0000", 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184525 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.807398+0000", 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057833529999999998 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816627+0000", 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092296080000000003 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816706+0000", 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8294999999999995e-05 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816764+0000", 2024-09-21T09:12:50.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8176e-05 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1817 3.b 3:d1dcc069:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.261228198, 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017632233000000001, 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1817 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339144+0000", 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.328e-06 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343186+0000", 2024-09-21T09:12:50.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040426910000000002 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343218+0000", 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2183e-05 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343233+0000", 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4430000000000001e-05 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343425+0000", 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019234499999999999 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343871+0000", 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000445659 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:50.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.344300+0000", 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042892100000000002 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356373+0000", 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012073406 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356567+0000", 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019390999999999999 2024-09-21T09:12:50.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356680+0000", 2024-09-21T09:12:50.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011297 2024-09-21T09:12:50.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356773+0000", 2024-09-21T09:12:50.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3389999999999999e-05 2024-09-21T09:12:50.707 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1847 3.21 3:841376c9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.757646416, 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02309464, 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.708 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.709 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.709 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1847 2024-09-21T09:12:50.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.709 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:50.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842726+0000", 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7159999999999999e-06 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846655+0000", 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039289329999999999 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846681+0000", 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.635e-05 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846695+0000", 2024-09-21T09:12:50.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3988999999999999e-05 2024-09-21T09:12:50.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846786+0000", 2024-09-21T09:12:50.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0605000000000004e-05 2024-09-21T09:12:50.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.847020+0000", 2024-09-21T09:12:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000234458 2024-09-21T09:12:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.847233+0000", 2024-09-21T09:12:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021297699999999999 2024-09-21T09:12:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.853208+0000", 2024-09-21T09:12:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059752599999999996 2024-09-21T09:12:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865654+0000", 2024-09-21T09:12:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012445289999999999 2024-09-21T09:12:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865746+0000", 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2262000000000005e-05 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865818+0000", 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1799999999999997e-05 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.715 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1885 3.b 3:d37941b6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3691132679999996, 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017285139000000001, 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1885 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231259+0000", 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7779999999999999e-06 2024-09-21T09:12:50.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235037+0000", 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037777710000000001 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235064+0000", 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7509e-05 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235079+0000", 2024-09-21T09:12:50.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.432e-05 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235199+0000", 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120555 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235451+0000", 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025202200000000002 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235673+0000", 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221547 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.243413+0000", 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077399119999999998 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248203+0000", 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004790239 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248405+0000", 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020200099999999999 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248541+0000", 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013648499999999999 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1913 3.21 3:87dbe7e5:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:50.721 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.0409118030000002, 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016018510999999999, 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1913 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559460+0000", 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0540000000000002e-06 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563313+0000", 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038530679999999999 2024-09-21T09:12:50.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563342+0000", 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8765e-05 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563355+0000", 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3217000000000001e-05 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563446+0000", 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1229000000000004e-05 2024-09-21T09:12:50.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563625+0000", 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017948000000000001 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563784+0000", 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015840099999999999 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.572444+0000", 2024-09-21T09:12:50.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086599659999999998 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575327+0000", 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028827639999999999 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575407+0000", 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0838000000000001e-05 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575476+0000", 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8728999999999999e-05 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1932 3.1d e66/43 3:ba4e63e7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_189:head v 66'13, mlcod=66'11)", 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.773715+0000", 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.8266548829999998, 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017760706000000001, 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:50.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.773715+0000", 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.773715+0000", 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.773717+0000", 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:12:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781583+0000", 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078659739999999995 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781627+0000", 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4246999999999998e-05 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781646+0000", 2024-09-21T09:12:50.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9539e-05 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781760+0000", 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011317 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781802+0000", 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2543999999999998e-05 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.791376+0000", 2024-09-21T09:12:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095742450000000003 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.791475+0000", 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8844000000000004e-05 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:50.731 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:50.733 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:50.731+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:50.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T09:12:50.833 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:50.831+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:50.874 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:50.874 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:50.874 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2024-09-21T09:12:50.874 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:50.889 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T09:12:50.934 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:50.931+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:50.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T09:12:51.009 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:12:51.009 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2024-09-21T09:12:51.009 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2024-09-21T09:12:51.009 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2024-09-21T09:12:51.009 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:12:51.024 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T09:12:51.035 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:51.031+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:51.109 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-09-21T09:12:51.136 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:51.131+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:51.147 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:51.164 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:51.165 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:51.181 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:51.182 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:51.198 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:51.199 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:51.201 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:51.201 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:51.215 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T09:12:51.219 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:51.220 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:51.240 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:51.241 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:51.241 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:51.235+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:51.261 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:51.262 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:51.282 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:51.282 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:51.336 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:51.336 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:51.337 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:51.335+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:51.350 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T09:12:51.438 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:51.435+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:51.519 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:51.519 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:51.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T09:12:51.578 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:51.575+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:51.580 INFO:tasks.workunit.client.0.smithi007.stderr:100+0 records in 2024-09-21T09:12:51.581 INFO:tasks.workunit.client.0.smithi007.stderr:100+0 records out 2024-09-21T09:12:51.581 INFO:tasks.workunit.client.0.smithi007.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 8.69141 s, 121 MB/s 2024-09-21T09:12:51.640 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:51.639+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:51.661 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:51.661 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:51.676 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T09:12:51.741 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:51.739+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:51.840 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:51.841 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:51.842 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:51.839+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:51.855 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T09:12:51.942 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:51.939+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:52.021 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:52.021 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:52.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T09:12:52.044 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:52.039+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:52.145 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:52.139+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:52.197 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:52.198 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:52.210 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T09:12:52.254 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:52.251+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:52.346 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:52.343+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:52.381 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:52.381 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:52.394 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T09:12:52.447 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:52.443+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:52.548 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:52.543+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:52.564 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:52.565 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:52.578 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T09:12:52.665 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:52.663+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:52.735 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:52.736 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:52.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T09:12:52.789 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-21T09:12:52.786+0000 7f50a817b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26444) UID: 0 2024-09-21T09:12:52.851 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:52.847+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:52.885 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:52.885 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:52.900 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T09:12:52.985 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:52.983+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:53.053 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:53.046+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:53.070 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:53.070 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:53.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T09:12:53.144 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T09:12:53.190 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:53.186+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:53.255 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:53.250+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:53.257 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:53.257 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:53.273 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T09:12:53.301 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T09:12:53.355 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:53.350+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:53.397 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-21T09:12:53.397 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T09:12:53.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T09:12:53.436 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2024-09-21T09:12:53.436 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T09:12:53.452 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2024-09-21T09:12:53.452 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T09:12:53.455 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-21T09:12:53.450+0000 7f67a7259640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26442) UID: 0 2024-09-21T09:12:53.468 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2024-09-21T09:12:53.469 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T09:12:53.485 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2024-09-21T09:12:53.485 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T09:12:53.503 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2024-09-21T09:12:53.504 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T09:12:53.523 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2024-09-21T09:12:53.523 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T09:12:53.542 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:53.542 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:53.542 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:53.542 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:53.542 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:53.543 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2024-09-21T09:12:53.544 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T09:12:53.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T09:12:53.558 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:53.555+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:53.564 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2024-09-21T09:12:53.564 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T09:12:53.658 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-21T09:12:53.655+0000 7f7b178f8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-21T09:12:53.724 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:53.724 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:53.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:53.724 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:53.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.724 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1163 3.17 3:eb0740dd:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.2__shadow_.pD0Y15KsHRum85Oei_tsI3fRxAao3bT_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 36.809083669000003, 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019360854, 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1163 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911567+0000", 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.911569+0000", 2024-09-21T09:12:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6460000000000002e-06 2024-09-21T09:12:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917121+0000", 2024-09-21T09:12:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005551846 2024-09-21T09:12:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917164+0000", 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2916e-05 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917183+0000", 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8508999999999998e-05 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917318+0000", 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013504200000000001 2024-09-21T09:12:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917572+0000", 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025395300000000001 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.917798+0000", 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022648300000000001 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.929367+0000", 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011568729999999999 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930809+0000", 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014424730000000001 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930883+0000", 2024-09-21T09:12:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3910000000000002e-05 2024-09-21T09:12:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:16.930928+0000", 2024-09-21T09:12:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4345999999999999e-05 2024-09-21T09:12:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1235 3.18 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.738889952000001, 2024-09-21T09:12:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028152907000000001, 2024-09-21T09:12:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1235 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981761+0000", 2024-09-21T09:12:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.981763+0000", 2024-09-21T09:12:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7700000000000002e-06 2024-09-21T09:12:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988006+0000", 2024-09-21T09:12:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062426979999999997 2024-09-21T09:12:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988042+0000", 2024-09-21T09:12:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6461999999999998e-05 2024-09-21T09:12:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988067+0000", 2024-09-21T09:12:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4372999999999999e-05 2024-09-21T09:12:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988210+0000", 2024-09-21T09:12:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014307299999999999 2024-09-21T09:12:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988480+0000", 2024-09-21T09:12:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026992500000000002 2024-09-21T09:12:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988718+0000", 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023859400000000001 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.002159+0000", 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01344091 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009749+0000", 2024-09-21T09:12:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075900769999999998 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009840+0000", 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0736999999999995e-05 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009913+0000", 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3287999999999994e-05 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1246 3.31 3:8d902261:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.719960509000003, 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022053738, 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1246 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000690+0000", 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.000694+0000", 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2599999999999999e-06 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004867+0000", 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041723300000000001 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004920+0000", 2024-09-21T09:12:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2985000000000002e-05 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.004948+0000", 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8362999999999999e-05 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005091+0000", 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000142903 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005381+0000", 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029025500000000001 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.005674+0000", 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000292878 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.017583+0000", 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011908981000000001 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022585+0000", 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050024179999999998 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022674+0000", 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8486999999999995e-05 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.022744+0000", 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9877999999999997e-05 2024-09-21T09:12:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1250 3.0 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.664153648999999, 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026211538999999999, 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1250 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056497+0000", 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.056500+0000", 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.18e-06 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061414+0000", 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049142930000000001 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061455+0000", 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0689000000000003e-05 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061475+0000", 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9760000000000001e-05 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.061649+0000", 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000174308 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062062+0000", 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041290199999999998 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062448+0000", 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038618600000000001 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.075288+0000", 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012839623999999999 2024-09-21T09:12:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082540+0000", 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072523489999999999 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082633+0000", 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3200000000000002e-05 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082708+0000", 2024-09-21T09:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5048000000000004e-05 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1258 3.17 3:e9fd25dc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.574425910000002, 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025293568999999998, 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1258 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146225+0000", 2024-09-21T09:12:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.146228+0000", 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8130000000000002e-06 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151893+0000", 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056641929999999997 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151937+0000", 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4768999999999998e-05 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.151978+0000", 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0844999999999999e-05 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152239+0000", 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026088000000000001 2024-09-21T09:12:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152546+0000", 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000306905 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.152815+0000", 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268912 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.165057+0000", 2024-09-21T09:12:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012242368 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171206+0000", 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006148349 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171389+0000", 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018327799999999999 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171518+0000", 2024-09-21T09:12:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000129257 2024-09-21T09:12:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1260 3.17 3:eb13e7c3:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.549499451000003, 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021083792000000001, 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1260 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171151+0000", 2024-09-21T09:12:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.171154+0000", 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9040000000000001e-06 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176055+0000", 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049010299999999998 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176092+0000", 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6662000000000002e-05 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176109+0000", 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7042999999999999e-05 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176228+0000", 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119747 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176521+0000", 2024-09-21T09:12:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029217499999999999 2024-09-21T09:12:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.176753+0000", 2024-09-21T09:12:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023253299999999999 2024-09-21T09:12:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.187711+0000", 2024-09-21T09:12:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010958324 2024-09-21T09:12:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192068+0000", 2024-09-21T09:12:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043564989999999998 2024-09-21T09:12:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192163+0000", 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.48e-05 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.192235+0000", 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2075000000000004e-05 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1272 3.29 3:963d269b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.423122131, 2024-09-21T09:12:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019343672999999999, 2024-09-21T09:12:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1272 2024-09-21T09:12:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297528+0000", 2024-09-21T09:12:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.297532+0000", 2024-09-21T09:12:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-06 2024-09-21T09:12:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300259+0000", 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027266579999999999 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300306+0000", 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6748e-05 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300325+0000", 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9752999999999999e-05 2024-09-21T09:12:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300489+0000", 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016374200000000001 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300746+0000", 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025647300000000001 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.300967+0000", 2024-09-21T09:12:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022157700000000001 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.309603+0000", 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086360010000000008 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316784+0000", 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071809450000000002 2024-09-21T09:12:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316833+0000", 2024-09-21T09:12:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8949999999999997e-05 2024-09-21T09:12:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.316872+0000", 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1283 3.29 3:97ed8f1e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.307175393999998, 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02166881, 2024-09-21T09:12:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1283 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413475+0000", 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.413478+0000", 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417497+0000", 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004018822 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417541+0000", 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3961999999999997e-05 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417568+0000", 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6452999999999999e-05 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.417777+0000", 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020961499999999999 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418024+0000", 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000247159 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.418257+0000", 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023203000000000001 2024-09-21T09:12:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.427160+0000", 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089031600000000002 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435069+0000", 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079094850000000008 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435111+0000", 2024-09-21T09:12:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1959000000000003e-05 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.435144+0000", 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2815999999999999e-05 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1306 3.3d 3:bf842dad:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 31.962479225999999, 2024-09-21T09:12:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020194347000000001, 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1306 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758171+0000", 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.758174+0000", 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762157+0000", 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039825770000000002 2024-09-21T09:12:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762201+0000", 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4245000000000001e-05 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762220+0000", 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8808999999999999e-05 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762324+0000", 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104033 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762588+0000", 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026391700000000001 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.762811+0000", 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000222957 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.771599+0000", 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087878469999999997 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778144+0000", 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065449810000000001 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778244+0000", 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9901000000000005e-05 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.778366+0000", 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012201000000000001 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1311 3.27 3:e6d5d281:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 31.861595038000001, 2024-09-21T09:12:53.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024501067000000001, 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1311 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859055+0000", 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.859057+0000", 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5149999999999999e-06 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862830+0000", 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037728620000000001 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862850+0000", 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0264000000000001e-05 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.862859+0000", 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2189999999999993e-06 2024-09-21T09:12:53.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863041+0000", 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018214899999999999 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863291+0000", 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024963299999999997 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:53.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.863529+0000", 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023759000000000001 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.870237+0000", 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067083170000000001 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883389+0000", 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013151532 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883486+0000", 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7640999999999996e-05 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.883557+0000", 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0345000000000005e-05 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1359 3.3d 3:bc104684:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.944139937999999, 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020340127, 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1359 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.792 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776511+0000", 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.776514+0000", 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8770000000000003e-06 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783654+0000", 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071395319999999996 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783702+0000", 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8449000000000003e-05 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783722+0000", 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9398999999999998e-05 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.783892+0000", 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017003 2024-09-21T09:12:53.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784158+0000", 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026600899999999999 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.784416+0000", 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025767999999999999 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795150+0000", 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010734321 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.795847+0000", 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00069705199999999998 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796516+0000", 2024-09-21T09:12:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066950600000000005 2024-09-21T09:12:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.796851+0000", 2024-09-21T09:12:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033427199999999999 2024-09-21T09:12:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1535 3.29 3:94169add:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.244065315, 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021366508999999999, 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1535 2024-09-21T09:12:53.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476585+0000", 2024-09-21T09:12:53.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.476590+0000", 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7269999999999998e-06 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483098+0000", 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065085480000000003 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483149+0000", 2024-09-21T09:12:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0726000000000002e-05 2024-09-21T09:12:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483171+0000", 2024-09-21T09:12:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1622999999999999e-05 2024-09-21T09:12:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483359+0000", 2024-09-21T09:12:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018774199999999999 2024-09-21T09:12:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.483790+0000", 2024-09-21T09:12:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000431915 2024-09-21T09:12:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.484215+0000", 2024-09-21T09:12:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000424664 2024-09-21T09:12:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.493337+0000", 2024-09-21T09:12:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091213739999999998 2024-09-21T09:12:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497756+0000", 2024-09-21T09:12:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044193039999999998 2024-09-21T09:12:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497856+0000", 2024-09-21T09:12:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9838000000000002e-05 2024-09-21T09:12:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.497952+0000", 2024-09-21T09:12:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6047999999999999e-05 2024-09-21T09:12:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1542 3.3d 3:bc2592c4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:53.806 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.168376499000001, 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019304961999999998, 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1542 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552274+0000", 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.552277+0000", 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2160000000000002e-06 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556307+0000", 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040297140000000002 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556345+0000", 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7996e-05 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556381+0000", 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6121999999999997e-05 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556519+0000", 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013799999999999999 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.556785+0000", 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026605299999999998 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.557027+0000", 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241905 2024-09-21T09:12:53.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.564209+0000", 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071818280000000003 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571404+0000", 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071951100000000002 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571496+0000", 2024-09-21T09:12:53.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2269999999999996e-05 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.571579+0000", 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2748000000000001e-05 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1543 3.1e 3:7938dd95:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.158943661999999, 2024-09-21T09:12:53.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020873849999999999, 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1543 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561707+0000", 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.561710+0000", 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2499999999999998e-06 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567451+0000", 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005740864 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567493+0000", 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1851999999999998e-05 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567512+0000", 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-05 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567654+0000", 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014127899999999999 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.567918+0000", 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026440799999999999 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.568159+0000", 2024-09-21T09:12:53.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000240564 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.577966+0000", 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098075639999999995 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582419+0000", 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044529060000000004 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582514+0000", 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4438000000000006e-05 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.582581+0000", 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7125000000000005e-05 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1594 3.1e 3:7b761948:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:53.818 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 26.507834443, 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.031784366000000001, 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1594 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212816+0000", 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.212820+0000", 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0899999999999998e-06 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223204+0000", 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010383691 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223255+0000", 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1128000000000002e-05 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223283+0000", 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7523000000000001e-05 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223484+0000", 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149499999999999 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223901+0000", 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000417334 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:53.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224303+0000", 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040194699999999999 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.242455+0000", 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018151792999999999 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244504+0000", 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020487370000000001 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244559+0000", 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4959e-05 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244600+0000", 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1668999999999997e-05 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1595 3.29 3:9443c179:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:53.824 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 26.496113214000001, 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020426626, 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1595 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:53.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224537+0000", 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.224539+0000", 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.607e-06 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228447+0000", 2024-09-21T09:12:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003908412 2024-09-21T09:12:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228476+0000", 2024-09-21T09:12:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9155000000000001e-05 2024-09-21T09:12:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228488+0000", 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1274000000000001e-05 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228601+0000", 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113485 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.228854+0000", 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025256399999999999 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.229066+0000", 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000212322 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.241625+0000", 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012559130999999999 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244748+0000", 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031230160000000002 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244898+0000", 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014988800000000001 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244964+0000", 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5772000000000007e-05 2024-09-21T09:12:53.830 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1597 3.17 3:e845bb01:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 26.454601678, 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022999776, 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.831 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1597 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266049+0000", 2024-09-21T09:12:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.266050+0000", 2024-09-21T09:12:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.451e-06 2024-09-21T09:12:53.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269917+0000", 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038665650000000002 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269941+0000", 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4465e-05 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.269953+0000", 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2082000000000001e-05 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270023+0000", 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9733000000000005e-05 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270183+0000", 2024-09-21T09:12:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016033200000000001 2024-09-21T09:12:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.270338+0000", 2024-09-21T09:12:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015478399999999999 2024-09-21T09:12:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.275262+0000", 2024-09-21T09:12:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049237040000000001 2024-09-21T09:12:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288908+0000", 2024-09-21T09:12:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013646149 2024-09-21T09:12:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.288979+0000", 2024-09-21T09:12:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1227000000000001e-05 2024-09-21T09:12:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.289049+0000", 2024-09-21T09:12:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9283999999999996e-05 2024-09-21T09:12:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1848 3.31 3:8ef6a1f2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.857660+0000", 2024-09-21T09:12:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.862990392, 2024-09-21T09:12:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019587855000000001, 2024-09-21T09:12:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.839 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1848 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.857660+0000", 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.857660+0000", 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.857662+0000", 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7150000000000001e-06 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.861909+0000", 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042469049999999996 2024-09-21T09:12:53.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.861935+0000", 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5984000000000001e-05 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.861951+0000", 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6293000000000001e-05 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.862053+0000", 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010244800000000001 2024-09-21T09:12:53.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.862298+0000", 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024417299999999998 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.862525+0000", 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022785000000000001 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.869065+0000", 2024-09-21T09:12:53.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065390500000000002 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.877159+0000", 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080948180000000002 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.877207+0000", 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7888e-05 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.877248+0000", 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0731e-05 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1904 3.3e 3:7dbd3d00:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.459879+0000", 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.260771647, 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022385276999999999, 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.845 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1904 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.459879+0000", 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.459879+0000", 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.459882+0000", 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.196e-06 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.463893+0000", 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040105519999999997 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.463938+0000", 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5827e-05 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.463958+0000", 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9738999999999999e-05 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.464097+0000", 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013885500000000001 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.464347+0000", 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024990899999999998 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.464606+0000", 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025865799999999999 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.477859+0000", 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013253558 2024-09-21T09:12:53.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.481961+0000", 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041022039999999999 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.482101+0000", 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000139849 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.482264+0000", 2024-09-21T09:12:53.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016292999999999999 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1905 3.1e 3:7a089feb:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.471226+0000", 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.249424042999999, 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021597684999999998, 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:53.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1905 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.471226+0000", 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.471226+0000", 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:53.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.471229+0000", 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475465+0000", 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042360540000000004 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475486+0000", 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1495e-05 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475502+0000", 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6039999999999999e-05 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475643+0000", 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141135 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.475947+0000", 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030371899999999998 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.476280+0000", 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033269300000000001 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.483111+0000", 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068314320000000001 2024-09-21T09:12:53.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.492654+0000", 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095427589999999996 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.492750+0000", 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5933000000000005e-05 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.492824+0000", 2024-09-21T09:12:53.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4221999999999995e-05 2024-09-21T09:12:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:53.857 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:53.857 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:53.858 INFO:tasks.workunit.client.0.smithi007.stdout:quota enabled for the user 0.403462817051576 2024-09-21T09:12:53.858 INFO:tasks.workunit.client.0.smithi007.stdout:adding file to bucket buck_2024_08_21_09_12_42: 1Gb. 2024-09-21T09:12:53.858 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:53.858 INFO:tasks.workunit.client.0.smithi007.stdout:Test case: PASSED - user quota max size for 0.403462817051576 passed on 2 buckets 2024-09-21T09:12:53.858 INFO:tasks.workunit.client.0.smithi007.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-21T09:12:53.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T09:12:53.859 INFO:tasks.ceph.osd.6.smithi050.stderr:2024-09-21T09:12:53.855+0000 7f56374a5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-21T09:12:53.959 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:53.955+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:54.055 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:54.055 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:54.055 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:54.055 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:54.060 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:54.054+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:54.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T09:12:54.078 INFO:tasks.workunit.client.0.smithi007.stdout:user 0.403462817051576 deleted 2024-09-21T09:12:54.084 INFO:tasks.workunit.client.0.smithi007.stdout:OK 2024-09-21T09:12:54.084 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T09:12:54.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T09:12:54.135 INFO:tasks.workunit:Stopping ['rgw/s3_user_quota.pl'] on client.0... 2024-09-21T09:12:54.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T09:12:54.161 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:54.159+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2024-09-21T09:12:54.241 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:54.241 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:54.241 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:54.241 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:54.241 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:54.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T09:12:54.297 INFO:tasks.ceph.osd.7.smithi050.stderr:2024-09-21T09:12:54.295+0000 7fb830251640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-21T09:12:54.363 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-21T09:12:54.358+0000 7f68138d1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26440) UID: 0 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1235 3.18 e59/24 3:1b4516f6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_2:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.432154847, 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020425276999999999, 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988947+0000", 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.988949+0000", 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3659999999999999e-06 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994552+0000", 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056024719999999998 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994598+0000", 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6365000000000001e-05 2024-09-21T09:12:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994624+0000", 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6132e-05 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994804+0000", 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180209 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:20.994849+0000", 2024-09-21T09:12:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4838e-05 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009267+0000", 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014417780999999999 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.009372+0000", 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105114 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1323 3.12 3:4a999ff4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.308198111000003, 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019594209000000001, 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1323 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112904+0000", 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.112907+0000", 2024-09-21T09:12:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1e-06 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117323+0000", 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044160229999999998 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117368+0000", 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5105000000000003e-05 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117387+0000", 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.931e-05 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117571+0000", 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018423199999999999 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.117976+0000", 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040424599999999998 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.118414+0000", 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043875199999999999 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.131859+0000", 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013444621 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132294+0000", 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043466199999999999 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132420+0000", 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012634699999999999 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.132498+0000", 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7811000000000004e-05 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1332 3.33 3:cc16045e:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.123231468, 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024640585, 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1332 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297870+0000", 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.297873+0000", 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9560000000000002e-06 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302007+0000", 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041338299999999998 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302045+0000", 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7929000000000002e-05 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302062+0000", 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6844e-05 2024-09-21T09:12:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302223+0000", 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000161232 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.302631+0000", 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000408059 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.303057+0000", 2024-09-21T09:12:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000425463 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.312222+0000", 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091652239999999996 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322385+0000", 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010163292000000001 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322455+0000", 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0104000000000005e-05 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.322511+0000", 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5652000000000002e-05 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1340 3.24 3:244553ef:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:54.442 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 31.960511476000001, 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022132493999999999, 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1340 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460590+0000", 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.460593+0000", 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7259999999999998e-06 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465499+0000", 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049057679999999996 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465546+0000", 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6692e-05 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465565+0000", 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9939e-05 2024-09-21T09:12:54.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465709+0000", 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014318999999999999 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.465937+0000", 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022867100000000001 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:54.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.466152+0000", 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000214637 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.473162+0000", 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070101199999999999 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482551+0000", 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093889520000000008 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482644+0000", 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2768000000000004e-05 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.482723+0000", 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030999999999996e-05 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1347 3.25 3:a6a24497:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:54.448 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 31.814375888000001, 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017645750000000002, 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1347 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606726+0000", 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.606730+0000", 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6069999999999999e-06 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611645+0000", 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049153929999999997 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611688+0000", 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2658999999999999e-05 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611708+0000", 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.031e-05 2024-09-21T09:12:54.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.611908+0000", 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020053399999999999 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612168+0000", 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025985100000000002 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.612436+0000", 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026782899999999997 2024-09-21T09:12:54.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.619627+0000", 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071906119999999999 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624183+0000", 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045566000000000001 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624279+0000", 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6113000000000006e-05 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.624372+0000", 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2242000000000002e-05 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1540 3.5 e61/24 3:a26ab227:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_9:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:54.454 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.890122269999999, 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018163744999999999, 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530980+0000", 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.530982+0000", 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8169999999999999e-06 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538703+0000", 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077210630000000002 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538740+0000", 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6495000000000002e-05 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538759+0000", 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9259999999999999e-05 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538893+0000", 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013350999999999999 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.538936+0000", 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3046000000000001e-05 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549057+0000", 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010120986 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.549143+0000", 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6568000000000002e-05 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.458 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1550 3.1 3:83bb88f2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.789012702000001, 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884271000000001, 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.459 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1550 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632089+0000", 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.632093+0000", 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9859999999999996e-06 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638741+0000", 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066476859999999999 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638784+0000", 2024-09-21T09:12:54.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2982999999999998e-05 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638802+0000", 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8026e-05 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.638971+0000", 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016929600000000001 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639309+0000", 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000338315 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.639731+0000", 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042143600000000002 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.652998+0000", 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013267187999999999 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654665+0000", 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001667106 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654849+0000", 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184212 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.654973+0000", 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012403699999999999 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.464 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1553 3.25 3:a4ab7629:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.757330541999998, 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019797014000000002, 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.465 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1553 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663771+0000", 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.663774+0000", 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7089999999999998e-06 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668592+0000", 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048180580000000001 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668632+0000", 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9765999999999998e-05 2024-09-21T09:12:54.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668648+0000", 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6460000000000002e-05 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.668837+0000", 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018921500000000001 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669259+0000", 2024-09-21T09:12:54.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042197600000000001 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.669691+0000", 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043113599999999999 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683148+0000", 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013457184000000001 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683341+0000", 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019356899999999999 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683441+0000", 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9777000000000004e-05 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.683568+0000", 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127164 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1593 3.33 3:ccba01ee:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.221377079, 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034096062000000003, 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1593 2024-09-21T09:12:54.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199725+0000", 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.199727+0000", 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.616e-06 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210215+0000", 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010487918000000001 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210257+0000", 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1375999999999998e-05 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210284+0000", 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7630000000000001e-05 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210450+0000", 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016565899999999999 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.210824+0000", 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037435799999999998 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.211233+0000", 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040886699999999999 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.223360+0000", 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012127012 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233490+0000", 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010129917 2024-09-21T09:12:54.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233690+0000", 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019989199999999999 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.233821+0000", 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000130817 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1601 3.1 3:80d10627:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.108352896, 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018087450000000001, 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1601 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312749+0000", 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.312751+0000", 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.503e-06 2024-09-21T09:12:54.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316621+0000", 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038693740000000001 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316644+0000", 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3617000000000001e-05 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316657+0000", 2024-09-21T09:12:54.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2213e-05 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316721+0000", 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4871999999999998e-05 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316835+0000", 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113594 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.316940+0000", 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010543 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.321841+0000", 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049003730000000004 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330736+0000", 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008894941 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330783+0000", 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6811000000000003e-05 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.330836+0000", 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3721999999999998e-05 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1779 3.33 3:cf2f93e7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.599660603, 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018811553000000002, 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1779 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821441+0000", 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.821446+0000", 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999999e-06 2024-09-21T09:12:54.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825426+0000", 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039806329999999999 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825466+0000", 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9860999999999997e-05 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825486+0000", 2024-09-21T09:12:54.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9802000000000001e-05 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825623+0000", 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013701499999999999 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.825875+0000", 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000252224 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:54.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.826117+0000", 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024205799999999999 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.832983+0000", 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068659560000000003 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840056+0000", 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0070724200000000003 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840166+0000", 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110423 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.840253+0000", 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6730999999999993e-05 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1786 3.24 3:26afb083:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:54.488 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.511040928, 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017381338, 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1786 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910061+0000", 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.910071+0000", 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0083e-05 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915610+0000", 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055387580000000004 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915654+0000", 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4527999999999998e-05 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915674+0000", 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0191999999999999e-05 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915777+0000", 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102301 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.915933+0000", 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015625700000000001 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.916070+0000", 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000137236 2024-09-21T09:12:54.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.924065+0000", 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0079951290000000001 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927320+0000", 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032548210000000002 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927388+0000", 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7847000000000003e-05 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.927442+0000", 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4185999999999999e-05 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1821 3.4 3:220bbc7d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:54.494 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.030904476, 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022884436000000001, 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1821 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390197+0000", 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.390201+0000", 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4359999999999998e-06 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.394951+0000", 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047500119999999996 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.394993+0000", 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2573e-05 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395011+0000", 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7782999999999999e-05 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395212+0000", 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000200848 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395467+0000", 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025509699999999997 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.395699+0000", 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023194900000000001 2024-09-21T09:12:54.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.403439+0000", 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077395509999999999 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.412978+0000", 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095393089999999993 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.413031+0000", 2024-09-21T09:12:54.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3498999999999997e-05 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.413082+0000", 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0379e-05 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1845 3.1 3:83de2a14:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.801729+0000", 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.619372646, 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021697627000000001, 2024-09-21T09:12:54.500 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1845 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.801729+0000", 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.801729+0000", 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.801739+0000", 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0121e-05 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805691+0000", 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039520409999999999 2024-09-21T09:12:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805723+0000", 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2153000000000002e-05 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805737+0000", 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3913999999999999e-05 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805823+0000", 2024-09-21T09:12:54.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6102999999999999e-05 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.805984+0000", 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016028599999999999 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.806122+0000", 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013851 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.810930+0000", 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048081590000000002 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.823296+0000", 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012365665 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.823352+0000", 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5940999999999999e-05 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.823427+0000", 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4734000000000006e-05 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1873 3.12 3:4955beba:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.087650+0000", 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.3334519, 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018306975, 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.506 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1873 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.087650+0000", 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.087650+0000", 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.087653+0000", 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3340000000000002e-06 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091588+0000", 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039349989999999998 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091631+0000", 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2740000000000001e-05 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091671+0000", 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0250999999999998e-05 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.091853+0000", 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000181936 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.092278+0000", 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042514799999999998 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.092717+0000", 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043888800000000002 2024-09-21T09:12:54.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.102005+0000", 2024-09-21T09:12:54.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092876320000000005 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.105847+0000", 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038424269999999998 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.105908+0000", 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0992000000000002e-05 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.105957+0000", 2024-09-21T09:12:54.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8628000000000003e-05 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1916 3.24 3:278f10aa:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.591627+0000", 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.829474442, 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018567160999999999, 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1916 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.591627+0000", 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.591627+0000", 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.591630+0000", 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6769999999999999e-06 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595380+0000", 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003750265 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595409+0000", 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8535e-05 2024-09-21T09:12:54.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595423+0000", 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4299e-05 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595516+0000", 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3241999999999999e-05 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595677+0000", 2024-09-21T09:12:54.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016073899999999999 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.595826+0000", 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148839 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.601944+0000", 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061175860000000004 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.610085+0000", 2024-09-21T09:12:54.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0081411350000000007 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.610152+0000", 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7138999999999995e-05 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.610195+0000", 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2704999999999999e-05 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1930 3.25 3:a48e38fc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.749346+0000", 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.671755572, 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019726848000000002, 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1930 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.522 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.749346+0000", 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.749346+0000", 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.749390+0000", 2024-09-21T09:12:54.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3881000000000002e-05 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.753954+0000", 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045636349999999999 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.753994+0000", 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0682000000000001e-05 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754020+0000", 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5981000000000001e-05 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754157+0000", 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013675499999999999 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754398+0000", 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000241153 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.754644+0000", 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024586600000000002 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.763986+0000", 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093414110000000009 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.768763+0000", 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047770989999999999 2024-09-21T09:12:54.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.768944+0000", 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018164 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.769073+0000", 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012874499999999999 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1931 3.24 3:26cd634c:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.760522+0000", 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.660579697999999, 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021060718999999999, 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1931 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.760522+0000", 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.760522+0000", 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.760526+0000", 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7929999999999999e-06 2024-09-21T09:12:54.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.764987+0000", 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044612209999999996 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765033+0000", 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6241e-05 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765061+0000", 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7418000000000001e-05 2024-09-21T09:12:54.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765222+0000", 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016105399999999999 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765569+0000", 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034681700000000002 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.765797+0000", 2024-09-21T09:12:54.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022870200000000001 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.780465+0000", 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014667695999999999 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781292+0000", 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00082726399999999997 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781456+0000", 2024-09-21T09:12:54.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163898 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781583+0000", 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012661500000000001 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1934 3.7 e66/24 3:e2d55273:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_191:head v 66'4, mlcod=62'2)", 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.800593+0000", 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.620509134000001, 2024-09-21T09:12:54.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023533157999999998, 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.800593+0000", 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.800593+0000", 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.800595+0000", 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3259999999999998e-06 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807173+0000", 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065779369999999998 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807224+0000", 2024-09-21T09:12:54.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0794000000000002e-05 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807251+0000", 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6868000000000001e-05 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807435+0000", 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184916 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.807495+0000", 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9679999999999998e-05 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.823968+0000", 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016472992999999998 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.824126+0000", 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000157644 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.537 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1935 3.4 3:23c8af85:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.804040+0000", 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.617062283999999, 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025977671000000001, 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:54.538 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1935 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.804040+0000", 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.804040+0000", 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:54.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.804042+0000", 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7829999999999999e-06 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810574+0000", 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065318269999999996 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810623+0000", 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8649999999999997e-05 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810648+0000", 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5128999999999999e-05 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.810833+0000", 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018524599999999999 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.811283+0000", 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00045005300000000001 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.811770+0000", 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000486689 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.827600+0000", 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015830462999999999 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.829839+0000", 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022383289999999998 2024-09-21T09:12:54.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.829933+0000", 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4310999999999999e-05 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.830017+0000", 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4190999999999994e-05 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:54.543 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:54.545 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-21T09:12:54.538+0000 7f4d99f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26438) UID: 0 2024-09-21T09:12:54.546 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T09:12:54.546 DEBUG:teuthology.parallel:result is None 2024-09-21T09:12:54.546 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T09:12:54.603 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T09:12:54.603 DEBUG:teuthology.orchestra.run.smithi007:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-21T09:12:54.645 INFO:tasks.ceph.osd.4.smithi050.stderr:2024-09-21T09:12:54.643+0000 7fce720ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26477) UID: 0 2024-09-21T09:12:54.662 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T09:12:54.662 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-21T09:12:54.672 INFO:tasks.thrashosds:joining thrashosds 2024-09-21T09:12:54.677 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:54.677 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:54.678 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-21T09:12:54.678 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:54.693 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T09:12:54.856 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:54.856 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-21T09:12:54.857 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-21T09:12:54.857 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-21T09:12:54.857 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:54.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T09:12:55.000 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-21T09:12:55.000 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-21T09:12:55.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-21T09:12:55.000 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-21T09:12:55.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.000 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1250 3.0 e59/24 3:01c52555:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_7:head v 59'1, mlcod=0'0)", 2024-09-21T09:12:55.000 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:55.000 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.934502788000003, 2024-09-21T09:12:55.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019412175, 2024-09-21T09:12:55.000 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062727+0000", 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.062729+0000", 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4399999999999999e-06 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068286+0000", 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055572190000000004 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068320+0000", 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4069000000000002e-05 2024-09-21T09:12:55.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068339+0000", 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8433000000000001e-05 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068528+0000", 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018950099999999999 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.068587+0000", 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8545999999999998e-05 2024-09-21T09:12:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082000+0000", 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013412884999999999 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.082139+0000", 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013908200000000001 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1257 3.2e 3:748eda2f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.863478463, 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.030777402999999998, 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1257 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133751+0000", 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.133755+0000", 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6890000000000002e-06 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.148913+0000", 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015158207 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.148973+0000", 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0424999999999998e-05 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149005+0000", 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1588999999999999e-05 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149191+0000", 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000186391 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149587+0000", 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039548900000000001 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.149983+0000", 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000395929 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.163254+0000", 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013271173000000001 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164324+0000", 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010705039999999999 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164449+0000", 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012412600000000001 2024-09-21T09:12:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.164528+0000", 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9881000000000003e-05 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1271 3.2e 3:76653b78:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.711017945999998, 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021378690999999998, 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1271 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286212+0000", 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.286214+0000", 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7099999999999999e-06 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291359+0000", 2024-09-21T09:12:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005144554 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291399+0000", 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9983e-05 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291427+0000", 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8152000000000001e-05 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291603+0000", 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176028 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.291857+0000", 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025373000000000003 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.292093+0000", 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023640999999999999 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.304468+0000", 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012374970000000001 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307321+0000", 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002852491 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307474+0000", 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015347900000000001 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.307590+0000", 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116184 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1312 3.b 3:d07beb3d:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.114808185999998, 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020651398000000001, 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1312 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882421+0000", 2024-09-21T09:12:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.882425+0000", 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6600000000000001e-06 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886385+0000", 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039597679999999998 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886407+0000", 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2143000000000001e-05 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886417+0000", 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9620000000000005e-06 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886510+0000", 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3453000000000001e-05 2024-09-21T09:12:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886739+0000", 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022843599999999999 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.886953+0000", 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021450000000000001 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.892836+0000", 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058827300000000001 2024-09-21T09:12:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.902975+0000", 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010139426999999999 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.903028+0000", 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2608999999999997e-05 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:21.903073+0000", 2024-09-21T09:12:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4709999999999997e-05 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1320 3.2e 3:75d4642b:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.949798928999996, 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018026718000000001, 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1320 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047431+0000", 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.047434+0000", 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2229999999999999e-06 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051443+0000", 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040093439999999998 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051486+0000", 2024-09-21T09:12:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3222000000000001e-05 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051513+0000", 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6401999999999999e-05 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051655+0000", 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014170400000000001 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051826+0000", 2024-09-21T09:12:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017193500000000001 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.051987+0000", 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016016000000000001 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.057648+0000", 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056618600000000003 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065327+0000", 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076783520000000003 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065398+0000", 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1675999999999996e-05 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.065457+0000", 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8839999999999999e-05 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1324 3.2e 3:773eeeb4:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.861703761999998, 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020230399, 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1324 2024-09-21T09:12:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135526+0000", 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.135529+0000", 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1700000000000001e-06 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139590+0000", 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040607860000000003 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139626+0000", 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6508999999999999e-05 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139651+0000", 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4692e-05 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139740+0000", 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8800000000000004e-05 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139853+0000", 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011372200000000001 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.139948+0000", 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4049999999999996e-05 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.144662+0000", 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047143530000000001 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155681+0000", 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011019153 2024-09-21T09:12:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155723+0000", 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2014000000000001e-05 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.155756+0000", 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3149999999999999e-05 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1344 3.b 3:d3ddf01f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.459503542999997, 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017394212999999999, 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1344 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537726+0000", 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.537729+0000", 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.157e-06 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542421+0000", 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046917460000000001 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542457+0000", 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6396000000000002e-05 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542475+0000", 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7663e-05 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542621+0000", 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145943 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.542894+0000", 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027341300000000002 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.543122+0000", 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227557 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.554640+0000", 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011517853999999999 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.554941+0000", 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030173899999999998 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.555035+0000", 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3640999999999993e-05 2024-09-21T09:12:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.555120+0000", 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5104000000000004e-05 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1368 3.2e 3:74fb0022:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.119916527999997, 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015885940000000001, 2024-09-21T09:12:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1368 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877313+0000", 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.877316+0000", 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5380000000000001e-06 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881169+0000", 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038535430000000001 2024-09-21T09:12:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881196+0000", 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539000000000001e-05 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881208+0000", 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1919999999999999e-05 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881267+0000", 2024-09-21T09:12:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9691999999999997e-05 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881393+0000", 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000126129 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.881508+0000", 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114156 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.885968+0000", 2024-09-21T09:12:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004460365 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893120+0000", 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007152538 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893162+0000", 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1854000000000003e-05 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.893199+0000", 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6665999999999998e-05 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1377 3.21 3:85925c47:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.4__shadow_.qKPWge-ojBrzqXj46Ci77cyu0eutflf_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.012534944999999, 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016148349999999999, 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1377 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984695+0000", 2024-09-21T09:12:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.984699+0000", 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0029999999999996e-06 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989011+0000", 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004312209 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989050+0000", 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9496000000000003e-05 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989070+0000", 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9306000000000001e-05 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989244+0000", 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000173945 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.989640+0000", 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039646700000000001 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.990033+0000", 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039296300000000003 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:22.999277+0000", 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092444799999999994 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000657+0000", 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013798059999999999 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000761+0000", 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103665 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:23.000843+0000", 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2009999999999996e-05 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1546 3.1d e61/43 3:b8116d35:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5__shadow_.rtiP5--qH128ENnLCVg38EotA7njfyW_15:head v 61'8, mlcod=60'6)", 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.402349310999998, 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018965064, 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594880+0000", 2024-09-21T09:12:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.594884+0000", 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3330000000000001e-06 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601862+0000", 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069784510000000001 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601909+0000", 2024-09-21T09:12:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7052000000000003e-05 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.601932+0000", 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2962000000000001e-05 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602065+0000", 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013274700000000001 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.602106+0000", 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1625999999999998e-05 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.613748+0000", 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011642062 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.613845+0000", 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6830999999999995e-05 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1557 3.2e 3:771f05bc:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.5_100Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.241425362000001, 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023866490000000001, 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1557 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.056 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755804+0000", 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.755808+0000", 2024-09-21T09:12:55.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3330000000000001e-06 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760408+0000", 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046002960000000002 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760449+0000", 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1681999999999998e-05 2024-09-21T09:12:55.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760469+0000", 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9809999999999998e-05 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.760669+0000", 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000200065 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.761108+0000", 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043852600000000001 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.762360+0000", 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001252555 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.778150+0000", 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015789290000000001 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779443+0000", 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012928289999999999 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779587+0000", 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014415900000000001 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:25.779671+0000", 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3944999999999997e-05 2024-09-21T09:12:55.061 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1596 3.21 3:8499e3d2:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.752383512000002, 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017352083000000001, 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1596 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244846+0000", 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.244852+0000", 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8250000000000001e-06 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249499+0000", 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046469349999999996 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249527+0000", 2024-09-21T09:12:55.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7767e-05 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249538+0000", 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1138000000000001e-05 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249686+0000", 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148574 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.249959+0000", 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027321399999999998 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.250202+0000", 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000242864 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.260647+0000", 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010445060000000001 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262040+0000", 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001392449 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262126+0000", 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6388e-05 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.262198+0000", 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1868999999999999e-05 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.067 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1609 3.21 3:85d5ed9f:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.6__shadow_.D4YfsOL34mJvR3Yl2r06bIYgMnzMytn_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.588844213000002, 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016153879999999999, 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.068 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1609 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408385+0000", 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.408387+0000", 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.956e-06 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411460+0000", 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030725240000000001 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411478+0000", 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8286000000000001e-05 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411491+0000", 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.296e-05 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.411695+0000", 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020357799999999999 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.412057+0000", 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000362402 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.412539+0000", 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000481528 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.419746+0000", 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072079359999999999 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424338+0000", 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045913780000000001 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424456+0000", 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118334 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:27.424539+0000", 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2997999999999994e-05 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1765 3.21 3:871ca5b6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.373459243999999, 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022099173999999999, 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1765 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623770+0000", 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.623775+0000", 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4730000000000002e-06 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.628965+0000", 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051900050000000001 2024-09-21T09:12:55.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629006+0000", 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1533999999999999e-05 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629025+0000", 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8196e-05 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629157+0000", 2024-09-21T09:12:55.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132781 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629415+0000", 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025730399999999997 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.629647+0000", 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023241200000000001 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.641959+0000", 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012311767 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645546+0000", 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035869560000000001 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645731+0000", 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018504200000000001 2024-09-21T09:12:55.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.645869+0000", 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013870399999999999 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1777 3.2e 3:74182f8a:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:55.080 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.199998189, 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019532442000000001, 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1777 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797231+0000", 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.797235+0000", 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3110000000000001e-06 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801081+0000", 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038459890000000002 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801112+0000", 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1514999999999999e-05 2024-09-21T09:12:55.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801129+0000", 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6934000000000001e-05 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801227+0000", 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7442999999999995e-05 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801430+0000", 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020329300000000001 2024-09-21T09:12:55.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.801614+0000", 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000184525 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.807398+0000", 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057833529999999998 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816627+0000", 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092296080000000003 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816706+0000", 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8294999999999995e-05 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:39.816764+0000", 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8176e-05 2024-09-21T09:12:55.086 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1817 3.b 3:d1dcc069:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.658088306, 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017632233000000001, 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.087 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1817 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339141+0000", 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.339144+0000", 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.328e-06 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343186+0000", 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040426910000000002 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343218+0000", 2024-09-21T09:12:55.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2183e-05 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343233+0000", 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4430000000000001e-05 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343425+0000", 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019234499999999999 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.343871+0000", 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000445659 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.344300+0000", 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042892100000000002 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356373+0000", 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012073406 2024-09-21T09:12:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356567+0000", 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019390999999999999 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356680+0000", 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011297 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.356773+0000", 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3389999999999999e-05 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1847 3.21 3:841376c9:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.154506524, 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.02309464, 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.093 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1847 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842723+0000", 2024-09-21T09:12:55.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.842726+0000", 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7159999999999999e-06 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846655+0000", 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039289329999999999 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846681+0000", 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.635e-05 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846695+0000", 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3988999999999999e-05 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.846786+0000", 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0605000000000004e-05 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.847020+0000", 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000234458 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.847233+0000", 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021297699999999999 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.853208+0000", 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059752599999999996 2024-09-21T09:12:55.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865654+0000", 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012445289999999999 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865746+0000", 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2262000000000005e-05 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:40.865818+0000", 2024-09-21T09:12:55.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1799999999999997e-05 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1885 3.b 3:d37941b6:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.765973376, 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017285139000000001, 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1885 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231256+0000", 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.231259+0000", 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7779999999999999e-06 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235037+0000", 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037777710000000001 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235064+0000", 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7509e-05 2024-09-21T09:12:55.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235079+0000", 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.432e-05 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235199+0000", 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120555 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235451+0000", 2024-09-21T09:12:55.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025202200000000002 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 6", 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.235673+0000", 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221547 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.243413+0000", 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077399119999999998 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248203+0000", 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004790239 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248405+0000", 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020200099999999999 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.248541+0000", 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013648499999999999 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4367.0:1913 3.21 3:87dbe7e5:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.437771911, 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016018510999999999, 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4367", 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.7:0/1250223439", 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 1913 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.105 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559458+0000", 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.559460+0000", 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0540000000000002e-06 2024-09-21T09:12:55.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563313+0000", 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038530679999999999 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563342+0000", 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8765e-05 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563355+0000", 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3217000000000001e-05 2024-09-21T09:12:55.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563446+0000", 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1229000000000004e-05 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563625+0000", 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017948000000000001 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 1", 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.563784+0000", 2024-09-21T09:12:55.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015840099999999999 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.572444+0000", 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086599659999999998 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575327+0000", 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028827639999999999 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575407+0000", 2024-09-21T09:12:55.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0838000000000001e-05 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.575476+0000", 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8728999999999999e-05 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4367.0:1932 3.1d e66/43 3:ba4e63e7:::2295307e-9d2c-4406-8af2-3d485a5a3c79.4367.8__shadow_.is-yc-Zr9frO-xMVV-BmfrVOxlY-jK7_189:head v 66'13, mlcod=66'11)", 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-21T09:12:41.773715+0000", 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.223514991, 2024-09-21T09:12:55.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017760706000000001, 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.773715+0000", 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.773715+0000", 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.773717+0000", 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1430000000000001e-06 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781583+0000", 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078659739999999995 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781627+0000", 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4246999999999998e-05 2024-09-21T09:12:55.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781646+0000", 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9539e-05 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781760+0000", 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011317 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.781802+0000", 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2543999999999998e-05 2024-09-21T09:12:55.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.791376+0000", 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095742450000000003 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-21T09:12:41.791475+0000", 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8844000000000004e-05 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-21T09:12:55.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-21T09:12:55.115 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-21T09:12:56.189 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T09:12:56.566 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2024-09-21T09:12:56.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T09:12:57.586 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2024-09-21T09:13:17.127 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-21T09:13:17.127 INFO:tasks.thrashosds.thrasher:Adding osd 2 2024-09-21T09:13:17.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 2 2024-09-21T09:13:17.452 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-09-21T09:13:17.446+0000 7f640a5ef640 -1 mon.a@0(leader).osd e74 definitely_dead 0 2024-09-21T09:13:18.120 INFO:teuthology.orchestra.run.smithi007.stderr:marked in osd.2. 2024-09-21T09:13:18.161 INFO:tasks.thrashosds.thrasher:Added osd 2 2024-09-21T09:13:18.161 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-21T09:13:18.295 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a: {} 2024-09-21T09:13:18.295 INFO:teuthology.orchestra.run.smithi007.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T09:13:18.308 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b: {} 2024-09-21T09:13:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T09:13:18.317 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c: {} 2024-09-21T09:13:18.318 INFO:teuthology.orchestra.run.smithi007.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T09:13:18.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T09:13:19.108 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T09:13:19.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-21T09:13:20.111 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-21T09:13:20.159 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T09:13:21.140 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T09:13:21.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-21T09:13:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-21T09:13:22.181 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T09:13:23.156 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T09:13:23.182 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-21T09:13:24.171 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-21T09:13:24.196 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T09:13:25.188 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T09:13:25.213 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-21T09:13:26.182 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-21T09:13:26.212 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T09:13:27.202 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T09:13:27.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-21T09:13:28.213 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-21T09:13:28.242 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T09:13:29.230 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T09:13:29.253 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-21T09:13:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-21T09:13:30.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-21T09:13:31.251 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.6 to 1 (10000) 2024-09-21T09:13:31.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-21T09:13:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-21T09:13:32.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T09:13:33.281 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T09:13:33.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-21T09:13:34.295 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-21T09:13:34.321 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-21T09:13:34.321 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-21T09:13:34.321 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-21T09:13:34.321 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-21T09:13:34.321 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T09:13:34.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T09:13:34.638 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:13:34.638 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3","created":"2024-09-21T09:10:28.086623+0000","modified":"2024-09-21T09:13:34.280445+0000","last_up_change":"2024-09-21T09:10:41.697031+0000","last_in_change":"2024-09-21T09:13:18.090416+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T09:10:43.023047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T09:10:47.239561+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-21T09:10:55.648452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-21T09:10:57.205791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-21T09:10:59.105322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-21T09:11:00.986978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-21T09:11:02.911448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-21T09:11:05.053819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d44c360-02ac-4142-a4a1-3ef3bae71ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6817","nonce":1603589667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6819","nonce":1603589667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6823","nonce":1603589667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6821","nonce":1603589667}]},"public_addr":"172.21.15.7:6817/1603589667","cluster_addr":"172.21.15.7:6819/1603589667","heartbeat_back_addr":"172.21.15.7:6823/1603589667","heartbeat_front_addr":"172.21.15.7:6821/1603589667","state":["exists","up"]},{"osd":1,"uuid":"02fc3a59-f3a3-412b-ba73-5f43dc7c4714","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6825","nonce":4002665254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6827","nonce":4002665254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6831","nonce":4002665254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6829","nonce":4002665254}]},"public_addr":"172.21.15.7:6825/4002665254","cluster_addr":"172.21.15.7:6827/4002665254","heartbeat_back_addr":"172.21.15.7:6831/4002665254","heartbeat_front_addr":"172.21.15.7:6829/4002665254","state":["exists","up"]},{"osd":2,"uuid":"2ad4a646-5d8d-431d-89c1-5f13ae2c6048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6809","nonce":992756194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6811","nonce":992756194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6815","nonce":992756194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6813","nonce":992756194}]},"public_addr":"172.21.15.7:6809/992756194","cluster_addr":"172.21.15.7:6811/992756194","heartbeat_back_addr":"172.21.15.7:6815/992756194","heartbeat_front_addr":"172.21.15.7:6813/992756194","state":["exists","up"]},{"osd":3,"uuid":"99b23411-8e42-453f-917e-8342abf03624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6801","nonce":1625592448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6803","nonce":1625592448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6807","nonce":1625592448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6805","nonce":1625592448}]},"public_addr":"172.21.15.7:6801/1625592448","cluster_addr":"172.21.15.7:6803/1625592448","heartbeat_back_addr":"172.21.15.7:6807/1625592448","heartbeat_front_addr":"172.21.15.7:6805/1625592448","state":["exists","up"]},{"osd":4,"uuid":"7d1e4d92-c6ab-4218-bc8e-2809085574b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6803","nonce":50317293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6805","nonce":50317293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6809","nonce":50317293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6807","nonce":50317293}]},"public_addr":"172.21.15.50:6803/50317293","cluster_addr":"172.21.15.50:6805/50317293","heartbeat_back_addr":"172.21.15.50:6809/50317293","heartbeat_front_addr":"172.21.15.50:6807/50317293","state":["exists","up"]},{"osd":5,"uuid":"2065653a-bbf5-4d55-b57c-a947d18b5fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6820","nonce":3773654391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6824","nonce":3773654391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6832","nonce":3773654391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6828","nonce":3773654391}]},"public_addr":"172.21.15.50:6820/3773654391","cluster_addr":"172.21.15.50:6824/3773654391","heartbeat_back_addr":"172.21.15.50:6832/3773654391","heartbeat_front_addr":"172.21.15.50:6828/3773654391","state":["exists","up"]},{"osd":6,"uuid":"59146344-8e80-4b04-8947-1c119e33be55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6821","nonce":2220031654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6825","nonce":2220031654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6831","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6833","nonce":2220031654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6829","nonce":2220031654}]},"public_addr":"172.21.15.50:6821/2220031654","cluster_addr":"172.21.15.50:6825/2220031654","heartbeat_back_addr":"172.21.15.50:6833/2220031654","heartbeat_front_addr":"172.21.15.50:6829/2220031654","state":["exists","up"]},{"osd":7,"uuid":"2bd65ed0-7bb8-43d1-a5c6-0713c265495a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6811","nonce":647878711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6813","nonce":647878711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6817","nonce":647878711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6815","nonce":647878711}]},"public_addr":"172.21.15.50:6811/647878711","cluster_addr":"172.21.15.50:6813/647878711","heartbeat_back_addr":"172.21.15.50:6817/647878711","heartbeat_front_addr":"172.21.15.50:6815/647878711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.970712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.599658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.516125+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.728100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.283957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.740034+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.565564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.895681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:13:34.658 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T09:13:34.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T09:13:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:13:34.962 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3","created":"2024-09-21T09:10:28.086623+0000","modified":"2024-09-21T09:13:34.280445+0000","last_up_change":"2024-09-21T09:10:41.697031+0000","last_in_change":"2024-09-21T09:13:18.090416+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T09:10:43.023047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T09:10:47.239561+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-21T09:10:55.648452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-21T09:10:57.205791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-21T09:10:59.105322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-21T09:11:00.986978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-21T09:11:02.911448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-21T09:11:05.053819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d44c360-02ac-4142-a4a1-3ef3bae71ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6817","nonce":1603589667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6819","nonce":1603589667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6823","nonce":1603589667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6821","nonce":1603589667}]},"public_addr":"172.21.15.7:6817/1603589667","cluster_addr":"172.21.15.7:6819/1603589667","heartbeat_back_addr":"172.21.15.7:6823/1603589667","heartbeat_front_addr":"172.21.15.7:6821/1603589667","state":["exists","up"]},{"osd":1,"uuid":"02fc3a59-f3a3-412b-ba73-5f43dc7c4714","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6825","nonce":4002665254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6827","nonce":4002665254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6831","nonce":4002665254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6829","nonce":4002665254}]},"public_addr":"172.21.15.7:6825/4002665254","cluster_addr":"172.21.15.7:6827/4002665254","heartbeat_back_addr":"172.21.15.7:6831/4002665254","heartbeat_front_addr":"172.21.15.7:6829/4002665254","state":["exists","up"]},{"osd":2,"uuid":"2ad4a646-5d8d-431d-89c1-5f13ae2c6048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6809","nonce":992756194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6811","nonce":992756194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6815","nonce":992756194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6813","nonce":992756194}]},"public_addr":"172.21.15.7:6809/992756194","cluster_addr":"172.21.15.7:6811/992756194","heartbeat_back_addr":"172.21.15.7:6815/992756194","heartbeat_front_addr":"172.21.15.7:6813/992756194","state":["exists","up"]},{"osd":3,"uuid":"99b23411-8e42-453f-917e-8342abf03624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6801","nonce":1625592448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6803","nonce":1625592448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6807","nonce":1625592448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6805","nonce":1625592448}]},"public_addr":"172.21.15.7:6801/1625592448","cluster_addr":"172.21.15.7:6803/1625592448","heartbeat_back_addr":"172.21.15.7:6807/1625592448","heartbeat_front_addr":"172.21.15.7:6805/1625592448","state":["exists","up"]},{"osd":4,"uuid":"7d1e4d92-c6ab-4218-bc8e-2809085574b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6803","nonce":50317293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6805","nonce":50317293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6809","nonce":50317293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6807","nonce":50317293}]},"public_addr":"172.21.15.50:6803/50317293","cluster_addr":"172.21.15.50:6805/50317293","heartbeat_back_addr":"172.21.15.50:6809/50317293","heartbeat_front_addr":"172.21.15.50:6807/50317293","state":["exists","up"]},{"osd":5,"uuid":"2065653a-bbf5-4d55-b57c-a947d18b5fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6820","nonce":3773654391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6824","nonce":3773654391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6832","nonce":3773654391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6828","nonce":3773654391}]},"public_addr":"172.21.15.50:6820/3773654391","cluster_addr":"172.21.15.50:6824/3773654391","heartbeat_back_addr":"172.21.15.50:6832/3773654391","heartbeat_front_addr":"172.21.15.50:6828/3773654391","state":["exists","up"]},{"osd":6,"uuid":"59146344-8e80-4b04-8947-1c119e33be55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6821","nonce":2220031654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6825","nonce":2220031654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6831","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6833","nonce":2220031654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6829","nonce":2220031654}]},"public_addr":"172.21.15.50:6821/2220031654","cluster_addr":"172.21.15.50:6825/2220031654","heartbeat_back_addr":"172.21.15.50:6833/2220031654","heartbeat_front_addr":"172.21.15.50:6829/2220031654","state":["exists","up"]},{"osd":7,"uuid":"2bd65ed0-7bb8-43d1-a5c6-0713c265495a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6811","nonce":647878711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6813","nonce":647878711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6817","nonce":647878711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6815","nonce":647878711}]},"public_addr":"172.21.15.50:6811/647878711","cluster_addr":"172.21.15.50:6813/647878711","heartbeat_back_addr":"172.21.15.50:6817/647878711","heartbeat_front_addr":"172.21.15.50:6815/647878711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.970712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.599658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.516125+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.728100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.283957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.740034+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.565564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.895681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:13:34.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T09:13:34.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T09:13:34.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T09:13:34.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T09:13:34.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T09:13:34.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T09:13:34.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T09:13:34.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T09:13:35.250 INFO:teuthology.orchestra.run.smithi007.stdout:64424509478 2024-09-21T09:13:35.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T09:13:35.260 INFO:teuthology.orchestra.run.smithi007.stdout:64424509478 2024-09-21T09:13:35.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T09:13:35.261 INFO:teuthology.orchestra.run.smithi007.stdout:64424509478 2024-09-21T09:13:35.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T09:13:35.262 INFO:teuthology.orchestra.run.smithi007.stdout:64424509479 2024-09-21T09:13:35.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T09:13:35.263 INFO:teuthology.orchestra.run.smithi007.stdout:64424509479 2024-09-21T09:13:35.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T09:13:35.265 INFO:teuthology.orchestra.run.smithi007.stdout:64424509479 2024-09-21T09:13:35.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T09:13:35.275 INFO:teuthology.orchestra.run.smithi007.stdout:64424509479 2024-09-21T09:13:35.275 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T09:13:35.279 INFO:teuthology.orchestra.run.smithi007.stdout:55834574886 2024-09-21T09:13:35.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T09:13:35.770 INFO:teuthology.orchestra.run.smithi007.stdout:64424509477 2024-09-21T09:13:35.788 INFO:teuthology.orchestra.run.smithi007.stdout:64424509477 2024-09-21T09:13:35.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509478 got 64424509477 for osd.2 2024-09-21T09:13:35.798 INFO:teuthology.orchestra.run.smithi007.stdout:64424509477 2024-09-21T09:13:35.810 INFO:teuthology.orchestra.run.smithi007.stdout:64424509478 2024-09-21T09:13:35.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509478 got 64424509477 for osd.7 2024-09-21T09:13:35.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509478 got 64424509477 for osd.0 2024-09-21T09:13:35.831 INFO:teuthology.orchestra.run.smithi007.stdout:64424509478 2024-09-21T09:13:35.832 INFO:teuthology.orchestra.run.smithi007.stdout:64424509478 2024-09-21T09:13:35.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509478 for osd.3 2024-09-21T09:13:35.839 INFO:teuthology.orchestra.run.smithi007.stdout:64424509478 2024-09-21T09:13:35.848 INFO:teuthology.orchestra.run.smithi007.stdout:55834574885 2024-09-21T09:13:35.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509478 for osd.6 2024-09-21T09:13:35.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509478 for osd.1 2024-09-21T09:13:35.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509478 for osd.5 2024-09-21T09:13:35.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574886 got 55834574885 for osd.4 2024-09-21T09:13:36.798 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T09:13:36.818 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T09:13:36.830 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T09:13:36.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T09:13:36.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T09:13:36.862 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T09:13:36.864 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T09:13:36.872 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T09:13:37.344 INFO:teuthology.orchestra.run.smithi007.stdout:64424509478 2024-09-21T09:13:37.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509478 got 64424509478 for osd.2 2024-09-21T09:13:37.369 DEBUG:teuthology.parallel:result is None 2024-09-21T09:13:37.371 INFO:teuthology.orchestra.run.smithi007.stdout:64424509478 2024-09-21T09:13:37.379 INFO:teuthology.orchestra.run.smithi007.stdout:64424509478 2024-09-21T09:13:37.383 INFO:teuthology.orchestra.run.smithi007.stdout:64424509479 2024-09-21T09:13:37.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509478 got 64424509478 for osd.7 2024-09-21T09:13:37.403 INFO:teuthology.orchestra.run.smithi007.stdout:64424509479 2024-09-21T09:13:37.404 DEBUG:teuthology.parallel:result is None 2024-09-21T09:13:37.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509479 for osd.3 2024-09-21T09:13:37.405 DEBUG:teuthology.parallel:result is None 2024-09-21T09:13:37.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509478 got 64424509478 for osd.0 2024-09-21T09:13:37.416 DEBUG:teuthology.parallel:result is None 2024-09-21T09:13:37.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509479 for osd.5 2024-09-21T09:13:37.424 INFO:teuthology.orchestra.run.smithi007.stdout:55834574886 2024-09-21T09:13:37.424 DEBUG:teuthology.parallel:result is None 2024-09-21T09:13:37.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574886 got 55834574886 for osd.4 2024-09-21T09:13:37.440 DEBUG:teuthology.parallel:result is None 2024-09-21T09:13:37.449 INFO:teuthology.orchestra.run.smithi007.stdout:64424509479 2024-09-21T09:13:37.463 INFO:teuthology.orchestra.run.smithi007.stdout:64424509479 2024-09-21T09:13:37.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509479 for osd.1 2024-09-21T09:13:37.466 DEBUG:teuthology.parallel:result is None 2024-09-21T09:13:37.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509479 for osd.6 2024-09-21T09:13:37.481 DEBUG:teuthology.parallel:result is None 2024-09-21T09:13:37.481 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T09:13:37.481 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:13:37.852 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:13:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:13:37.878 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-21T09:13:37.019138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397793038,"num_objects":773,"num_object_clones":0,"num_object_copies":1546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":773,"num_whiteouts":0,"num_read":2000,"num_read_kb":1716,"num_write":1739,"num_write_kb":2368151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":1149241676,"num_keys_recovered":26,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2521,"ondisk_log_size":2521,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4978792,"kb_used_data":4691820,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":749995928,"statfs":{"total":773094113280,"available":767995830272,"internally_reserved":0,"allocated":4804423680,"data_stored":4800313723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.774290"},"pg_stats":[{"pgid":"3.3f","version":"66'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299072+0000","last_change":"2024-09-21T09:10:56.846463+0000","last_active":"2024-09-21T09:13:34.299072+0000","last_peered":"2024-09-21T09:13:34.299072+0000","last_clean":"2024-09-21T09:13:34.299072+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:13:34.299072+0000","last_undegraded":"2024-09-21T09:13:34.299072+0000","last_fullsized":"2024-09-21T09:13:34.299072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"58'2","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291991+0000","last_change":"2024-09-21T09:10:58.836923+0000","last_active":"2024-09-21T09:13:33.291991+0000","last_peered":"2024-09-21T09:13:33.291991+0000","last_clean":"2024-09-21T09:13:33.291991+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:13:33.291991+0000","last_undegraded":"2024-09-21T09:13:33.291991+0000","last_fullsized":"2024-09-21T09:13:33.291991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:30.880333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"67'13","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957928+0000","last_change":"2024-09-21T09:10:56.865056+0000","last_active":"2024-09-21T09:13:34.957928+0000","last_peered":"2024-09-21T09:13:34.957928+0000","last_clean":"2024-09-21T09:13:34.957928+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:13:34.957928+0000","last_undegraded":"2024-09-21T09:13:34.957928+0000","last_fullsized":"2024-09-21T09:13:34.957928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482290+0000","last_change":"2024-09-21T09:10:58.835355+0000","last_active":"2024-09-21T09:13:34.482290+0000","last_peered":"2024-09-21T09:13:34.482290+0000","last_clean":"2024-09-21T09:13:34.482290+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:13:34.482290+0000","last_undegraded":"2024-09-21T09:13:34.482290+0000","last_fullsized":"2024-09-21T09:13:34.482290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:24.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"67'13","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957115+0000","last_change":"2024-09-21T09:10:56.861504+0000","last_active":"2024-09-21T09:13:34.957115+0000","last_peered":"2024-09-21T09:13:34.957115+0000","last_clean":"2024-09-21T09:13:34.957115+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:13:34.957115+0000","last_undegraded":"2024-09-21T09:13:34.957115+0000","last_fullsized":"2024-09-21T09:13:34.957115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:00.409267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482198+0000","last_change":"2024-09-21T09:13:19.490368+0000","last_active":"2024-09-21T09:13:34.482198+0000","last_peered":"2024-09-21T09:13:34.482198+0000","last_clean":"2024-09-21T09:13:34.482198+0000","last_became_active":"2024-09-21T09:13:19.153424+0000","last_became_peered":"2024-09-21T09:13:19.153424+0000","last_unstale":"2024-09-21T09:13:34.482198+0000","last_undegraded":"2024-09-21T09:13:34.482198+0000","last_fullsized":"2024-09-21T09:13:34.482198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:25.154789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"66'13","reported_seq":68,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298556+0000","last_change":"2024-09-21T09:13:20.586732+0000","last_active":"2024-09-21T09:13:34.298556+0000","last_peered":"2024-09-21T09:13:34.298556+0000","last_clean":"2024-09-21T09:13:34.298556+0000","last_became_active":"2024-09-21T09:13:19.165441+0000","last_became_peered":"2024-09-21T09:13:19.165441+0000","last_unstale":"2024-09-21T09:13:34.298556+0000","last_undegraded":"2024-09-21T09:13:34.298556+0000","last_fullsized":"2024-09-21T09:13:34.298556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:51.794446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"58'4","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286885+0000","last_change":"2024-09-21T09:13:20.643217+0000","last_active":"2024-09-21T09:13:33.286885+0000","last_peered":"2024-09-21T09:13:33.286885+0000","last_clean":"2024-09-21T09:13:33.286885+0000","last_became_active":"2024-09-21T09:13:19.153875+0000","last_became_peered":"2024-09-21T09:13:19.153875+0000","last_unstale":"2024-09-21T09:13:33.286885+0000","last_undegraded":"2024-09-21T09:13:33.286885+0000","last_fullsized":"2024-09-21T09:13:33.286885+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:03.004434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"67'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296553+0000","last_change":"2024-09-21T09:10:56.863607+0000","last_active":"2024-09-21T09:13:34.296553+0000","last_peered":"2024-09-21T09:13:34.296553+0000","last_clean":"2024-09-21T09:13:34.296553+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:13:34.296553+0000","last_undegraded":"2024-09-21T09:13:34.296553+0000","last_fullsized":"2024-09-21T09:13:34.296553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296333+0000","last_change":"2024-09-21T09:10:58.851357+0000","last_active":"2024-09-21T09:13:34.296333+0000","last_peered":"2024-09-21T09:13:34.296333+0000","last_clean":"2024-09-21T09:13:34.296333+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:13:34.296333+0000","last_undegraded":"2024-09-21T09:13:34.296333+0000","last_fullsized":"2024-09-21T09:13:34.296333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"66'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293642+0000","last_change":"2024-09-21T09:13:19.704935+0000","last_active":"2024-09-21T09:13:34.293642+0000","last_peered":"2024-09-21T09:13:34.293642+0000","last_clean":"2024-09-21T09:13:34.293642+0000","last_became_active":"2024-09-21T09:13:19.160915+0000","last_became_peered":"2024-09-21T09:13:19.160915+0000","last_unstale":"2024-09-21T09:13:34.293642+0000","last_undegraded":"2024-09-21T09:13:34.293642+0000","last_fullsized":"2024-09-21T09:13:34.293642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:00.863610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297928+0000","last_change":"2024-09-21T09:10:58.825880+0000","last_active":"2024-09-21T09:13:34.297928+0000","last_peered":"2024-09-21T09:13:34.297928+0000","last_clean":"2024-09-21T09:13:34.297928+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:13:34.297928+0000","last_undegraded":"2024-09-21T09:13:34.297928+0000","last_fullsized":"2024-09-21T09:13:34.297928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:46.662637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"66'5","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294804+0000","last_change":"2024-09-21T09:10:56.851331+0000","last_active":"2024-09-21T09:13:34.294804+0000","last_peered":"2024-09-21T09:13:34.294804+0000","last_clean":"2024-09-21T09:13:34.294804+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:13:34.294804+0000","last_undegraded":"2024-09-21T09:13:34.294804+0000","last_fullsized":"2024-09-21T09:13:34.294804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"62'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298620+0000","last_change":"2024-09-21T09:13:20.336460+0000","last_active":"2024-09-21T09:13:34.298620+0000","last_peered":"2024-09-21T09:13:34.298620+0000","last_clean":"2024-09-21T09:13:34.298620+0000","last_became_active":"2024-09-21T09:13:19.164775+0000","last_became_peered":"2024-09-21T09:13:19.164775+0000","last_unstale":"2024-09-21T09:13:34.298620+0000","last_undegraded":"2024-09-21T09:13:34.298620+0000","last_fullsized":"2024-09-21T09:13:34.298620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:16.166364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"67'11","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955584+0000","last_change":"2024-09-21T09:10:56.864409+0000","last_active":"2024-09-21T09:13:34.955584+0000","last_peered":"2024-09-21T09:13:34.955584+0000","last_clean":"2024-09-21T09:13:34.955584+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:13:34.955584+0000","last_undegraded":"2024-09-21T09:13:34.955584+0000","last_fullsized":"2024-09-21T09:13:34.955584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"62'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958533+0000","last_change":"2024-09-21T09:10:58.837006+0000","last_active":"2024-09-21T09:13:34.958533+0000","last_peered":"2024-09-21T09:13:34.958533+0000","last_clean":"2024-09-21T09:13:34.958533+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:13:34.958533+0000","last_undegraded":"2024-09-21T09:13:34.958533+0000","last_fullsized":"2024-09-21T09:13:34.958533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:52.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482026+0000","last_change":"2024-09-21T09:10:58.853249+0000","last_active":"2024-09-21T09:13:34.482026+0000","last_peered":"2024-09-21T09:13:34.482026+0000","last_clean":"2024-09-21T09:13:34.482026+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:13:34.482026+0000","last_undegraded":"2024-09-21T09:13:34.482026+0000","last_fullsized":"2024-09-21T09:13:34.482026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:03.692219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"66'11","reported_seq":149,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.294419+0000","last_change":"2024-09-21T09:10:56.838955+0000","last_active":"2024-09-21T09:13:33.294419+0000","last_peered":"2024-09-21T09:13:33.294419+0000","last_clean":"2024-09-21T09:13:33.294419+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:13:33.294419+0000","last_undegraded":"2024-09-21T09:13:33.294419+0000","last_fullsized":"2024-09-21T09:13:33.294419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294467+0000","last_change":"2024-09-21T09:10:58.869303+0000","last_active":"2024-09-21T09:13:34.294467+0000","last_peered":"2024-09-21T09:13:34.294467+0000","last_clean":"2024-09-21T09:13:34.294467+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:13:34.294467+0000","last_undegraded":"2024-09-21T09:13:34.294467+0000","last_fullsized":"2024-09-21T09:13:34.294467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"67'7","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298558+0000","last_change":"2024-09-21T09:13:21.021044+0000","last_active":"2024-09-21T09:13:34.298558+0000","last_peered":"2024-09-21T09:13:34.298558+0000","last_clean":"2024-09-21T09:13:34.298558+0000","last_became_active":"2024-09-21T09:13:19.154413+0000","last_became_peered":"2024-09-21T09:13:19.154413+0000","last_unstale":"2024-09-21T09:13:34.298558+0000","last_undegraded":"2024-09-21T09:13:34.298558+0000","last_fullsized":"2024-09-21T09:13:34.298558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'8","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292232+0000","last_change":"2024-09-21T09:10:58.840976+0000","last_active":"2024-09-21T09:13:33.292232+0000","last_peered":"2024-09-21T09:13:33.292232+0000","last_clean":"2024-09-21T09:13:33.292232+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:13:33.292232+0000","last_undegraded":"2024-09-21T09:13:33.292232+0000","last_fullsized":"2024-09-21T09:13:33.292232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"66'9","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298092+0000","last_change":"2024-09-21T09:10:56.853888+0000","last_active":"2024-09-21T09:13:34.298092+0000","last_peered":"2024-09-21T09:13:34.298092+0000","last_clean":"2024-09-21T09:13:34.298092+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:13:34.298092+0000","last_undegraded":"2024-09-21T09:13:34.298092+0000","last_fullsized":"2024-09-21T09:13:34.298092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294562+0000","last_change":"2024-09-21T09:10:58.838132+0000","last_active":"2024-09-21T09:13:34.294562+0000","last_peered":"2024-09-21T09:13:34.294562+0000","last_clean":"2024-09-21T09:13:34.294562+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:13:34.294562+0000","last_undegraded":"2024-09-21T09:13:34.294562+0000","last_fullsized":"2024-09-21T09:13:34.294562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"66'10","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296777+0000","last_change":"2024-09-21T09:10:56.845923+0000","last_active":"2024-09-21T09:13:34.296777+0000","last_peered":"2024-09-21T09:13:34.296777+0000","last_clean":"2024-09-21T09:13:34.296777+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:13:34.296777+0000","last_undegraded":"2024-09-21T09:13:34.296777+0000","last_fullsized":"2024-09-21T09:13:34.296777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'8","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956761+0000","last_change":"2024-09-21T09:10:58.848326+0000","last_active":"2024-09-21T09:13:34.956761+0000","last_peered":"2024-09-21T09:13:34.956761+0000","last_clean":"2024-09-21T09:13:34.956761+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:13:34.956761+0000","last_undegraded":"2024-09-21T09:13:34.956761+0000","last_fullsized":"2024-09-21T09:13:34.956761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:44.318321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"71'12","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295345+0000","last_change":"2024-09-21T09:10:56.859019+0000","last_active":"2024-09-21T09:13:34.295345+0000","last_peered":"2024-09-21T09:13:34.295345+0000","last_clean":"2024-09-21T09:13:34.295345+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:13:34.295345+0000","last_undegraded":"2024-09-21T09:13:34.295345+0000","last_fullsized":"2024-09-21T09:13:34.295345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"62'4","reported_seq":144,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292467+0000","last_change":"2024-09-21T09:10:58.830335+0000","last_active":"2024-09-21T09:13:33.292467+0000","last_peered":"2024-09-21T09:13:33.292467+0000","last_clean":"2024-09-21T09:13:33.292467+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:13:33.292467+0000","last_undegraded":"2024-09-21T09:13:33.292467+0000","last_fullsized":"2024-09-21T09:13:33.292467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"67'7","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294674+0000","last_change":"2024-09-21T09:10:56.862662+0000","last_active":"2024-09-21T09:13:34.294674+0000","last_peered":"2024-09-21T09:13:34.294674+0000","last_clean":"2024-09-21T09:13:34.294674+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:13:34.294674+0000","last_undegraded":"2024-09-21T09:13:34.294674+0000","last_fullsized":"2024-09-21T09:13:34.294674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295061+0000","last_change":"2024-09-21T09:11:06.898983+0000","last_active":"2024-09-21T09:13:34.295061+0000","last_peered":"2024-09-21T09:13:34.295061+0000","last_clean":"2024-09-21T09:13:34.295061+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:13:34.295061+0000","last_undegraded":"2024-09-21T09:13:34.295061+0000","last_fullsized":"2024-09-21T09:13:34.295061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294904+0000","last_change":"2024-09-21T09:10:58.876069+0000","last_active":"2024-09-21T09:13:34.294904+0000","last_peered":"2024-09-21T09:13:34.294904+0000","last_clean":"2024-09-21T09:13:34.294904+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:13:34.294904+0000","last_undegraded":"2024-09-21T09:13:34.294904+0000","last_fullsized":"2024-09-21T09:13:34.294904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"66'4","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482459+0000","last_change":"2024-09-21T09:10:56.848523+0000","last_active":"2024-09-21T09:13:34.482459+0000","last_peered":"2024-09-21T09:13:34.482459+0000","last_clean":"2024-09-21T09:13:34.482459+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:13:34.482459+0000","last_undegraded":"2024-09-21T09:13:34.482459+0000","last_fullsized":"2024-09-21T09:13:34.482459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:19.819608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483302+0000","last_change":"2024-09-21T09:11:00.842168+0000","last_active":"2024-09-21T09:13:34.483302+0000","last_peered":"2024-09-21T09:13:34.483302+0000","last_clean":"2024-09-21T09:13:34.483302+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:13:34.483302+0000","last_undegraded":"2024-09-21T09:13:34.483302+0000","last_fullsized":"2024-09-21T09:13:34.483302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:33.920548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"71'15","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287270+0000","last_change":"2024-09-21T09:11:02.866403+0000","last_active":"2024-09-21T09:13:33.287270+0000","last_peered":"2024-09-21T09:13:33.287270+0000","last_clean":"2024-09-21T09:13:33.287270+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:13:33.287270+0000","last_undegraded":"2024-09-21T09:13:33.287270+0000","last_fullsized":"2024-09-21T09:13:33.287270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:12.124539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291274+0000","last_change":"2024-09-21T09:11:04.894715+0000","last_active":"2024-09-21T09:13:33.291274+0000","last_peered":"2024-09-21T09:13:33.291274+0000","last_clean":"2024-09-21T09:13:33.291274+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:13:33.291274+0000","last_undegraded":"2024-09-21T09:13:33.291274+0000","last_fullsized":"2024-09-21T09:13:33.291274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:59.579572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"58'2","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293978+0000","last_change":"2024-09-21T09:11:06.885484+0000","last_active":"2024-09-21T09:13:33.293978+0000","last_peered":"2024-09-21T09:13:33.293978+0000","last_clean":"2024-09-21T09:13:33.293978+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:13:33.293978+0000","last_undegraded":"2024-09-21T09:13:33.293978+0000","last_fullsized":"2024-09-21T09:13:33.293978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:13.165470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"61'6","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483104+0000","last_change":"2024-09-21T09:10:58.842832+0000","last_active":"2024-09-21T09:13:34.483104+0000","last_peered":"2024-09-21T09:13:34.483104+0000","last_clean":"2024-09-21T09:13:34.483104+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:13:34.483104+0000","last_undegraded":"2024-09-21T09:13:34.483104+0000","last_fullsized":"2024-09-21T09:13:34.483104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:12.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:56.849428+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285845+0000","last_change":"2024-09-21T09:13:19.156069+0000","last_active":"2024-09-21T09:13:33.285845+0000","last_peered":"2024-09-21T09:13:33.285845+0000","last_clean":"2024-09-21T09:13:33.285845+0000","last_became_active":"2024-09-21T09:13:19.153940+0000","last_became_peered":"2024-09-21T09:13:19.153940+0000","last_unstale":"2024-09-21T09:13:33.285845+0000","last_undegraded":"2024-09-21T09:13:33.285845+0000","last_fullsized":"2024-09-21T09:13:33.285845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:57.795849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":135,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293848+0000","last_change":"2024-09-21T09:11:02.866594+0000","last_active":"2024-09-21T09:13:33.293848+0000","last_peered":"2024-09-21T09:13:33.293848+0000","last_clean":"2024-09-21T09:13:33.293848+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:13:33.293848+0000","last_undegraded":"2024-09-21T09:13:33.293848+0000","last_fullsized":"2024-09-21T09:13:33.293848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292703+0000","last_change":"2024-09-21T09:11:04.887299+0000","last_active":"2024-09-21T09:13:33.292703+0000","last_peered":"2024-09-21T09:13:33.292703+0000","last_clean":"2024-09-21T09:13:33.292703+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:13:33.292703+0000","last_undegraded":"2024-09-21T09:13:33.292703+0000","last_fullsized":"2024-09-21T09:13:33.292703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:08.490686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":129,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294124+0000","last_change":"2024-09-21T09:13:19.145016+0000","last_active":"2024-09-21T09:13:34.294124+0000","last_peered":"2024-09-21T09:13:34.294124+0000","last_clean":"2024-09-21T09:13:34.294124+0000","last_became_active":"2024-09-21T09:13:19.144143+0000","last_became_peered":"2024-09-21T09:13:19.144143+0000","last_unstale":"2024-09-21T09:13:34.294124+0000","last_undegraded":"2024-09-21T09:13:34.294124+0000","last_fullsized":"2024-09-21T09:13:34.294124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957751+0000","last_change":"2024-09-21T09:10:58.851370+0000","last_active":"2024-09-21T09:13:34.957751+0000","last_peered":"2024-09-21T09:13:34.957751+0000","last_clean":"2024-09-21T09:13:34.957751+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:13:34.957751+0000","last_undegraded":"2024-09-21T09:13:34.957751+0000","last_fullsized":"2024-09-21T09:13:34.957751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:05.984687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"66'4","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482409+0000","last_change":"2024-09-21T09:13:21.119832+0000","last_active":"2024-09-21T09:13:34.482409+0000","last_peered":"2024-09-21T09:13:34.482409+0000","last_clean":"2024-09-21T09:13:34.482409+0000","last_became_active":"2024-09-21T09:13:19.159398+0000","last_became_peered":"2024-09-21T09:13:19.159398+0000","last_unstale":"2024-09-21T09:13:34.482409+0000","last_undegraded":"2024-09-21T09:13:34.482409+0000","last_fullsized":"2024-09-21T09:13:34.482409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:40.942331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287538+0000","last_change":"2024-09-21T09:11:00.845836+0000","last_active":"2024-09-21T09:13:33.287538+0000","last_peered":"2024-09-21T09:13:33.287538+0000","last_clean":"2024-09-21T09:13:33.287538+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:13:33.287538+0000","last_undegraded":"2024-09-21T09:13:33.287538+0000","last_fullsized":"2024-09-21T09:13:33.287538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:06.353993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":144,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285940+0000","last_change":"2024-09-21T09:11:02.852500+0000","last_active":"2024-09-21T09:13:33.285940+0000","last_peered":"2024-09-21T09:13:33.285940+0000","last_clean":"2024-09-21T09:13:33.285940+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:13:33.285940+0000","last_undegraded":"2024-09-21T09:13:33.285940+0000","last_fullsized":"2024-09-21T09:13:33.285940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:19.073540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"71'101","reported_seq":327,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483341+0000","last_change":"2024-09-21T09:11:04.895087+0000","last_active":"2024-09-21T09:13:34.483341+0000","last_peered":"2024-09-21T09:13:34.483341+0000","last_clean":"2024-09-21T09:13:34.483341+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:13:34.483341+0000","last_undegraded":"2024-09-21T09:13:34.483341+0000","last_fullsized":"2024-09-21T09:13:34.483341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:11.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295621+0000","last_change":"2024-09-21T09:13:19.162437+0000","last_active":"2024-09-21T09:13:34.295621+0000","last_peered":"2024-09-21T09:13:34.295621+0000","last_clean":"2024-09-21T09:13:34.295621+0000","last_became_active":"2024-09-21T09:13:19.161659+0000","last_became_peered":"2024-09-21T09:13:19.161659+0000","last_unstale":"2024-09-21T09:13:34.295621+0000","last_undegraded":"2024-09-21T09:13:34.295621+0000","last_fullsized":"2024-09-21T09:13:34.295621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:59.822101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958090+0000","last_change":"2024-09-21T09:10:58.837602+0000","last_active":"2024-09-21T09:13:34.958090+0000","last_peered":"2024-09-21T09:13:34.958090+0000","last_clean":"2024-09-21T09:13:34.958090+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:13:34.958090+0000","last_undegraded":"2024-09-21T09:13:34.958090+0000","last_fullsized":"2024-09-21T09:13:34.958090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:36.269116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"67'17","reported_seq":155,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292857+0000","last_change":"2024-09-21T09:10:56.844292+0000","last_active":"2024-09-21T09:13:33.292857+0000","last_peered":"2024-09-21T09:13:33.292857+0000","last_clean":"2024-09-21T09:13:33.292857+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:13:33.292857+0000","last_undegraded":"2024-09-21T09:13:33.292857+0000","last_fullsized":"2024-09-21T09:13:33.292857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482929+0000","last_change":"2024-09-21T09:11:00.852984+0000","last_active":"2024-09-21T09:13:34.482929+0000","last_peered":"2024-09-21T09:13:34.482929+0000","last_clean":"2024-09-21T09:13:34.482929+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:13:34.482929+0000","last_undegraded":"2024-09-21T09:13:34.482929+0000","last_fullsized":"2024-09-21T09:13:34.482929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:33.175145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"71'15","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299712+0000","last_change":"2024-09-21T09:13:19.543924+0000","last_active":"2024-09-21T09:13:34.299712+0000","last_peered":"2024-09-21T09:13:34.299712+0000","last_clean":"2024-09-21T09:13:34.299712+0000","last_became_active":"2024-09-21T09:13:19.160798+0000","last_became_peered":"2024-09-21T09:13:19.160798+0000","last_unstale":"2024-09-21T09:13:34.299712+0000","last_undegraded":"2024-09-21T09:13:34.299712+0000","last_fullsized":"2024-09-21T09:13:34.299712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"71'101","reported_seq":301,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956966+0000","last_change":"2024-09-21T09:11:04.894947+0000","last_active":"2024-09-21T09:13:34.956966+0000","last_peered":"2024-09-21T09:13:34.956966+0000","last_clean":"2024-09-21T09:13:34.956966+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:13:34.956966+0000","last_undegraded":"2024-09-21T09:13:34.956966+0000","last_fullsized":"2024-09-21T09:13:34.956966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:21.481386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482063+0000","last_change":"2024-09-21T09:10:58.841384+0000","last_active":"2024-09-21T09:13:34.482063+0000","last_peered":"2024-09-21T09:13:34.482063+0000","last_clean":"2024-09-21T09:13:34.482063+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:13:34.482063+0000","last_undegraded":"2024-09-21T09:13:34.482063+0000","last_fullsized":"2024-09-21T09:13:34.482063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:08.308265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"67'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299480+0000","last_change":"2024-09-21T09:10:56.846710+0000","last_active":"2024-09-21T09:13:34.299480+0000","last_peered":"2024-09-21T09:13:34.299480+0000","last_clean":"2024-09-21T09:13:34.299480+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:13:34.299480+0000","last_undegraded":"2024-09-21T09:13:34.299480+0000","last_fullsized":"2024-09-21T09:13:34.299480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":130,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.290582+0000","last_change":"2024-09-21T09:11:00.839560+0000","last_active":"2024-09-21T09:13:33.290582+0000","last_peered":"2024-09-21T09:13:33.290582+0000","last_clean":"2024-09-21T09:13:33.290582+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:13:33.290582+0000","last_undegraded":"2024-09-21T09:13:33.290582+0000","last_fullsized":"2024-09-21T09:13:33.290582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:41.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"71'26","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295964+0000","last_change":"2024-09-21T09:11:02.872323+0000","last_active":"2024-09-21T09:13:34.295964+0000","last_peered":"2024-09-21T09:13:34.295964+0000","last_clean":"2024-09-21T09:13:34.295964+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:13:34.295964+0000","last_undegraded":"2024-09-21T09:13:34.295964+0000","last_fullsized":"2024-09-21T09:13:34.295964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294211+0000","last_change":"2024-09-21T09:13:19.150862+0000","last_active":"2024-09-21T09:13:34.294211+0000","last_peered":"2024-09-21T09:13:34.294211+0000","last_clean":"2024-09-21T09:13:34.294211+0000","last_became_active":"2024-09-21T09:13:19.149936+0000","last_became_peered":"2024-09-21T09:13:19.149936+0000","last_unstale":"2024-09-21T09:13:34.294211+0000","last_undegraded":"2024-09-21T09:13:34.294211+0000","last_fullsized":"2024-09-21T09:13:34.294211+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.535171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"62'12","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298350+0000","last_change":"2024-09-21T09:13:20.340381+0000","last_active":"2024-09-21T09:13:34.298350+0000","last_peered":"2024-09-21T09:13:34.298350+0000","last_clean":"2024-09-21T09:13:34.298350+0000","last_became_active":"2024-09-21T09:13:19.165108+0000","last_became_peered":"2024-09-21T09:13:19.165108+0000","last_unstale":"2024-09-21T09:13:34.298350+0000","last_undegraded":"2024-09-21T09:13:34.298350+0000","last_fullsized":"2024-09-21T09:13:34.298350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:41.830217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.294230+0000","last_change":"2024-09-21T09:10:58.839960+0000","last_active":"2024-09-21T09:13:33.294230+0000","last_peered":"2024-09-21T09:13:33.294230+0000","last_clean":"2024-09-21T09:13:33.294230+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:13:33.294230+0000","last_undegraded":"2024-09-21T09:13:33.294230+0000","last_fullsized":"2024-09-21T09:13:33.294230+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"67'7","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298110+0000","last_change":"2024-09-21T09:13:20.333955+0000","last_active":"2024-09-21T09:13:34.298110+0000","last_peered":"2024-09-21T09:13:34.298110+0000","last_clean":"2024-09-21T09:13:34.298110+0000","last_became_active":"2024-09-21T09:13:19.162605+0000","last_became_peered":"2024-09-21T09:13:19.162605+0000","last_unstale":"2024-09-21T09:13:34.298110+0000","last_undegraded":"2024-09-21T09:13:34.298110+0000","last_fullsized":"2024-09-21T09:13:34.298110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:21.030407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293432+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.293432+0000","last_peered":"2024-09-21T09:13:34.293432+0000","last_clean":"2024-09-21T09:13:34.293432+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:13:34.293432+0000","last_undegraded":"2024-09-21T09:13:34.293432+0000","last_fullsized":"2024-09-21T09:13:34.293432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:48.669684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"71'16","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285608+0000","last_change":"2024-09-21T09:11:02.866165+0000","last_active":"2024-09-21T09:13:33.285608+0000","last_peered":"2024-09-21T09:13:33.285608+0000","last_clean":"2024-09-21T09:13:33.285608+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:13:33.285608+0000","last_undegraded":"2024-09-21T09:13:33.285608+0000","last_fullsized":"2024-09-21T09:13:33.285608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:54:48.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285336+0000","last_change":"2024-09-21T09:11:04.871999+0000","last_active":"2024-09-21T09:13:33.285336+0000","last_peered":"2024-09-21T09:13:33.285336+0000","last_clean":"2024-09-21T09:13:33.285336+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:13:33.285336+0000","last_undegraded":"2024-09-21T09:13:33.285336+0000","last_fullsized":"2024-09-21T09:13:33.285336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:03.218684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"58'2","reported_seq":138,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291130+0000","last_change":"2024-09-21T09:13:19.709890+0000","last_active":"2024-09-21T09:13:33.291130+0000","last_peered":"2024-09-21T09:13:33.291130+0000","last_clean":"2024-09-21T09:13:33.291130+0000","last_became_active":"2024-09-21T09:13:19.167145+0000","last_became_peered":"2024-09-21T09:13:19.167145+0000","last_unstale":"2024-09-21T09:13:33.291130+0000","last_undegraded":"2024-09-21T09:13:33.291130+0000","last_fullsized":"2024-09-21T09:13:33.291130+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294491+0000","last_change":"2024-09-21T09:13:19.528866+0000","last_active":"2024-09-21T09:13:34.294491+0000","last_peered":"2024-09-21T09:13:34.294491+0000","last_clean":"2024-09-21T09:13:34.294491+0000","last_became_active":"2024-09-21T09:13:19.158113+0000","last_became_peered":"2024-09-21T09:13:19.158113+0000","last_unstale":"2024-09-21T09:13:34.294491+0000","last_undegraded":"2024-09-21T09:13:34.294491+0000","last_fullsized":"2024-09-21T09:13:34.294491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:48.503141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"66'18","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482839+0000","last_change":"2024-09-21T09:10:56.842697+0000","last_active":"2024-09-21T09:13:34.482839+0000","last_peered":"2024-09-21T09:13:34.482839+0000","last_clean":"2024-09-21T09:13:34.482839+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:13:34.482839+0000","last_undegraded":"2024-09-21T09:13:34.482839+0000","last_fullsized":"2024-09-21T09:13:34.482839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:42.311166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957018+0000","last_change":"2024-09-21T09:11:00.852970+0000","last_active":"2024-09-21T09:13:34.957018+0000","last_peered":"2024-09-21T09:13:34.957018+0000","last_clean":"2024-09-21T09:13:34.957018+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:13:34.957018+0000","last_undegraded":"2024-09-21T09:13:34.957018+0000","last_fullsized":"2024-09-21T09:13:34.957018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:35.201984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"71'21","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481917+0000","last_change":"2024-09-21T09:11:02.859081+0000","last_active":"2024-09-21T09:13:34.481917+0000","last_peered":"2024-09-21T09:13:34.481917+0000","last_clean":"2024-09-21T09:13:34.481917+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:13:34.481917+0000","last_undegraded":"2024-09-21T09:13:34.481917+0000","last_fullsized":"2024-09-21T09:13:34.481917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:19.576627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"71'101","reported_seq":256,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955287+0000","last_change":"2024-09-21T09:11:04.895980+0000","last_active":"2024-09-21T09:13:34.955287+0000","last_peered":"2024-09-21T09:13:34.955287+0000","last_clean":"2024-09-21T09:13:34.955287+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:13:34.955287+0000","last_undegraded":"2024-09-21T09:13:34.955287+0000","last_fullsized":"2024-09-21T09:13:34.955287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:57.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295156+0000","last_change":"2024-09-21T09:13:20.635132+0000","last_active":"2024-09-21T09:13:34.295156+0000","last_peered":"2024-09-21T09:13:34.295156+0000","last_clean":"2024-09-21T09:13:34.295156+0000","last_became_active":"2024-09-21T09:13:19.159646+0000","last_became_peered":"2024-09-21T09:13:19.159646+0000","last_unstale":"2024-09-21T09:13:34.295156+0000","last_undegraded":"2024-09-21T09:13:34.295156+0000","last_fullsized":"2024-09-21T09:13:34.295156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:10.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956296+0000","last_change":"2024-09-21T09:10:58.871951+0000","last_active":"2024-09-21T09:13:34.956296+0000","last_peered":"2024-09-21T09:13:34.956296+0000","last_clean":"2024-09-21T09:13:34.956296+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:13:34.956296+0000","last_undegraded":"2024-09-21T09:13:34.956296+0000","last_fullsized":"2024-09-21T09:13:34.956296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:16.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"66'7","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297543+0000","last_change":"2024-09-21T09:10:56.855073+0000","last_active":"2024-09-21T09:13:34.297543+0000","last_peered":"2024-09-21T09:13:34.297543+0000","last_clean":"2024-09-21T09:13:34.297543+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:13:34.297543+0000","last_undegraded":"2024-09-21T09:13:34.297543+0000","last_fullsized":"2024-09-21T09:13:34.297543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:43.818365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294089+0000","last_change":"2024-09-21T09:11:00.845552+0000","last_active":"2024-09-21T09:13:34.294089+0000","last_peered":"2024-09-21T09:13:34.294089+0000","last_clean":"2024-09-21T09:13:34.294089+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:13:34.294089+0000","last_undegraded":"2024-09-21T09:13:34.294089+0000","last_fullsized":"2024-09-21T09:13:34.294089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:44.841947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"71'24","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.284864+0000","last_change":"2024-09-21T09:11:02.868260+0000","last_active":"2024-09-21T09:13:33.284864+0000","last_peered":"2024-09-21T09:13:33.284864+0000","last_clean":"2024-09-21T09:13:33.284864+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:13:33.284864+0000","last_undegraded":"2024-09-21T09:13:33.284864+0000","last_fullsized":"2024-09-21T09:13:33.284864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:38.299285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955882+0000","last_change":"2024-09-21T09:11:04.890815+0000","last_active":"2024-09-21T09:13:34.955882+0000","last_peered":"2024-09-21T09:13:34.955882+0000","last_clean":"2024-09-21T09:13:34.955882+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:13:34.955882+0000","last_undegraded":"2024-09-21T09:13:34.955882+0000","last_fullsized":"2024-09-21T09:13:34.955882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:26.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527522+0000","last_change":"2024-09-21T09:11:06.888148+0000","last_active":"2024-09-21T09:13:34.527522+0000","last_peered":"2024-09-21T09:13:34.527522+0000","last_clean":"2024-09-21T09:13:34.527522+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:13:34.527522+0000","last_undegraded":"2024-09-21T09:13:34.527522+0000","last_fullsized":"2024-09-21T09:13:34.527522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296971+0000","last_change":"2024-09-21T09:10:58.871840+0000","last_active":"2024-09-21T09:13:34.296971+0000","last_peered":"2024-09-21T09:13:34.296971+0000","last_clean":"2024-09-21T09:13:34.296971+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:13:34.296971+0000","last_undegraded":"2024-09-21T09:13:34.296971+0000","last_fullsized":"2024-09-21T09:13:34.296971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"67'7","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526772+0000","last_change":"2024-09-21T09:10:56.855886+0000","last_active":"2024-09-21T09:13:34.526772+0000","last_peered":"2024-09-21T09:13:34.526772+0000","last_clean":"2024-09-21T09:13:34.526772+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:13:34.526772+0000","last_undegraded":"2024-09-21T09:13:34.526772+0000","last_fullsized":"2024-09-21T09:13:34.526772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526968+0000","last_change":"2024-09-21T09:11:00.850308+0000","last_active":"2024-09-21T09:13:34.526968+0000","last_peered":"2024-09-21T09:13:34.526968+0000","last_clean":"2024-09-21T09:13:34.526968+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:13:34.526968+0000","last_undegraded":"2024-09-21T09:13:34.526968+0000","last_fullsized":"2024-09-21T09:13:34.526968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:13.608546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"71'17","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293192+0000","last_change":"2024-09-21T09:11:02.866122+0000","last_active":"2024-09-21T09:13:33.293192+0000","last_peered":"2024-09-21T09:13:33.293192+0000","last_clean":"2024-09-21T09:13:33.293192+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:13:33.293192+0000","last_undegraded":"2024-09-21T09:13:33.293192+0000","last_fullsized":"2024-09-21T09:13:33.293192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527462+0000","last_change":"2024-09-21T09:11:04.880608+0000","last_active":"2024-09-21T09:13:34.527462+0000","last_peered":"2024-09-21T09:13:34.527462+0000","last_clean":"2024-09-21T09:13:34.527462+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:13:34.527462+0000","last_undegraded":"2024-09-21T09:13:34.527462+0000","last_fullsized":"2024-09-21T09:13:34.527462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:39.226968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955061+0000","last_change":"2024-09-21T09:11:06.892201+0000","last_active":"2024-09-21T09:13:34.955061+0000","last_peered":"2024-09-21T09:13:34.955061+0000","last_clean":"2024-09-21T09:13:34.955061+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:13:34.955061+0000","last_undegraded":"2024-09-21T09:13:34.955061+0000","last_fullsized":"2024-09-21T09:13:34.955061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:32.463353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483248+0000","last_change":"2024-09-21T09:10:58.838223+0000","last_active":"2024-09-21T09:13:34.483248+0000","last_peered":"2024-09-21T09:13:34.483248+0000","last_clean":"2024-09-21T09:13:34.483248+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:13:34.483248+0000","last_undegraded":"2024-09-21T09:13:34.483248+0000","last_fullsized":"2024-09-21T09:13:34.483248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:01.253234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"67'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482527+0000","last_change":"2024-09-21T09:10:56.841106+0000","last_active":"2024-09-21T09:13:34.482527+0000","last_peered":"2024-09-21T09:13:34.482527+0000","last_clean":"2024-09-21T09:13:34.482527+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:13:34.482527+0000","last_undegraded":"2024-09-21T09:13:34.482527+0000","last_fullsized":"2024-09-21T09:13:34.482527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:40.827746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956508+0000","last_change":"2024-09-21T09:11:00.841164+0000","last_active":"2024-09-21T09:13:34.956508+0000","last_peered":"2024-09-21T09:13:34.956508+0000","last_clean":"2024-09-21T09:13:34.956508+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:13:34.956508+0000","last_undegraded":"2024-09-21T09:13:34.956508+0000","last_fullsized":"2024-09-21T09:13:34.956508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:05.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"71'23","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957641+0000","last_change":"2024-09-21T09:11:02.852292+0000","last_active":"2024-09-21T09:13:34.957641+0000","last_peered":"2024-09-21T09:13:34.957641+0000","last_clean":"2024-09-21T09:13:34.957641+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:13:34.957641+0000","last_undegraded":"2024-09-21T09:13:34.957641+0000","last_fullsized":"2024-09-21T09:13:34.957641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:12.322229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"71'101","reported_seq":295,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527407+0000","last_change":"2024-09-21T09:11:04.892391+0000","last_active":"2024-09-21T09:13:34.527407+0000","last_peered":"2024-09-21T09:13:34.527407+0000","last_clean":"2024-09-21T09:13:34.527407+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:13:34.527407+0000","last_undegraded":"2024-09-21T09:13:34.527407+0000","last_fullsized":"2024-09-21T09:13:34.527407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:52.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293567+0000","last_change":"2024-09-21T09:11:06.883898+0000","last_active":"2024-09-21T09:13:34.293567+0000","last_peered":"2024-09-21T09:13:34.293567+0000","last_clean":"2024-09-21T09:13:34.293567+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:13:34.293567+0000","last_undegraded":"2024-09-21T09:13:34.293567+0000","last_fullsized":"2024-09-21T09:13:34.293567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298809+0000","last_change":"2024-09-21T09:13:20.217794+0000","last_active":"2024-09-21T09:13:34.298809+0000","last_peered":"2024-09-21T09:13:34.298809+0000","last_clean":"2024-09-21T09:13:34.298809+0000","last_became_active":"2024-09-21T09:13:19.161819+0000","last_became_peered":"2024-09-21T09:13:19.161819+0000","last_unstale":"2024-09-21T09:13:34.298809+0000","last_undegraded":"2024-09-21T09:13:34.298809+0000","last_fullsized":"2024-09-21T09:13:34.298809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:41.176970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"67'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482438+0000","last_change":"2024-09-21T09:10:56.844590+0000","last_active":"2024-09-21T09:13:34.482438+0000","last_peered":"2024-09-21T09:13:34.482438+0000","last_clean":"2024-09-21T09:13:34.482438+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:13:34.482438+0000","last_undegraded":"2024-09-21T09:13:34.482438+0000","last_fullsized":"2024-09-21T09:13:34.482438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:20.839825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":266,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.290719+0000","last_change":"2024-09-21T09:11:00.839056+0000","last_active":"2024-09-21T09:13:33.290719+0000","last_peered":"2024-09-21T09:13:33.290719+0000","last_clean":"2024-09-21T09:13:33.290719+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:13:33.290719+0000","last_undegraded":"2024-09-21T09:13:33.290719+0000","last_fullsized":"2024-09-21T09:13:33.290719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:07.991734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"65'11","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294566+0000","last_change":"2024-09-21T09:11:02.876439+0000","last_active":"2024-09-21T09:13:34.294566+0000","last_peered":"2024-09-21T09:13:34.294566+0000","last_clean":"2024-09-21T09:13:34.294566+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:13:34.294566+0000","last_undegraded":"2024-09-21T09:13:34.294566+0000","last_fullsized":"2024-09-21T09:13:34.294566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"71'101","reported_seq":307,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292393+0000","last_change":"2024-09-21T09:11:04.884790+0000","last_active":"2024-09-21T09:13:33.292393+0000","last_peered":"2024-09-21T09:13:33.292393+0000","last_clean":"2024-09-21T09:13:33.292393+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:13:33.292393+0000","last_undegraded":"2024-09-21T09:13:33.292393+0000","last_fullsized":"2024-09-21T09:13:33.292393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:00.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294059+0000","last_change":"2024-09-21T09:13:19.158996+0000","last_active":"2024-09-21T09:13:34.294059+0000","last_peered":"2024-09-21T09:13:34.294059+0000","last_clean":"2024-09-21T09:13:34.294059+0000","last_became_active":"2024-09-21T09:13:19.139533+0000","last_became_peered":"2024-09-21T09:13:19.139533+0000","last_unstale":"2024-09-21T09:13:34.294059+0000","last_undegraded":"2024-09-21T09:13:34.294059+0000","last_fullsized":"2024-09-21T09:13:34.294059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:03.695046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527899+0000","last_change":"2024-09-21T09:10:58.873730+0000","last_active":"2024-09-21T09:13:34.527899+0000","last_peered":"2024-09-21T09:13:34.527899+0000","last_clean":"2024-09-21T09:13:34.527899+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:13:34.527899+0000","last_undegraded":"2024-09-21T09:13:34.527899+0000","last_fullsized":"2024-09-21T09:13:34.527899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"67'2","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286334+0000","last_change":"2024-09-21T09:10:56.849104+0000","last_active":"2024-09-21T09:13:33.286334+0000","last_peered":"2024-09-21T09:13:33.286334+0000","last_clean":"2024-09-21T09:13:33.286334+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:13:33.286334+0000","last_undegraded":"2024-09-21T09:13:33.286334+0000","last_fullsized":"2024-09-21T09:13:33.286334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:34.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483039+0000","last_change":"2024-09-21T09:11:00.841893+0000","last_active":"2024-09-21T09:13:34.483039+0000","last_peered":"2024-09-21T09:13:34.483039+0000","last_clean":"2024-09-21T09:13:34.483039+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:13:34.483039+0000","last_undegraded":"2024-09-21T09:13:34.483039+0000","last_fullsized":"2024-09-21T09:13:34.483039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:55.253483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"71'23","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291929+0000","last_change":"2024-09-21T09:11:02.867833+0000","last_active":"2024-09-21T09:13:33.291929+0000","last_peered":"2024-09-21T09:13:33.291929+0000","last_clean":"2024-09-21T09:13:33.291929+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:13:33.291929+0000","last_undegraded":"2024-09-21T09:13:33.291929+0000","last_fullsized":"2024-09-21T09:13:33.291929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298750+0000","last_change":"2024-09-21T09:13:19.166139+0000","last_active":"2024-09-21T09:13:34.298750+0000","last_peered":"2024-09-21T09:13:34.298750+0000","last_clean":"2024-09-21T09:13:34.298750+0000","last_became_active":"2024-09-21T09:13:19.164969+0000","last_became_peered":"2024-09-21T09:13:19.164969+0000","last_unstale":"2024-09-21T09:13:34.298750+0000","last_undegraded":"2024-09-21T09:13:34.298750+0000","last_fullsized":"2024-09-21T09:13:34.298750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:05.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"62'12","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526114+0000","last_change":"2024-09-21T09:11:06.883751+0000","last_active":"2024-09-21T09:13:34.526114+0000","last_peered":"2024-09-21T09:13:34.526114+0000","last_clean":"2024-09-21T09:13:34.526114+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:13:34.526114+0000","last_undegraded":"2024-09-21T09:13:34.526114+0000","last_fullsized":"2024-09-21T09:13:34.526114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:09.296705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482855+0000","last_change":"2024-09-21T09:10:58.838888+0000","last_active":"2024-09-21T09:13:34.482855+0000","last_peered":"2024-09-21T09:13:34.482855+0000","last_clean":"2024-09-21T09:13:34.482855+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:13:34.482855+0000","last_undegraded":"2024-09-21T09:13:34.482855+0000","last_fullsized":"2024-09-21T09:13:34.482855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:53.547541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":302,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293123+0000","last_change":"2024-09-21T09:10:44.726458+0000","last_active":"2024-09-21T09:13:33.293123+0000","last_peered":"2024-09-21T09:13:33.293123+0000","last_clean":"2024-09-21T09:13:33.293123+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:13:33.293123+0000","last_undegraded":"2024-09-21T09:13:33.293123+0000","last_fullsized":"2024-09-21T09:13:33.293123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_clean_scrub_stamp":"2024-09-21T09:10:43.702491+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:07.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482574+0000","last_change":"2024-09-21T09:13:20.381044+0000","last_active":"2024-09-21T09:13:34.482574+0000","last_peered":"2024-09-21T09:13:34.482574+0000","last_clean":"2024-09-21T09:13:34.482574+0000","last_became_active":"2024-09-21T09:13:19.155065+0000","last_became_peered":"2024-09-21T09:13:19.155065+0000","last_unstale":"2024-09-21T09:13:34.482574+0000","last_undegraded":"2024-09-21T09:13:34.482574+0000","last_fullsized":"2024-09-21T09:13:34.482574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:51.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":202,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286594+0000","last_change":"2024-09-21T09:13:19.483993+0000","last_active":"2024-09-21T09:13:33.286594+0000","last_peered":"2024-09-21T09:13:33.286594+0000","last_clean":"2024-09-21T09:13:33.286594+0000","last_became_active":"2024-09-21T09:13:19.152677+0000","last_became_peered":"2024-09-21T09:13:19.152677+0000","last_unstale":"2024-09-21T09:13:33.286594+0000","last_undegraded":"2024-09-21T09:13:33.286594+0000","last_fullsized":"2024-09-21T09:13:33.286594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:26.411630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:11:00.845448+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"71'33","reported_seq":175,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483133+0000","last_change":"2024-09-21T09:11:02.863275+0000","last_active":"2024-09-21T09:13:34.483133+0000","last_peered":"2024-09-21T09:13:34.483133+0000","last_clean":"2024-09-21T09:13:34.483133+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:13:34.483133+0000","last_undegraded":"2024-09-21T09:13:34.483133+0000","last_fullsized":"2024-09-21T09:13:34.483133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:39.968749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4873,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957584+0000","last_change":"2024-09-21T09:11:04.894538+0000","last_active":"2024-09-21T09:13:34.957584+0000","last_peered":"2024-09-21T09:13:34.957584+0000","last_clean":"2024-09-21T09:13:34.957584+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:13:34.957584+0000","last_undegraded":"2024-09-21T09:13:34.957584+0000","last_fullsized":"2024-09-21T09:13:34.957584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.154030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"71'6","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294223+0000","last_change":"2024-09-21T09:13:19.487021+0000","last_active":"2024-09-21T09:13:34.294223+0000","last_peered":"2024-09-21T09:13:34.294223+0000","last_clean":"2024-09-21T09:13:34.294223+0000","last_became_active":"2024-09-21T09:13:19.153438+0000","last_became_peered":"2024-09-21T09:13:19.153438+0000","last_unstale":"2024-09-21T09:13:34.294223+0000","last_undegraded":"2024-09-21T09:13:34.294223+0000","last_fullsized":"2024-09-21T09:13:34.294223+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:22.759172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":422,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957786+0000","last_change":"2024-09-21T09:10:58.855489+0000","last_active":"2024-09-21T09:13:34.957786+0000","last_peered":"2024-09-21T09:13:34.957786+0000","last_clean":"2024-09-21T09:13:34.957786+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:13:34.957786+0000","last_undegraded":"2024-09-21T09:13:34.957786+0000","last_fullsized":"2024-09-21T09:13:34.957786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:04.859633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482280+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:13:34.482280+0000","last_peered":"2024-09-21T09:13:34.482280+0000","last_clean":"2024-09-21T09:13:34.482280+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:13:34.482280+0000","last_undegraded":"2024-09-21T09:13:34.482280+0000","last_fullsized":"2024-09-21T09:13:34.482280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:09.405380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"66'7","reported_seq":188,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294349+0000","last_change":"2024-09-21T09:13:19.304956+0000","last_active":"2024-09-21T09:13:34.294349+0000","last_peered":"2024-09-21T09:13:34.294349+0000","last_clean":"2024-09-21T09:13:34.294349+0000","last_became_active":"2024-09-21T09:13:19.142666+0000","last_became_peered":"2024-09-21T09:13:19.142666+0000","last_unstale":"2024-09-21T09:13:34.294349+0000","last_undegraded":"2024-09-21T09:13:34.294349+0000","last_fullsized":"2024-09-21T09:13:34.294349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:08.103741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483007+0000","last_change":"2024-09-21T09:11:00.845917+0000","last_active":"2024-09-21T09:13:34.483007+0000","last_peered":"2024-09-21T09:13:34.483007+0000","last_clean":"2024-09-21T09:13:34.483007+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:13:34.483007+0000","last_undegraded":"2024-09-21T09:13:34.483007+0000","last_fullsized":"2024-09-21T09:13:34.483007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:59.152254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"71'108","reported_seq":318,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526731+0000","last_change":"2024-09-21T09:11:02.871422+0000","last_active":"2024-09-21T09:13:34.526731+0000","last_peered":"2024-09-21T09:13:34.526731+0000","last_clean":"2024-09-21T09:13:34.526731+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:13:34.526731+0000","last_undegraded":"2024-09-21T09:13:34.526731+0000","last_fullsized":"2024-09-21T09:13:34.526731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:57.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61997,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":28,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483210+0000","last_change":"2024-09-21T09:11:04.893734+0000","last_active":"2024-09-21T09:13:34.483210+0000","last_peered":"2024-09-21T09:13:34.483210+0000","last_clean":"2024-09-21T09:13:34.483210+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:34.483210+0000","last_undegraded":"2024-09-21T09:13:34.483210+0000","last_fullsized":"2024-09-21T09:13:34.483210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.709917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"58'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955754+0000","last_change":"2024-09-21T09:11:06.895362+0000","last_active":"2024-09-21T09:13:34.955754+0000","last_peered":"2024-09-21T09:13:34.955754+0000","last_clean":"2024-09-21T09:13:34.955754+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:13:34.955754+0000","last_undegraded":"2024-09-21T09:13:34.955754+0000","last_fullsized":"2024-09-21T09:13:34.955754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:23.606134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:10:58.831552+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526089+0000","last_change":"2024-09-21T09:10:51.587265+0000","last_active":"2024-09-21T09:13:34.526089+0000","last_peered":"2024-09-21T09:13:34.526089+0000","last_clean":"2024-09-21T09:13:34.526089+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:13:34.526089+0000","last_undegraded":"2024-09-21T09:13:34.526089+0000","last_fullsized":"2024-09-21T09:13:34.526089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"66'11","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955635+0000","last_change":"2024-09-21T09:10:56.866005+0000","last_active":"2024-09-21T09:13:34.955635+0000","last_peered":"2024-09-21T09:13:34.955635+0000","last_clean":"2024-09-21T09:13:34.955635+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:13:34.955635+0000","last_undegraded":"2024-09-21T09:13:34.955635+0000","last_fullsized":"2024-09-21T09:13:34.955635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527710+0000","last_change":"2024-09-21T09:11:00.850206+0000","last_active":"2024-09-21T09:13:34.527710+0000","last_peered":"2024-09-21T09:13:34.527710+0000","last_clean":"2024-09-21T09:13:34.527710+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:13:34.527710+0000","last_undegraded":"2024-09-21T09:13:34.527710+0000","last_fullsized":"2024-09-21T09:13:34.527710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:26.137691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297661+0000","last_change":"2024-09-21T09:11:02.873117+0000","last_active":"2024-09-21T09:13:34.297661+0000","last_peered":"2024-09-21T09:13:34.297661+0000","last_clean":"2024-09-21T09:13:34.297661+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:13:34.297661+0000","last_undegraded":"2024-09-21T09:13:34.297661+0000","last_fullsized":"2024-09-21T09:13:34.297661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286345+0000","last_change":"2024-09-21T09:11:04.873369+0000","last_active":"2024-09-21T09:13:33.286345+0000","last_peered":"2024-09-21T09:13:33.286345+0000","last_clean":"2024-09-21T09:13:33.286345+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:13:33.286345+0000","last_undegraded":"2024-09-21T09:13:33.286345+0000","last_fullsized":"2024-09-21T09:13:33.286345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.868816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285253+0000","last_change":"2024-09-21T09:11:06.896298+0000","last_active":"2024-09-21T09:13:33.285253+0000","last_peered":"2024-09-21T09:13:33.285253+0000","last_clean":"2024-09-21T09:13:33.285253+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:13:33.285253+0000","last_undegraded":"2024-09-21T09:13:33.285253+0000","last_fullsized":"2024-09-21T09:13:33.285253+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:42.784843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"58'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:58.838558+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482642+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:13:34.482642+0000","last_peered":"2024-09-21T09:13:34.482642+0000","last_clean":"2024-09-21T09:13:34.482642+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:13:34.482642+0000","last_undegraded":"2024-09-21T09:13:34.482642+0000","last_fullsized":"2024-09-21T09:13:34.482642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:07.894252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"66'7","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296736+0000","last_change":"2024-09-21T09:13:20.378657+0000","last_active":"2024-09-21T09:13:34.296736+0000","last_peered":"2024-09-21T09:13:34.296736+0000","last_clean":"2024-09-21T09:13:34.296736+0000","last_became_active":"2024-09-21T09:13:19.153710+0000","last_became_peered":"2024-09-21T09:13:19.153710+0000","last_unstale":"2024-09-21T09:13:34.296736+0000","last_undegraded":"2024-09-21T09:13:34.296736+0000","last_fullsized":"2024-09-21T09:13:34.296736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526975+0000","last_change":"2024-09-21T09:11:00.852944+0000","last_active":"2024-09-21T09:13:34.526975+0000","last_peered":"2024-09-21T09:13:34.526975+0000","last_clean":"2024-09-21T09:13:34.526975+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:13:34.526975+0000","last_undegraded":"2024-09-21T09:13:34.526975+0000","last_fullsized":"2024-09-21T09:13:34.526975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:24.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.954874+0000","last_change":"2024-09-21T09:11:02.856485+0000","last_active":"2024-09-21T09:13:34.954874+0000","last_peered":"2024-09-21T09:13:34.954874+0000","last_clean":"2024-09-21T09:13:34.954874+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:13:34.954874+0000","last_undegraded":"2024-09-21T09:13:34.954874+0000","last_fullsized":"2024-09-21T09:13:34.954874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:05.267197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483296+0000","last_change":"2024-09-21T09:11:04.880602+0000","last_active":"2024-09-21T09:13:34.483296+0000","last_peered":"2024-09-21T09:13:34.483296+0000","last_clean":"2024-09-21T09:13:34.483296+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:13:34.483296+0000","last_undegraded":"2024-09-21T09:13:34.483296+0000","last_fullsized":"2024-09-21T09:13:34.483296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:56.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"62'4","reported_seq":123,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.290729+0000","last_change":"2024-09-21T09:11:06.869065+0000","last_active":"2024-09-21T09:13:33.290729+0000","last_peered":"2024-09-21T09:13:33.290729+0000","last_clean":"2024-09-21T09:13:33.290729+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:13:33.290729+0000","last_undegraded":"2024-09-21T09:13:33.290729+0000","last_fullsized":"2024-09-21T09:13:33.290729+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:28.667296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"71'12","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294295+0000","last_change":"2024-09-21T09:10:58.846835+0000","last_active":"2024-09-21T09:13:34.294295+0000","last_peered":"2024-09-21T09:13:34.294295+0000","last_clean":"2024-09-21T09:13:34.294295+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:13:34.294295+0000","last_undegraded":"2024-09-21T09:13:34.294295+0000","last_fullsized":"2024-09-21T09:13:34.294295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"66'10","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299651+0000","last_change":"2024-09-21T09:13:19.380704+0000","last_active":"2024-09-21T09:13:34.299651+0000","last_peered":"2024-09-21T09:13:34.299651+0000","last_clean":"2024-09-21T09:13:34.299651+0000","last_became_active":"2024-09-21T09:13:19.142534+0000","last_became_peered":"2024-09-21T09:13:19.142534+0000","last_unstale":"2024-09-21T09:13:34.299651+0000","last_undegraded":"2024-09-21T09:13:34.299651+0000","last_fullsized":"2024-09-21T09:13:34.299651+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957216+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:13:34.957216+0000","last_peered":"2024-09-21T09:13:34.957216+0000","last_clean":"2024-09-21T09:13:34.957216+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:13:34.957216+0000","last_undegraded":"2024-09-21T09:13:34.957216+0000","last_fullsized":"2024-09-21T09:13:34.957216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285944+0000","last_change":"2024-09-21T09:11:00.855241+0000","last_active":"2024-09-21T09:13:33.285944+0000","last_peered":"2024-09-21T09:13:33.285944+0000","last_clean":"2024-09-21T09:13:33.285944+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:13:33.285944+0000","last_undegraded":"2024-09-21T09:13:33.285944+0000","last_fullsized":"2024-09-21T09:13:33.285944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:56:14.401301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"71'30","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525679+0000","last_change":"2024-09-21T09:11:02.864623+0000","last_active":"2024-09-21T09:13:34.525679+0000","last_peered":"2024-09-21T09:13:34.525679+0000","last_clean":"2024-09-21T09:13:34.525679+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:13:34.525679+0000","last_undegraded":"2024-09-21T09:13:34.525679+0000","last_fullsized":"2024-09-21T09:13:34.525679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:12.141735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297500+0000","last_change":"2024-09-21T09:13:19.146039+0000","last_active":"2024-09-21T09:13:34.297500+0000","last_peered":"2024-09-21T09:13:34.297500+0000","last_clean":"2024-09-21T09:13:34.297500+0000","last_became_active":"2024-09-21T09:13:19.145677+0000","last_became_peered":"2024-09-21T09:13:19.145677+0000","last_unstale":"2024-09-21T09:13:34.297500+0000","last_undegraded":"2024-09-21T09:13:34.297500+0000","last_fullsized":"2024-09-21T09:13:34.297500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:04.909499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"62'4","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957412+0000","last_change":"2024-09-21T09:11:06.896833+0000","last_active":"2024-09-21T09:13:34.957412+0000","last_peered":"2024-09-21T09:13:34.957412+0000","last_clean":"2024-09-21T09:13:34.957412+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:13:34.957412+0000","last_undegraded":"2024-09-21T09:13:34.957412+0000","last_fullsized":"2024-09-21T09:13:34.957412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:38.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"61'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294846+0000","last_change":"2024-09-21T09:10:58.825808+0000","last_active":"2024-09-21T09:13:34.294846+0000","last_peered":"2024-09-21T09:13:34.294846+0000","last_clean":"2024-09-21T09:13:34.294846+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:13:34.294846+0000","last_undegraded":"2024-09-21T09:13:34.294846+0000","last_fullsized":"2024-09-21T09:13:34.294846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"67'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295613+0000","last_change":"2024-09-21T09:10:56.851643+0000","last_active":"2024-09-21T09:13:34.295613+0000","last_peered":"2024-09-21T09:13:34.295613+0000","last_clean":"2024-09-21T09:13:34.295613+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:13:34.295613+0000","last_undegraded":"2024-09-21T09:13:34.295613+0000","last_fullsized":"2024-09-21T09:13:34.295613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482740+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:13:34.482740+0000","last_peered":"2024-09-21T09:13:34.482740+0000","last_clean":"2024-09-21T09:13:34.482740+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:13:34.482740+0000","last_undegraded":"2024-09-21T09:13:34.482740+0000","last_fullsized":"2024-09-21T09:13:34.482740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:24.356684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295776+0000","last_change":"2024-09-21T09:11:00.847115+0000","last_active":"2024-09-21T09:13:34.295776+0000","last_peered":"2024-09-21T09:13:34.295776+0000","last_clean":"2024-09-21T09:13:34.295776+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:13:34.295776+0000","last_undegraded":"2024-09-21T09:13:34.295776+0000","last_fullsized":"2024-09-21T09:13:34.295776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:55.012417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293962+0000","last_change":"2024-09-21T09:11:02.862921+0000","last_active":"2024-09-21T09:13:34.293962+0000","last_peered":"2024-09-21T09:13:34.293962+0000","last_clean":"2024-09-21T09:13:34.293962+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:13:34.293962+0000","last_undegraded":"2024-09-21T09:13:34.293962+0000","last_fullsized":"2024-09-21T09:13:34.293962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"71'101","reported_seq":259,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291252+0000","last_change":"2024-09-21T09:11:04.894220+0000","last_active":"2024-09-21T09:13:33.291252+0000","last_peered":"2024-09-21T09:13:33.291252+0000","last_clean":"2024-09-21T09:13:33.291252+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:13:33.291252+0000","last_undegraded":"2024-09-21T09:13:33.291252+0000","last_fullsized":"2024-09-21T09:13:33.291252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:07.285264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527292+0000","last_change":"2024-09-21T09:11:06.881113+0000","last_active":"2024-09-21T09:13:34.527292+0000","last_peered":"2024-09-21T09:13:34.527292+0000","last_clean":"2024-09-21T09:13:34.527292+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:13:34.527292+0000","last_undegraded":"2024-09-21T09:13:34.527292+0000","last_fullsized":"2024-09-21T09:13:34.527292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285828+0000","last_change":"2024-09-21T09:10:58.868894+0000","last_active":"2024-09-21T09:13:33.285828+0000","last_peered":"2024-09-21T09:13:33.285828+0000","last_clean":"2024-09-21T09:13:33.285828+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:13:33.285828+0000","last_undegraded":"2024-09-21T09:13:33.285828+0000","last_fullsized":"2024-09-21T09:13:33.285828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:41.448227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"66'4","reported_seq":145,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.288030+0000","last_change":"2024-09-21T09:10:56.853201+0000","last_active":"2024-09-21T09:13:33.288030+0000","last_peered":"2024-09-21T09:13:33.288030+0000","last_clean":"2024-09-21T09:13:33.288030+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:13:33.288030+0000","last_undegraded":"2024-09-21T09:13:33.288030+0000","last_fullsized":"2024-09-21T09:13:33.288030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:58.587669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287949+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:13:33.287949+0000","last_peered":"2024-09-21T09:13:33.287949+0000","last_clean":"2024-09-21T09:13:33.287949+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:13:33.287949+0000","last_undegraded":"2024-09-21T09:13:33.287949+0000","last_fullsized":"2024-09-21T09:13:33.287949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:03.383843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:11:00.850095+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:17.456402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"62'11","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482326+0000","last_change":"2024-09-21T09:11:02.853229+0000","last_active":"2024-09-21T09:13:34.482326+0000","last_peered":"2024-09-21T09:13:34.482326+0000","last_clean":"2024-09-21T09:13:34.482326+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:13:34.482326+0000","last_undegraded":"2024-09-21T09:13:34.482326+0000","last_fullsized":"2024-09-21T09:13:34.482326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:25.468451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"79'105","reported_seq":285,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955898+0000","last_change":"2024-09-21T09:13:22.165756+0000","last_active":"2024-09-21T09:13:34.955898+0000","last_peered":"2024-09-21T09:13:34.955898+0000","last_clean":"2024-09-21T09:13:34.955898+0000","last_became_active":"2024-09-21T09:13:22.164964+0000","last_became_peered":"2024-09-21T09:13:22.164964+0000","last_unstale":"2024-09-21T09:13:34.955898+0000","last_undegraded":"2024-09-21T09:13:34.955898+0000","last_fullsized":"2024-09-21T09:13:34.955898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:18.044791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"62'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956097+0000","last_change":"2024-09-21T09:11:06.887900+0000","last_active":"2024-09-21T09:13:34.956097+0000","last_peered":"2024-09-21T09:13:34.956097+0000","last_clean":"2024-09-21T09:13:34.956097+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:13:34.956097+0000","last_undegraded":"2024-09-21T09:13:34.956097+0000","last_fullsized":"2024-09-21T09:13:34.956097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:03.433485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297268+0000","last_change":"2024-09-21T09:13:19.160539+0000","last_active":"2024-09-21T09:13:34.297268+0000","last_peered":"2024-09-21T09:13:34.297268+0000","last_clean":"2024-09-21T09:13:34.297268+0000","last_became_active":"2024-09-21T09:13:19.158513+0000","last_became_peered":"2024-09-21T09:13:19.158513+0000","last_unstale":"2024-09-21T09:13:34.297268+0000","last_undegraded":"2024-09-21T09:13:34.297268+0000","last_fullsized":"2024-09-21T09:13:34.297268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:56.953433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"66'6","reported_seq":147,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287792+0000","last_change":"2024-09-21T09:10:56.849803+0000","last_active":"2024-09-21T09:13:33.287792+0000","last_peered":"2024-09-21T09:13:33.287792+0000","last_clean":"2024-09-21T09:13:33.287792+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:13:33.287792+0000","last_undegraded":"2024-09-21T09:13:33.287792+0000","last_fullsized":"2024-09-21T09:13:33.287792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:47.709157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483413+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:13:34.483413+0000","last_peered":"2024-09-21T09:13:34.483413+0000","last_clean":"2024-09-21T09:13:34.483413+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:13:34.483413+0000","last_undegraded":"2024-09-21T09:13:34.483413+0000","last_fullsized":"2024-09-21T09:13:34.483413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:33.465317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285098+0000","last_change":"2024-09-21T09:13:19.154303+0000","last_active":"2024-09-21T09:13:33.285098+0000","last_peered":"2024-09-21T09:13:33.285098+0000","last_clean":"2024-09-21T09:13:33.285098+0000","last_became_active":"2024-09-21T09:13:19.152735+0000","last_became_peered":"2024-09-21T09:13:19.152735+0000","last_unstale":"2024-09-21T09:13:33.285098+0000","last_undegraded":"2024-09-21T09:13:33.285098+0000","last_fullsized":"2024-09-21T09:13:33.285098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:24.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"71'37","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295954+0000","last_change":"2024-09-21T09:11:02.856720+0000","last_active":"2024-09-21T09:13:34.295954+0000","last_peered":"2024-09-21T09:13:34.295954+0000","last_clean":"2024-09-21T09:13:34.295954+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:13:34.295954+0000","last_undegraded":"2024-09-21T09:13:34.295954+0000","last_fullsized":"2024-09-21T09:13:34.295954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286249+0000","last_change":"2024-09-21T09:11:04.872979+0000","last_active":"2024-09-21T09:13:33.286249+0000","last_peered":"2024-09-21T09:13:33.286249+0000","last_clean":"2024-09-21T09:13:33.286249+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:13:33.286249+0000","last_undegraded":"2024-09-21T09:13:33.286249+0000","last_fullsized":"2024-09-21T09:13:33.286249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:17.499450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"71'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299731+0000","last_change":"2024-09-21T09:13:19.169497+0000","last_active":"2024-09-21T09:13:34.299731+0000","last_peered":"2024-09-21T09:13:34.299731+0000","last_clean":"2024-09-21T09:13:34.299731+0000","last_became_active":"2024-09-21T09:13:19.140926+0000","last_became_peered":"2024-09-21T09:13:19.140926+0000","last_unstale":"2024-09-21T09:13:34.299731+0000","last_undegraded":"2024-09-21T09:13:34.299731+0000","last_fullsized":"2024-09-21T09:13:34.299731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:44.853024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":426,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287242+0000","last_change":"2024-09-21T09:11:06.900571+0000","last_active":"2024-09-21T09:13:33.287242+0000","last_peered":"2024-09-21T09:13:33.287242+0000","last_clean":"2024-09-21T09:13:33.287242+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:13:33.287242+0000","last_undegraded":"2024-09-21T09:13:33.287242+0000","last_fullsized":"2024-09-21T09:13:33.287242+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:40.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295838+0000","last_change":"2024-09-21T09:13:19.531538+0000","last_active":"2024-09-21T09:13:34.295838+0000","last_peered":"2024-09-21T09:13:34.295838+0000","last_clean":"2024-09-21T09:13:34.295838+0000","last_became_active":"2024-09-21T09:13:19.158305+0000","last_became_peered":"2024-09-21T09:13:19.158305+0000","last_unstale":"2024-09-21T09:13:34.295838+0000","last_undegraded":"2024-09-21T09:13:34.295838+0000","last_fullsized":"2024-09-21T09:13:34.295838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:10.110896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"66'8","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482868+0000","last_change":"2024-09-21T09:13:21.278992+0000","last_active":"2024-09-21T09:13:34.482868+0000","last_peered":"2024-09-21T09:13:34.482868+0000","last_clean":"2024-09-21T09:13:34.482868+0000","last_became_active":"2024-09-21T09:13:19.168562+0000","last_became_peered":"2024-09-21T09:13:19.168562+0000","last_unstale":"2024-09-21T09:13:34.482868+0000","last_undegraded":"2024-09-21T09:13:34.482868+0000","last_fullsized":"2024-09-21T09:13:34.482868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:29.147931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294332+0000","last_change":"2024-09-21T09:11:00.839217+0000","last_active":"2024-09-21T09:13:34.294332+0000","last_peered":"2024-09-21T09:13:34.294332+0000","last_clean":"2024-09-21T09:13:34.294332+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:13:34.294332+0000","last_undegraded":"2024-09-21T09:13:34.294332+0000","last_fullsized":"2024-09-21T09:13:34.294332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:23.833810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"71'18","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293754+0000","last_change":"2024-09-21T09:11:02.872614+0000","last_active":"2024-09-21T09:13:34.293754+0000","last_peered":"2024-09-21T09:13:34.293754+0000","last_clean":"2024-09-21T09:13:34.293754+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:13:34.293754+0000","last_undegraded":"2024-09-21T09:13:34.293754+0000","last_fullsized":"2024-09-21T09:13:34.293754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525609+0000","last_change":"2024-09-21T09:11:04.882308+0000","last_active":"2024-09-21T09:13:34.525609+0000","last_peered":"2024-09-21T09:13:34.525609+0000","last_clean":"2024-09-21T09:13:34.525609+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:13:34.525609+0000","last_undegraded":"2024-09-21T09:13:34.525609+0000","last_fullsized":"2024-09-21T09:13:34.525609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:42.301147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"61'16","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527236+0000","last_change":"2024-09-21T09:11:06.892382+0000","last_active":"2024-09-21T09:13:34.527236+0000","last_peered":"2024-09-21T09:13:34.527236+0000","last_clean":"2024-09-21T09:13:34.527236+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:13:34.527236+0000","last_undegraded":"2024-09-21T09:13:34.527236+0000","last_fullsized":"2024-09-21T09:13:34.527236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:20.449346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"62'6","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285980+0000","last_change":"2024-09-21T09:10:58.869150+0000","last_active":"2024-09-21T09:13:33.285980+0000","last_peered":"2024-09-21T09:13:33.285980+0000","last_clean":"2024-09-21T09:13:33.285980+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:13:33.285980+0000","last_undegraded":"2024-09-21T09:13:33.285980+0000","last_fullsized":"2024-09-21T09:13:33.285980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:58.386210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"66'9","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298150+0000","last_change":"2024-09-21T09:10:56.854764+0000","last_active":"2024-09-21T09:13:34.298150+0000","last_peered":"2024-09-21T09:13:34.298150+0000","last_clean":"2024-09-21T09:13:34.298150+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:13:34.298150+0000","last_undegraded":"2024-09-21T09:13:34.298150+0000","last_fullsized":"2024-09-21T09:13:34.298150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285663+0000","last_change":"2024-09-21T09:11:00.839265+0000","last_active":"2024-09-21T09:13:33.285663+0000","last_peered":"2024-09-21T09:13:33.285663+0000","last_clean":"2024-09-21T09:13:33.285663+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:13:33.285663+0000","last_undegraded":"2024-09-21T09:13:33.285663+0000","last_fullsized":"2024-09-21T09:13:33.285663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:14.524942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"45'5","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.284804+0000","last_change":"2024-09-21T09:13:20.848665+0000","last_active":"2024-09-21T09:13:33.284804+0000","last_peered":"2024-09-21T09:13:33.284804+0000","last_clean":"2024-09-21T09:13:33.284804+0000","last_became_active":"2024-09-21T09:13:19.154000+0000","last_became_peered":"2024-09-21T09:13:19.154000+0000","last_unstale":"2024-09-21T09:13:33.284804+0000","last_undegraded":"2024-09-21T09:13:33.284804+0000","last_fullsized":"2024-09-21T09:13:33.284804+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:40.242838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297539+0000","last_change":"2024-09-21T09:13:19.160157+0000","last_active":"2024-09-21T09:13:34.297539+0000","last_peered":"2024-09-21T09:13:34.297539+0000","last_clean":"2024-09-21T09:13:34.297539+0000","last_became_active":"2024-09-21T09:13:19.157523+0000","last_became_peered":"2024-09-21T09:13:19.157523+0000","last_unstale":"2024-09-21T09:13:34.297539+0000","last_undegraded":"2024-09-21T09:13:34.297539+0000","last_fullsized":"2024-09-21T09:13:34.297539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:07.414777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294652+0000","last_change":"2024-09-21T09:11:06.879042+0000","last_active":"2024-09-21T09:13:34.294652+0000","last_peered":"2024-09-21T09:13:34.294652+0000","last_clean":"2024-09-21T09:13:34.294652+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:13:34.294652+0000","last_undegraded":"2024-09-21T09:13:34.294652+0000","last_fullsized":"2024-09-21T09:13:34.294652+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:34.670949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285427+0000","last_change":"2024-09-21T09:10:58.864481+0000","last_active":"2024-09-21T09:13:33.285427+0000","last_peered":"2024-09-21T09:13:33.285427+0000","last_clean":"2024-09-21T09:13:33.285427+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:13:33.285427+0000","last_undegraded":"2024-09-21T09:13:33.285427+0000","last_fullsized":"2024-09-21T09:13:33.285427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:33.405020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"67'12","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298309+0000","last_change":"2024-09-21T09:13:20.071816+0000","last_active":"2024-09-21T09:13:34.298309+0000","last_peered":"2024-09-21T09:13:34.298309+0000","last_clean":"2024-09-21T09:13:34.298309+0000","last_became_active":"2024-09-21T09:13:19.160370+0000","last_became_peered":"2024-09-21T09:13:19.160370+0000","last_unstale":"2024-09-21T09:13:34.298309+0000","last_undegraded":"2024-09-21T09:13:34.298309+0000","last_fullsized":"2024-09-21T09:13:34.298309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:13.089799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292818+0000","last_change":"2024-09-21T09:13:19.145601+0000","last_active":"2024-09-21T09:13:34.292818+0000","last_peered":"2024-09-21T09:13:34.292818+0000","last_clean":"2024-09-21T09:13:34.292818+0000","last_became_active":"2024-09-21T09:13:19.142672+0000","last_became_peered":"2024-09-21T09:13:19.142672+0000","last_unstale":"2024-09-21T09:13:34.292818+0000","last_undegraded":"2024-09-21T09:13:34.292818+0000","last_fullsized":"2024-09-21T09:13:34.292818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.000309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"71'17","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526668+0000","last_change":"2024-09-21T09:11:02.869796+0000","last_active":"2024-09-21T09:13:34.526668+0000","last_peered":"2024-09-21T09:13:34.526668+0000","last_clean":"2024-09-21T09:13:34.526668+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:13:34.526668+0000","last_undegraded":"2024-09-21T09:13:34.526668+0000","last_fullsized":"2024-09-21T09:13:34.526668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:48.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291159+0000","last_change":"2024-09-21T09:11:04.893727+0000","last_active":"2024-09-21T09:13:33.291159+0000","last_peered":"2024-09-21T09:13:33.291159+0000","last_clean":"2024-09-21T09:13:33.291159+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:33.291159+0000","last_undegraded":"2024-09-21T09:13:33.291159+0000","last_fullsized":"2024-09-21T09:13:33.291159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:18.437905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"71'7","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482615+0000","last_change":"2024-09-21T09:13:21.128242+0000","last_active":"2024-09-21T09:13:34.482615+0000","last_peered":"2024-09-21T09:13:34.482615+0000","last_clean":"2024-09-21T09:13:34.482615+0000","last_became_active":"2024-09-21T09:13:19.167169+0000","last_became_peered":"2024-09-21T09:13:19.167169+0000","last_unstale":"2024-09-21T09:13:34.482615+0000","last_undegraded":"2024-09-21T09:13:34.482615+0000","last_fullsized":"2024-09-21T09:13:34.482615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:46.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526036+0000","last_change":"2024-09-21T09:10:58.859005+0000","last_active":"2024-09-21T09:13:34.526036+0000","last_peered":"2024-09-21T09:13:34.526036+0000","last_clean":"2024-09-21T09:13:34.526036+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:13:34.526036+0000","last_undegraded":"2024-09-21T09:13:34.526036+0000","last_fullsized":"2024-09-21T09:13:34.526036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:38.110596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"66'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958780+0000","last_change":"2024-09-21T09:10:56.860416+0000","last_active":"2024-09-21T09:13:34.958780+0000","last_peered":"2024-09-21T09:13:34.958780+0000","last_clean":"2024-09-21T09:13:34.958780+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:13:34.958780+0000","last_undegraded":"2024-09-21T09:13:34.958780+0000","last_fullsized":"2024-09-21T09:13:34.958780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:48.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482021+0000","last_change":"2024-09-21T09:13:19.153082+0000","last_active":"2024-09-21T09:13:34.482021+0000","last_peered":"2024-09-21T09:13:34.482021+0000","last_clean":"2024-09-21T09:13:34.482021+0000","last_became_active":"2024-09-21T09:13:19.152722+0000","last_became_peered":"2024-09-21T09:13:19.152722+0000","last_unstale":"2024-09-21T09:13:34.482021+0000","last_undegraded":"2024-09-21T09:13:34.482021+0000","last_fullsized":"2024-09-21T09:13:34.482021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:26.550403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"71'16","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295783+0000","last_change":"2024-09-21T09:11:02.872950+0000","last_active":"2024-09-21T09:13:34.295783+0000","last_peered":"2024-09-21T09:13:34.295783+0000","last_clean":"2024-09-21T09:13:34.295783+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:13:34.295783+0000","last_undegraded":"2024-09-21T09:13:34.295783+0000","last_fullsized":"2024-09-21T09:13:34.295783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526197+0000","last_change":"2024-09-21T09:13:19.144593+0000","last_active":"2024-09-21T09:13:34.526197+0000","last_peered":"2024-09-21T09:13:34.526197+0000","last_clean":"2024-09-21T09:13:34.526197+0000","last_became_active":"2024-09-21T09:13:19.143577+0000","last_became_peered":"2024-09-21T09:13:19.143577+0000","last_unstale":"2024-09-21T09:13:34.526197+0000","last_undegraded":"2024-09-21T09:13:34.526197+0000","last_fullsized":"2024-09-21T09:13:34.526197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:02.985464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483155+0000","last_change":"2024-09-21T09:10:58.839092+0000","last_active":"2024-09-21T09:13:34.483155+0000","last_peered":"2024-09-21T09:13:34.483155+0000","last_clean":"2024-09-21T09:13:34.483155+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:13:34.483155+0000","last_undegraded":"2024-09-21T09:13:34.483155+0000","last_fullsized":"2024-09-21T09:13:34.483155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:02.458655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"66'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956457+0000","last_change":"2024-09-21T09:10:56.865435+0000","last_active":"2024-09-21T09:13:34.956457+0000","last_peered":"2024-09-21T09:13:34.956457+0000","last_clean":"2024-09-21T09:13:34.956457+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:13:34.956457+0000","last_undegraded":"2024-09-21T09:13:34.956457+0000","last_fullsized":"2024-09-21T09:13:34.956457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295267+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.295267+0000","last_peered":"2024-09-21T09:13:34.295267+0000","last_clean":"2024-09-21T09:13:34.295267+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:13:34.295267+0000","last_undegraded":"2024-09-21T09:13:34.295267+0000","last_fullsized":"2024-09-21T09:13:34.295267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:10.134818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"71'24","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294966+0000","last_change":"2024-09-21T09:11:02.879895+0000","last_active":"2024-09-21T09:13:34.294966+0000","last_peered":"2024-09-21T09:13:34.294966+0000","last_clean":"2024-09-21T09:13:34.294966+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:13:34.294966+0000","last_undegraded":"2024-09-21T09:13:34.294966+0000","last_fullsized":"2024-09-21T09:13:34.294966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298886+0000","last_change":"2024-09-21T09:13:19.166381+0000","last_active":"2024-09-21T09:13:34.298886+0000","last_peered":"2024-09-21T09:13:34.298886+0000","last_clean":"2024-09-21T09:13:34.298886+0000","last_became_active":"2024-09-21T09:13:19.165859+0000","last_became_peered":"2024-09-21T09:13:19.165859+0000","last_unstale":"2024-09-21T09:13:34.298886+0000","last_undegraded":"2024-09-21T09:13:34.298886+0000","last_fullsized":"2024-09-21T09:13:34.298886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:20.747731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957270+0000","last_change":"2024-09-21T09:11:06.896002+0000","last_active":"2024-09-21T09:13:34.957270+0000","last_peered":"2024-09-21T09:13:34.957270+0000","last_clean":"2024-09-21T09:13:34.957270+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:13:34.957270+0000","last_undegraded":"2024-09-21T09:13:34.957270+0000","last_fullsized":"2024-09-21T09:13:34.957270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:01.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"71'10","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287684+0000","last_change":"2024-09-21T09:10:58.868892+0000","last_active":"2024-09-21T09:13:33.287684+0000","last_peered":"2024-09-21T09:13:33.287684+0000","last_clean":"2024-09-21T09:13:33.287684+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:13:33.287684+0000","last_undegraded":"2024-09-21T09:13:33.287684+0000","last_fullsized":"2024-09-21T09:13:33.287684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"66'5","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286015+0000","last_change":"2024-09-21T09:10:56.827351+0000","last_active":"2024-09-21T09:13:33.286015+0000","last_peered":"2024-09-21T09:13:33.286015+0000","last_clean":"2024-09-21T09:13:33.286015+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:13:33.286015+0000","last_undegraded":"2024-09-21T09:13:33.286015+0000","last_fullsized":"2024-09-21T09:13:33.286015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:49.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298002+0000","last_change":"2024-09-21T09:13:19.159092+0000","last_active":"2024-09-21T09:13:34.298002+0000","last_peered":"2024-09-21T09:13:34.298002+0000","last_clean":"2024-09-21T09:13:34.298002+0000","last_became_active":"2024-09-21T09:13:19.158652+0000","last_became_peered":"2024-09-21T09:13:19.158652+0000","last_unstale":"2024-09-21T09:13:34.298002+0000","last_undegraded":"2024-09-21T09:13:34.298002+0000","last_fullsized":"2024-09-21T09:13:34.298002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:32.340994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"71'22","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482767+0000","last_change":"2024-09-21T09:13:21.165572+0000","last_active":"2024-09-21T09:13:34.482767+0000","last_peered":"2024-09-21T09:13:34.482767+0000","last_clean":"2024-09-21T09:13:34.482767+0000","last_became_active":"2024-09-21T09:13:19.167344+0000","last_became_peered":"2024-09-21T09:13:19.167344+0000","last_unstale":"2024-09-21T09:13:34.482767+0000","last_undegraded":"2024-09-21T09:13:34.482767+0000","last_fullsized":"2024-09-21T09:13:34.482767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:05.930094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956301+0000","last_change":"2024-09-21T09:11:04.890782+0000","last_active":"2024-09-21T09:13:34.956301+0000","last_peered":"2024-09-21T09:13:34.956301+0000","last_clean":"2024-09-21T09:13:34.956301+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:13:34.956301+0000","last_undegraded":"2024-09-21T09:13:34.956301+0000","last_fullsized":"2024-09-21T09:13:34.956301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:42.740558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"71'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482532+0000","last_change":"2024-09-21T09:11:06.889510+0000","last_active":"2024-09-21T09:13:34.482532+0000","last_peered":"2024-09-21T09:13:34.482532+0000","last_clean":"2024-09-21T09:13:34.482532+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:13:34.482532+0000","last_undegraded":"2024-09-21T09:13:34.482532+0000","last_fullsized":"2024-09-21T09:13:34.482532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:38.377418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527248+0000","last_change":"2024-09-21T09:10:58.854750+0000","last_active":"2024-09-21T09:13:34.527248+0000","last_peered":"2024-09-21T09:13:34.527248+0000","last_clean":"2024-09-21T09:13:34.527248+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:13:34.527248+0000","last_undegraded":"2024-09-21T09:13:34.527248+0000","last_fullsized":"2024-09-21T09:13:34.527248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.559151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"67'10","reported_seq":148,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293570+0000","last_change":"2024-09-21T09:10:56.863198+0000","last_active":"2024-09-21T09:13:33.293570+0000","last_peered":"2024-09-21T09:13:33.293570+0000","last_clean":"2024-09-21T09:13:33.293570+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:13:33.293570+0000","last_undegraded":"2024-09-21T09:13:33.293570+0000","last_fullsized":"2024-09-21T09:13:33.293570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298158+0000","last_change":"2024-09-21T09:13:20.592162+0000","last_active":"2024-09-21T09:13:34.298158+0000","last_peered":"2024-09-21T09:13:34.298158+0000","last_clean":"2024-09-21T09:13:34.298158+0000","last_became_active":"2024-09-21T09:13:19.165929+0000","last_became_peered":"2024-09-21T09:13:19.165929+0000","last_unstale":"2024-09-21T09:13:34.298158+0000","last_undegraded":"2024-09-21T09:13:34.298158+0000","last_fullsized":"2024-09-21T09:13:34.298158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:41.372526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"71'17","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295570+0000","last_change":"2024-09-21T09:11:02.879188+0000","last_active":"2024-09-21T09:13:34.295570+0000","last_peered":"2024-09-21T09:13:34.295570+0000","last_clean":"2024-09-21T09:13:34.295570+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:13:34.295570+0000","last_undegraded":"2024-09-21T09:13:34.295570+0000","last_fullsized":"2024-09-21T09:13:34.295570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:37.208901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527107+0000","last_change":"2024-09-21T09:11:04.880786+0000","last_active":"2024-09-21T09:13:34.527107+0000","last_peered":"2024-09-21T09:13:34.527107+0000","last_clean":"2024-09-21T09:13:34.527107+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:13:34.527107+0000","last_undegraded":"2024-09-21T09:13:34.527107+0000","last_fullsized":"2024-09-21T09:13:34.527107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:54.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"62'10","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481914+0000","last_change":"2024-09-21T09:11:06.898517+0000","last_active":"2024-09-21T09:13:34.481914+0000","last_peered":"2024-09-21T09:13:34.481914+0000","last_clean":"2024-09-21T09:13:34.481914+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:13:34.481914+0000","last_undegraded":"2024-09-21T09:13:34.481914+0000","last_fullsized":"2024-09-21T09:13:34.481914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:46.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":39,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":147,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286952+0000","last_change":"2024-09-21T09:10:58.868807+0000","last_active":"2024-09-21T09:13:33.286952+0000","last_peered":"2024-09-21T09:13:33.286952+0000","last_clean":"2024-09-21T09:13:33.286952+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:13:33.286952+0000","last_undegraded":"2024-09-21T09:13:33.286952+0000","last_fullsized":"2024-09-21T09:13:33.286952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.574650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"67'12","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287187+0000","last_change":"2024-09-21T09:10:56.851205+0000","last_active":"2024-09-21T09:13:33.287187+0000","last_peered":"2024-09-21T09:13:33.287187+0000","last_clean":"2024-09-21T09:13:33.287187+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:13:33.287187+0000","last_undegraded":"2024-09-21T09:13:33.287187+0000","last_fullsized":"2024-09-21T09:13:33.287187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:52.423650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287169+0000","last_change":"2024-09-21T09:11:00.856830+0000","last_active":"2024-09-21T09:13:33.287169+0000","last_peered":"2024-09-21T09:13:33.287169+0000","last_clean":"2024-09-21T09:13:33.287169+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:13:33.287169+0000","last_undegraded":"2024-09-21T09:13:33.287169+0000","last_fullsized":"2024-09-21T09:13:33.287169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:45.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"74'14","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483000+0000","last_change":"2024-09-21T09:13:21.153990+0000","last_active":"2024-09-21T09:13:34.483000+0000","last_peered":"2024-09-21T09:13:34.483000+0000","last_clean":"2024-09-21T09:13:34.483000+0000","last_became_active":"2024-09-21T09:13:19.167321+0000","last_became_peered":"2024-09-21T09:13:19.167321+0000","last_unstale":"2024-09-21T09:13:34.483000+0000","last_undegraded":"2024-09-21T09:13:34.483000+0000","last_fullsized":"2024-09-21T09:13:34.483000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:34.649177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"71'101","reported_seq":269,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298386+0000","last_change":"2024-09-21T09:11:04.870463+0000","last_active":"2024-09-21T09:13:34.298386+0000","last_peered":"2024-09-21T09:13:34.298386+0000","last_clean":"2024-09-21T09:13:34.298386+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:13:34.298386+0000","last_undegraded":"2024-09-21T09:13:34.298386+0000","last_fullsized":"2024-09-21T09:13:34.298386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:30.495090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"58'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481854+0000","last_change":"2024-09-21T09:11:06.883550+0000","last_active":"2024-09-21T09:13:34.481854+0000","last_peered":"2024-09-21T09:13:34.481854+0000","last_clean":"2024-09-21T09:13:34.481854+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:13:34.481854+0000","last_undegraded":"2024-09-21T09:13:34.481854+0000","last_fullsized":"2024-09-21T09:13:34.481854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:56.825424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"71'10","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296041+0000","last_change":"2024-09-21T09:13:19.537524+0000","last_active":"2024-09-21T09:13:34.296041+0000","last_peered":"2024-09-21T09:13:34.296041+0000","last_clean":"2024-09-21T09:13:34.296041+0000","last_became_active":"2024-09-21T09:13:19.159904+0000","last_became_peered":"2024-09-21T09:13:19.159904+0000","last_unstale":"2024-09-21T09:13:34.296041+0000","last_undegraded":"2024-09-21T09:13:34.296041+0000","last_fullsized":"2024-09-21T09:13:34.296041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:12.531734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"67'12","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293240+0000","last_change":"2024-09-21T09:10:56.852586+0000","last_active":"2024-09-21T09:13:33.293240+0000","last_peered":"2024-09-21T09:13:33.293240+0000","last_clean":"2024-09-21T09:13:33.293240+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:13:33.293240+0000","last_undegraded":"2024-09-21T09:13:33.293240+0000","last_fullsized":"2024-09-21T09:13:33.293240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":130,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.290596+0000","last_change":"2024-09-21T09:11:00.839800+0000","last_active":"2024-09-21T09:13:33.290596+0000","last_peered":"2024-09-21T09:13:33.290596+0000","last_clean":"2024-09-21T09:13:33.290596+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:13:33.290596+0000","last_undegraded":"2024-09-21T09:13:33.290596+0000","last_fullsized":"2024-09-21T09:13:33.290596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:21.140377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"71'22","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293383+0000","last_change":"2024-09-21T09:11:02.857087+0000","last_active":"2024-09-21T09:13:34.293383+0000","last_peered":"2024-09-21T09:13:34.293383+0000","last_clean":"2024-09-21T09:13:34.293383+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:13:34.293383+0000","last_undegraded":"2024-09-21T09:13:34.293383+0000","last_fullsized":"2024-09-21T09:13:34.293383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.284978+0000","last_change":"2024-09-21T09:11:04.872303+0000","last_active":"2024-09-21T09:13:33.284978+0000","last_peered":"2024-09-21T09:13:33.284978+0000","last_clean":"2024-09-21T09:13:33.284978+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:13:33.284978+0000","last_undegraded":"2024-09-21T09:13:33.284978+0000","last_fullsized":"2024-09-21T09:13:33.284978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.517451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"71'10","reported_seq":135,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293321+0000","last_change":"2024-09-21T09:11:06.873636+0000","last_active":"2024-09-21T09:13:33.293321+0000","last_peered":"2024-09-21T09:13:33.293321+0000","last_clean":"2024-09-21T09:13:33.293321+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:13:33.293321+0000","last_undegraded":"2024-09-21T09:13:33.293321+0000","last_fullsized":"2024-09-21T09:13:33.293321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:52.693664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293210+0000","last_change":"2024-09-21T09:13:19.144377+0000","last_active":"2024-09-21T09:13:34.293210+0000","last_peered":"2024-09-21T09:13:34.293210+0000","last_clean":"2024-09-21T09:13:34.293210+0000","last_became_active":"2024-09-21T09:13:19.143746+0000","last_became_peered":"2024-09-21T09:13:19.143746+0000","last_unstale":"2024-09-21T09:13:34.293210+0000","last_undegraded":"2024-09-21T09:13:34.293210+0000","last_fullsized":"2024-09-21T09:13:34.293210+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:48.781954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"67'15","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482960+0000","last_change":"2024-09-21T09:11:34.170912+0000","last_active":"2024-09-21T09:13:34.482960+0000","last_peered":"2024-09-21T09:13:34.482960+0000","last_clean":"2024-09-21T09:13:34.482960+0000","last_became_active":"2024-09-21T09:11:34.170599+0000","last_became_peered":"2024-09-21T09:11:34.170599+0000","last_unstale":"2024-09-21T09:13:34.482960+0000","last_undegraded":"2024-09-21T09:13:34.482960+0000","last_fullsized":"2024-09-21T09:13:34.482960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296362+0000","last_change":"2024-09-21T09:13:19.144365+0000","last_active":"2024-09-21T09:13:34.296362+0000","last_peered":"2024-09-21T09:13:34.296362+0000","last_clean":"2024-09-21T09:13:34.296362+0000","last_became_active":"2024-09-21T09:13:19.141404+0000","last_became_peered":"2024-09-21T09:13:19.141404+0000","last_unstale":"2024-09-21T09:13:34.296362+0000","last_undegraded":"2024-09-21T09:13:34.296362+0000","last_fullsized":"2024-09-21T09:13:34.296362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:05.438476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"71'16","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285721+0000","last_change":"2024-09-21T09:11:02.847926+0000","last_active":"2024-09-21T09:13:33.285721+0000","last_peered":"2024-09-21T09:13:33.285721+0000","last_clean":"2024-09-21T09:13:33.285721+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:13:33.285721+0000","last_undegraded":"2024-09-21T09:13:33.285721+0000","last_fullsized":"2024-09-21T09:13:33.285721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:15.592269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482045+0000","last_change":"2024-09-21T09:11:04.880866+0000","last_active":"2024-09-21T09:13:34.482045+0000","last_peered":"2024-09-21T09:13:34.482045+0000","last_clean":"2024-09-21T09:13:34.482045+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:13:34.482045+0000","last_undegraded":"2024-09-21T09:13:34.482045+0000","last_fullsized":"2024-09-21T09:13:34.482045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:02.568576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957411+0000","last_change":"2024-09-21T09:11:06.899493+0000","last_active":"2024-09-21T09:13:34.957411+0000","last_peered":"2024-09-21T09:13:34.957411+0000","last_clean":"2024-09-21T09:13:34.957411+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:13:34.957411+0000","last_undegraded":"2024-09-21T09:13:34.957411+0000","last_fullsized":"2024-09-21T09:13:34.957411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:50.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525954+0000","last_change":"2024-09-21T09:10:58.856310+0000","last_active":"2024-09-21T09:13:34.525954+0000","last_peered":"2024-09-21T09:13:34.525954+0000","last_clean":"2024-09-21T09:13:34.525954+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:13:34.525954+0000","last_undegraded":"2024-09-21T09:13:34.525954+0000","last_fullsized":"2024-09-21T09:13:34.525954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:12.549438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"66'11","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958076+0000","last_change":"2024-09-21T09:13:20.628384+0000","last_active":"2024-09-21T09:13:34.958076+0000","last_peered":"2024-09-21T09:13:34.958076+0000","last_clean":"2024-09-21T09:13:34.958076+0000","last_became_active":"2024-09-21T09:13:19.169569+0000","last_became_peered":"2024-09-21T09:13:19.169569+0000","last_unstale":"2024-09-21T09:13:34.958076+0000","last_undegraded":"2024-09-21T09:13:34.958076+0000","last_fullsized":"2024-09-21T09:13:34.958076+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:00.389819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":130,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.290406+0000","last_change":"2024-09-21T09:11:00.837141+0000","last_active":"2024-09-21T09:13:33.290406+0000","last_peered":"2024-09-21T09:13:33.290406+0000","last_clean":"2024-09-21T09:13:33.290406+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:13:33.290406+0000","last_undegraded":"2024-09-21T09:13:33.290406+0000","last_fullsized":"2024-09-21T09:13:33.290406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"71'11","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294478+0000","last_change":"2024-09-21T09:13:20.076515+0000","last_active":"2024-09-21T09:13:34.294478+0000","last_peered":"2024-09-21T09:13:34.294478+0000","last_clean":"2024-09-21T09:13:34.294478+0000","last_became_active":"2024-09-21T09:13:19.150207+0000","last_became_peered":"2024-09-21T09:13:19.150207+0000","last_unstale":"2024-09-21T09:13:34.294478+0000","last_undegraded":"2024-09-21T09:13:34.294478+0000","last_fullsized":"2024-09-21T09:13:34.294478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482052+0000","last_change":"2024-09-21T09:11:04.887172+0000","last_active":"2024-09-21T09:13:34.482052+0000","last_peered":"2024-09-21T09:13:34.482052+0000","last_clean":"2024-09-21T09:13:34.482052+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:13:34.482052+0000","last_undegraded":"2024-09-21T09:13:34.482052+0000","last_fullsized":"2024-09-21T09:13:34.482052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:01.250555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482536+0000","last_change":"2024-09-21T09:13:19.157682+0000","last_active":"2024-09-21T09:13:34.482536+0000","last_peered":"2024-09-21T09:13:34.482536+0000","last_clean":"2024-09-21T09:13:34.482536+0000","last_became_active":"2024-09-21T09:13:19.157306+0000","last_became_peered":"2024-09-21T09:13:19.157306+0000","last_unstale":"2024-09-21T09:13:34.482536+0000","last_undegraded":"2024-09-21T09:13:34.482536+0000","last_fullsized":"2024-09-21T09:13:34.482536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.786122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292810+0000","last_change":"2024-09-21T09:13:19.713138+0000","last_active":"2024-09-21T09:13:34.292810+0000","last_peered":"2024-09-21T09:13:34.292810+0000","last_clean":"2024-09-21T09:13:34.292810+0000","last_became_active":"2024-09-21T09:13:19.161496+0000","last_became_peered":"2024-09-21T09:13:19.161496+0000","last_unstale":"2024-09-21T09:13:34.292810+0000","last_undegraded":"2024-09-21T09:13:34.292810+0000","last_fullsized":"2024-09-21T09:13:34.292810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:42.440821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958517+0000","last_change":"2024-09-21T09:10:56.861373+0000","last_active":"2024-09-21T09:13:34.958517+0000","last_peered":"2024-09-21T09:13:34.958517+0000","last_clean":"2024-09-21T09:13:34.958517+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:13:34.958517+0000","last_undegraded":"2024-09-21T09:13:34.958517+0000","last_fullsized":"2024-09-21T09:13:34.958517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:45.846021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":134,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285038+0000","last_change":"2024-09-21T09:11:00.838647+0000","last_active":"2024-09-21T09:13:33.285038+0000","last_peered":"2024-09-21T09:13:33.285038+0000","last_clean":"2024-09-21T09:13:33.285038+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:13:33.285038+0000","last_undegraded":"2024-09-21T09:13:33.285038+0000","last_fullsized":"2024-09-21T09:13:33.285038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:16.279789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"71'17","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482115+0000","last_change":"2024-09-21T09:11:02.877357+0000","last_active":"2024-09-21T09:13:34.482115+0000","last_peered":"2024-09-21T09:13:34.482115+0000","last_clean":"2024-09-21T09:13:34.482115+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:13:34.482115+0000","last_undegraded":"2024-09-21T09:13:34.482115+0000","last_fullsized":"2024-09-21T09:13:34.482115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:46.845302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67351,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286326+0000","last_change":"2024-09-21T09:11:04.896698+0000","last_active":"2024-09-21T09:13:33.286326+0000","last_peered":"2024-09-21T09:13:33.286326+0000","last_clean":"2024-09-21T09:13:33.286326+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:13:33.286326+0000","last_undegraded":"2024-09-21T09:13:33.286326+0000","last_fullsized":"2024-09-21T09:13:33.286326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:59.924890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297318+0000","last_change":"2024-09-21T09:13:20.646926+0000","last_active":"2024-09-21T09:13:34.297318+0000","last_peered":"2024-09-21T09:13:34.297318+0000","last_clean":"2024-09-21T09:13:34.297318+0000","last_became_active":"2024-09-21T09:13:19.153765+0000","last_became_peered":"2024-09-21T09:13:19.153765+0000","last_unstale":"2024-09-21T09:13:34.297318+0000","last_undegraded":"2024-09-21T09:13:34.297318+0000","last_fullsized":"2024-09-21T09:13:34.297318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'6","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287998+0000","last_change":"2024-09-21T09:10:58.865842+0000","last_active":"2024-09-21T09:13:33.287998+0000","last_peered":"2024-09-21T09:13:33.287998+0000","last_clean":"2024-09-21T09:13:33.287998+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:13:33.287998+0000","last_undegraded":"2024-09-21T09:13:33.287998+0000","last_fullsized":"2024-09-21T09:13:33.287998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:10.069785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"66'7","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293255+0000","last_change":"2024-09-21T09:13:19.522324+0000","last_active":"2024-09-21T09:13:34.293255+0000","last_peered":"2024-09-21T09:13:34.293255+0000","last_clean":"2024-09-21T09:13:34.293255+0000","last_became_active":"2024-09-21T09:13:19.143052+0000","last_became_peered":"2024-09-21T09:13:19.143052+0000","last_unstale":"2024-09-21T09:13:34.293255+0000","last_undegraded":"2024-09-21T09:13:34.293255+0000","last_fullsized":"2024-09-21T09:13:34.293255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:36.362618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"71'8","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527890+0000","last_change":"2024-09-21T09:10:58.871267+0000","last_active":"2024-09-21T09:13:34.527890+0000","last_peered":"2024-09-21T09:13:34.527890+0000","last_clean":"2024-09-21T09:13:34.527890+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:13:34.527890+0000","last_undegraded":"2024-09-21T09:13:34.527890+0000","last_fullsized":"2024-09-21T09:13:34.527890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"66'8","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525789+0000","last_change":"2024-09-21T09:10:56.847914+0000","last_active":"2024-09-21T09:13:34.525789+0000","last_peered":"2024-09-21T09:13:34.525789+0000","last_clean":"2024-09-21T09:13:34.525789+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:13:34.525789+0000","last_undegraded":"2024-09-21T09:13:34.525789+0000","last_fullsized":"2024-09-21T09:13:34.525789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482765+0000","last_change":"2024-09-21T09:10:58.837841+0000","last_active":"2024-09-21T09:13:34.482765+0000","last_peered":"2024-09-21T09:13:34.482765+0000","last_clean":"2024-09-21T09:13:34.482765+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:13:34.482765+0000","last_undegraded":"2024-09-21T09:13:34.482765+0000","last_fullsized":"2024-09-21T09:13:34.482765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:54.101397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"67'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482421+0000","last_change":"2024-09-21T09:10:56.861995+0000","last_active":"2024-09-21T09:13:34.482421+0000","last_peered":"2024-09-21T09:13:34.482421+0000","last_clean":"2024-09-21T09:13:34.482421+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:13:34.482421+0000","last_undegraded":"2024-09-21T09:13:34.482421+0000","last_fullsized":"2024-09-21T09:13:34.482421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:44.655482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"58'4","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957038+0000","last_change":"2024-09-21T09:13:20.835461+0000","last_active":"2024-09-21T09:13:34.957038+0000","last_peered":"2024-09-21T09:13:34.957038+0000","last_clean":"2024-09-21T09:13:34.957038+0000","last_became_active":"2024-09-21T09:13:19.169698+0000","last_became_peered":"2024-09-21T09:13:19.169698+0000","last_unstale":"2024-09-21T09:13:34.957038+0000","last_undegraded":"2024-09-21T09:13:34.957038+0000","last_fullsized":"2024-09-21T09:13:34.957038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:00.406380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"62'6","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955827+0000","last_change":"2024-09-21T09:10:56.866139+0000","last_active":"2024-09-21T09:13:34.955827+0000","last_peered":"2024-09-21T09:13:34.955827+0000","last_clean":"2024-09-21T09:13:34.955827+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:13:34.955827+0000","last_undegraded":"2024-09-21T09:13:34.955827+0000","last_fullsized":"2024-09-21T09:13:34.955827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:33.551996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"58'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956535+0000","last_change":"2024-09-21T09:10:58.840408+0000","last_active":"2024-09-21T09:13:34.956535+0000","last_peered":"2024-09-21T09:13:34.956535+0000","last_clean":"2024-09-21T09:13:34.956535+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:13:34.956535+0000","last_undegraded":"2024-09-21T09:13:34.956535+0000","last_fullsized":"2024-09-21T09:13:34.956535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:42.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"66'8","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295479+0000","last_change":"2024-09-21T09:10:56.860054+0000","last_active":"2024-09-21T09:13:34.295479+0000","last_peered":"2024-09-21T09:13:34.295479+0000","last_clean":"2024-09-21T09:13:34.295479+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:13:34.295479+0000","last_undegraded":"2024-09-21T09:13:34.295479+0000","last_fullsized":"2024-09-21T09:13:34.295479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296113+0000","last_change":"2024-09-21T09:10:58.836500+0000","last_active":"2024-09-21T09:13:34.296113+0000","last_peered":"2024-09-21T09:13:34.296113+0000","last_clean":"2024-09-21T09:13:34.296113+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:13:34.296113+0000","last_undegraded":"2024-09-21T09:13:34.296113+0000","last_fullsized":"2024-09-21T09:13:34.296113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"66'8","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295940+0000","last_change":"2024-09-21T09:10:56.862765+0000","last_active":"2024-09-21T09:13:34.295940+0000","last_peered":"2024-09-21T09:13:34.295940+0000","last_clean":"2024-09-21T09:13:34.295940+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:13:34.295940+0000","last_undegraded":"2024-09-21T09:13:34.295940+0000","last_fullsized":"2024-09-21T09:13:34.295940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"62'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294186+0000","last_change":"2024-09-21T09:10:58.826466+0000","last_active":"2024-09-21T09:13:34.294186+0000","last_peered":"2024-09-21T09:13:34.294186+0000","last_clean":"2024-09-21T09:13:34.294186+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:13:34.294186+0000","last_undegraded":"2024-09-21T09:13:34.294186+0000","last_fullsized":"2024-09-21T09:13:34.294186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"66'9","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299107+0000","last_change":"2024-09-21T09:13:20.211974+0000","last_active":"2024-09-21T09:13:34.299107+0000","last_peered":"2024-09-21T09:13:34.299107+0000","last_clean":"2024-09-21T09:13:34.299107+0000","last_became_active":"2024-09-21T09:13:19.161214+0000","last_became_peered":"2024-09-21T09:13:19.161214+0000","last_unstale":"2024-09-21T09:13:34.299107+0000","last_undegraded":"2024-09-21T09:13:34.299107+0000","last_fullsized":"2024-09-21T09:13:34.299107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:40:58.281738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"62'2","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292575+0000","last_change":"2024-09-21T09:10:58.872072+0000","last_active":"2024-09-21T09:13:33.292575+0000","last_peered":"2024-09-21T09:13:33.292575+0000","last_clean":"2024-09-21T09:13:33.292575+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:13:33.292575+0000","last_undegraded":"2024-09-21T09:13:33.292575+0000","last_fullsized":"2024-09-21T09:13:33.292575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"67'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958252+0000","last_change":"2024-09-21T09:10:56.861072+0000","last_active":"2024-09-21T09:13:34.958252+0000","last_peered":"2024-09-21T09:13:34.958252+0000","last_clean":"2024-09-21T09:13:34.958252+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:13:34.958252+0000","last_undegraded":"2024-09-21T09:13:34.958252+0000","last_fullsized":"2024-09-21T09:13:34.958252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527799+0000","last_change":"2024-09-21T09:10:58.856982+0000","last_active":"2024-09-21T09:13:34.527799+0000","last_peered":"2024-09-21T09:13:34.527799+0000","last_clean":"2024-09-21T09:13:34.527799+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:13:34.527799+0000","last_undegraded":"2024-09-21T09:13:34.527799+0000","last_fullsized":"2024-09-21T09:13:34.527799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"66'7","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482177+0000","last_change":"2024-09-21T09:10:56.847793+0000","last_active":"2024-09-21T09:13:34.482177+0000","last_peered":"2024-09-21T09:13:34.482177+0000","last_clean":"2024-09-21T09:13:34.482177+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:13:34.482177+0000","last_undegraded":"2024-09-21T09:13:34.482177+0000","last_fullsized":"2024-09-21T09:13:34.482177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:22.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"62'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298133+0000","last_change":"2024-09-21T09:10:58.851481+0000","last_active":"2024-09-21T09:13:34.298133+0000","last_peered":"2024-09-21T09:13:34.298133+0000","last_clean":"2024-09-21T09:13:34.298133+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:13:34.298133+0000","last_undegraded":"2024-09-21T09:13:34.298133+0000","last_fullsized":"2024-09-21T09:13:34.298133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:42.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"67'12","reported_seq":215,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956033+0000","last_change":"2024-09-21T09:13:20.068227+0000","last_active":"2024-09-21T09:13:34.956033+0000","last_peered":"2024-09-21T09:13:34.956033+0000","last_clean":"2024-09-21T09:13:34.956033+0000","last_became_active":"2024-09-21T09:13:19.169480+0000","last_became_peered":"2024-09-21T09:13:19.169480+0000","last_unstale":"2024-09-21T09:13:34.956033+0000","last_undegraded":"2024-09-21T09:13:34.956033+0000","last_fullsized":"2024-09-21T09:13:34.956033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:08.928533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957005+0000","last_change":"2024-09-21T09:10:58.843673+0000","last_active":"2024-09-21T09:13:34.957005+0000","last_peered":"2024-09-21T09:13:34.957005+0000","last_clean":"2024-09-21T09:13:34.957005+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:13:34.957005+0000","last_undegraded":"2024-09-21T09:13:34.957005+0000","last_fullsized":"2024-09-21T09:13:34.957005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:19.133330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"67'6","reported_seq":145,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292760+0000","last_change":"2024-09-21T09:10:56.838835+0000","last_active":"2024-09-21T09:13:33.292760+0000","last_peered":"2024-09-21T09:13:33.292760+0000","last_clean":"2024-09-21T09:13:33.292760+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:13:33.292760+0000","last_undegraded":"2024-09-21T09:13:33.292760+0000","last_fullsized":"2024-09-21T09:13:33.292760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'2","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292340+0000","last_change":"2024-09-21T09:10:58.869168+0000","last_active":"2024-09-21T09:13:33.292340+0000","last_peered":"2024-09-21T09:13:33.292340+0000","last_clean":"2024-09-21T09:13:33.292340+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:13:33.292340+0000","last_undegraded":"2024-09-21T09:13:33.292340+0000","last_fullsized":"2024-09-21T09:13:33.292340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"66'13","reported_seq":220,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286863+0000","last_change":"2024-09-21T09:13:20.275872+0000","last_active":"2024-09-21T09:13:33.286863+0000","last_peered":"2024-09-21T09:13:33.286863+0000","last_clean":"2024-09-21T09:13:33.286863+0000","last_became_active":"2024-09-21T09:13:19.153073+0000","last_became_peered":"2024-09-21T09:13:19.153073+0000","last_unstale":"2024-09-21T09:13:33.286863+0000","last_undegraded":"2024-09-21T09:13:33.286863+0000","last_fullsized":"2024-09-21T09:13:33.286863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:51.699749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":134,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291462+0000","last_change":"2024-09-21T09:10:58.840930+0000","last_active":"2024-09-21T09:13:33.291462+0000","last_peered":"2024-09-21T09:13:33.291462+0000","last_clean":"2024-09-21T09:13:33.291462+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:13:33.291462+0000","last_undegraded":"2024-09-21T09:13:33.291462+0000","last_fullsized":"2024-09-21T09:13:33.291462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"67'13","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297144+0000","last_change":"2024-09-21T09:10:56.841366+0000","last_active":"2024-09-21T09:13:34.297144+0000","last_peered":"2024-09-21T09:13:34.297144+0000","last_clean":"2024-09-21T09:13:34.297144+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:13:34.297144+0000","last_undegraded":"2024-09-21T09:13:34.297144+0000","last_fullsized":"2024-09-21T09:13:34.297144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:15.948479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526167+0000","last_change":"2024-09-21T09:10:58.873865+0000","last_active":"2024-09-21T09:13:34.526167+0000","last_peered":"2024-09-21T09:13:34.526167+0000","last_clean":"2024-09-21T09:13:34.526167+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:13:34.526167+0000","last_undegraded":"2024-09-21T09:13:34.526167+0000","last_fullsized":"2024-09-21T09:13:34.526167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"67'5","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482963+0000","last_change":"2024-09-21T09:10:56.843359+0000","last_active":"2024-09-21T09:13:34.482963+0000","last_peered":"2024-09-21T09:13:34.482963+0000","last_clean":"2024-09-21T09:13:34.482963+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:13:34.482963+0000","last_undegraded":"2024-09-21T09:13:34.482963+0000","last_fullsized":"2024-09-21T09:13:34.482963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:17.126175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"71'4","reported_seq":147,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285718+0000","last_change":"2024-09-21T09:10:58.864268+0000","last_active":"2024-09-21T09:13:33.285718+0000","last_peered":"2024-09-21T09:13:33.285718+0000","last_clean":"2024-09-21T09:13:33.285718+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:13:33.285718+0000","last_undegraded":"2024-09-21T09:13:33.285718+0000","last_fullsized":"2024-09-21T09:13:33.285718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:22.929821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"66'10","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.528171+0000","last_change":"2024-09-21T09:13:19.704634+0000","last_active":"2024-09-21T09:13:34.528171+0000","last_peered":"2024-09-21T09:13:34.528171+0000","last_clean":"2024-09-21T09:13:34.528171+0000","last_became_active":"2024-09-21T09:13:19.159408+0000","last_became_peered":"2024-09-21T09:13:19.159408+0000","last_unstale":"2024-09-21T09:13:34.528171+0000","last_undegraded":"2024-09-21T09:13:34.528171+0000","last_fullsized":"2024-09-21T09:13:34.528171+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:49.771475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":149,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292265+0000","last_change":"2024-09-21T09:10:58.840040+0000","last_active":"2024-09-21T09:13:33.292265+0000","last_peered":"2024-09-21T09:13:33.292265+0000","last_clean":"2024-09-21T09:13:33.292265+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:13:33.292265+0000","last_undegraded":"2024-09-21T09:13:33.292265+0000","last_fullsized":"2024-09-21T09:13:33.292265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"66'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483406+0000","last_change":"2024-09-21T09:10:56.845828+0000","last_active":"2024-09-21T09:13:34.483406+0000","last_peered":"2024-09-21T09:13:34.483406+0000","last_clean":"2024-09-21T09:13:34.483406+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:13:34.483406+0000","last_undegraded":"2024-09-21T09:13:34.483406+0000","last_fullsized":"2024-09-21T09:13:34.483406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:37.489093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"67'8","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:13:20.828458+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:13:19.155182+0000","last_became_peered":"2024-09-21T09:13:19.155182+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:34.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287801+0000","last_change":"2024-09-21T09:10:58.871879+0000","last_active":"2024-09-21T09:13:33.287801+0000","last_peered":"2024-09-21T09:13:33.287801+0000","last_clean":"2024-09-21T09:13:33.287801+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:13:33.287801+0000","last_undegraded":"2024-09-21T09:13:33.287801+0000","last_fullsized":"2024-09-21T09:13:33.287801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:28.117298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"66'10","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955726+0000","last_change":"2024-09-21T09:10:56.862439+0000","last_active":"2024-09-21T09:13:34.955726+0000","last_peered":"2024-09-21T09:13:34.955726+0000","last_clean":"2024-09-21T09:13:34.955726+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:13:34.955726+0000","last_undegraded":"2024-09-21T09:13:34.955726+0000","last_fullsized":"2024-09-21T09:13:34.955726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"62'4","reported_seq":144,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293887+0000","last_change":"2024-09-21T09:10:58.828974+0000","last_active":"2024-09-21T09:13:33.293887+0000","last_peered":"2024-09-21T09:13:33.293887+0000","last_clean":"2024-09-21T09:13:33.293887+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:13:33.293887+0000","last_undegraded":"2024-09-21T09:13:33.293887+0000","last_fullsized":"2024-09-21T09:13:33.293887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":233,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":848,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":812,"ondisk_log_size":812,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":156302,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":813,"num_read_kb":575,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":660,"num_keys_recovered":24,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":272744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":545,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":23,"num_write":644,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":1149239296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384652,"kb_used_data":349304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93987188,"statfs":{"total":96636764160,"available":96242880512,"internally_reserved":0,"allocated":357687296,"data_stored":357174157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":511572,"kb_used_data":476224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93860268,"statfs":{"total":96636764160,"available":96112914432,"internally_reserved":0,"allocated":487653376,"data_stored":487144593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":790668,"kb_used_data":755316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93581172,"statfs":{"total":96636764160,"available":95827120128,"internally_reserved":0,"allocated":773443584,"data_stored":772934975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763532,"kb_used_data":728184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93608308,"statfs":{"total":96636764160,"available":95854907392,"internally_reserved":0,"allocated":745660416,"data_stored":745152324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":677440,"kb_used_data":642084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93694400,"statfs":{"total":96636764160,"available":95943065600,"internally_reserved":0,"allocated":657494016,"data_stored":657008169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":594152,"kb_used_data":558804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93777688,"statfs":{"total":96636764160,"available":96028352512,"internally_reserved":0,"allocated":572215296,"data_stored":571677178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":794296,"kb_used_data":758940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93577544,"statfs":{"total":96636764160,"available":95823405056,"internally_reserved":0,"allocated":777154560,"data_stored":776616419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462480,"kb_used_data":422964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93909360,"statfs":{"total":96636764160,"available":96163184640,"internally_reserved":0,"allocated":433115136,"data_stored":432605908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":775946240,"data_stored":775946240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":570425344,"data_stored":570425344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":656408576,"data_stored":656408576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":744488960,"data_stored":744488960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":432013312,"data_stored":432013312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":771751936,"data_stored":771751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":486539264,"data_stored":486539264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":356515840,"data_stored":356515840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":70250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":6483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":58451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:13:37.888 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:13:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:13:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:13:38.289 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-21T09:13:37.019138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397793038,"num_objects":773,"num_object_clones":0,"num_object_copies":1546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":773,"num_whiteouts":0,"num_read":2000,"num_read_kb":1716,"num_write":1739,"num_write_kb":2368151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":1149241676,"num_keys_recovered":26,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2521,"ondisk_log_size":2521,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4978792,"kb_used_data":4691820,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":749995928,"statfs":{"total":773094113280,"available":767995830272,"internally_reserved":0,"allocated":4804423680,"data_stored":4800313723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.774290"},"pg_stats":[{"pgid":"3.3f","version":"66'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299072+0000","last_change":"2024-09-21T09:10:56.846463+0000","last_active":"2024-09-21T09:13:34.299072+0000","last_peered":"2024-09-21T09:13:34.299072+0000","last_clean":"2024-09-21T09:13:34.299072+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:13:34.299072+0000","last_undegraded":"2024-09-21T09:13:34.299072+0000","last_fullsized":"2024-09-21T09:13:34.299072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"58'2","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291991+0000","last_change":"2024-09-21T09:10:58.836923+0000","last_active":"2024-09-21T09:13:33.291991+0000","last_peered":"2024-09-21T09:13:33.291991+0000","last_clean":"2024-09-21T09:13:33.291991+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:13:33.291991+0000","last_undegraded":"2024-09-21T09:13:33.291991+0000","last_fullsized":"2024-09-21T09:13:33.291991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:30.880333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"67'13","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957928+0000","last_change":"2024-09-21T09:10:56.865056+0000","last_active":"2024-09-21T09:13:34.957928+0000","last_peered":"2024-09-21T09:13:34.957928+0000","last_clean":"2024-09-21T09:13:34.957928+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:13:34.957928+0000","last_undegraded":"2024-09-21T09:13:34.957928+0000","last_fullsized":"2024-09-21T09:13:34.957928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482290+0000","last_change":"2024-09-21T09:10:58.835355+0000","last_active":"2024-09-21T09:13:34.482290+0000","last_peered":"2024-09-21T09:13:34.482290+0000","last_clean":"2024-09-21T09:13:34.482290+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:13:34.482290+0000","last_undegraded":"2024-09-21T09:13:34.482290+0000","last_fullsized":"2024-09-21T09:13:34.482290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:24.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"67'13","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957115+0000","last_change":"2024-09-21T09:10:56.861504+0000","last_active":"2024-09-21T09:13:34.957115+0000","last_peered":"2024-09-21T09:13:34.957115+0000","last_clean":"2024-09-21T09:13:34.957115+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:13:34.957115+0000","last_undegraded":"2024-09-21T09:13:34.957115+0000","last_fullsized":"2024-09-21T09:13:34.957115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:00.409267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482198+0000","last_change":"2024-09-21T09:13:19.490368+0000","last_active":"2024-09-21T09:13:34.482198+0000","last_peered":"2024-09-21T09:13:34.482198+0000","last_clean":"2024-09-21T09:13:34.482198+0000","last_became_active":"2024-09-21T09:13:19.153424+0000","last_became_peered":"2024-09-21T09:13:19.153424+0000","last_unstale":"2024-09-21T09:13:34.482198+0000","last_undegraded":"2024-09-21T09:13:34.482198+0000","last_fullsized":"2024-09-21T09:13:34.482198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:25.154789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"66'13","reported_seq":68,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298556+0000","last_change":"2024-09-21T09:13:20.586732+0000","last_active":"2024-09-21T09:13:34.298556+0000","last_peered":"2024-09-21T09:13:34.298556+0000","last_clean":"2024-09-21T09:13:34.298556+0000","last_became_active":"2024-09-21T09:13:19.165441+0000","last_became_peered":"2024-09-21T09:13:19.165441+0000","last_unstale":"2024-09-21T09:13:34.298556+0000","last_undegraded":"2024-09-21T09:13:34.298556+0000","last_fullsized":"2024-09-21T09:13:34.298556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:51.794446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"58'4","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286885+0000","last_change":"2024-09-21T09:13:20.643217+0000","last_active":"2024-09-21T09:13:33.286885+0000","last_peered":"2024-09-21T09:13:33.286885+0000","last_clean":"2024-09-21T09:13:33.286885+0000","last_became_active":"2024-09-21T09:13:19.153875+0000","last_became_peered":"2024-09-21T09:13:19.153875+0000","last_unstale":"2024-09-21T09:13:33.286885+0000","last_undegraded":"2024-09-21T09:13:33.286885+0000","last_fullsized":"2024-09-21T09:13:33.286885+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:03.004434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"67'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296553+0000","last_change":"2024-09-21T09:10:56.863607+0000","last_active":"2024-09-21T09:13:34.296553+0000","last_peered":"2024-09-21T09:13:34.296553+0000","last_clean":"2024-09-21T09:13:34.296553+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:13:34.296553+0000","last_undegraded":"2024-09-21T09:13:34.296553+0000","last_fullsized":"2024-09-21T09:13:34.296553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296333+0000","last_change":"2024-09-21T09:10:58.851357+0000","last_active":"2024-09-21T09:13:34.296333+0000","last_peered":"2024-09-21T09:13:34.296333+0000","last_clean":"2024-09-21T09:13:34.296333+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:13:34.296333+0000","last_undegraded":"2024-09-21T09:13:34.296333+0000","last_fullsized":"2024-09-21T09:13:34.296333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"66'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293642+0000","last_change":"2024-09-21T09:13:19.704935+0000","last_active":"2024-09-21T09:13:34.293642+0000","last_peered":"2024-09-21T09:13:34.293642+0000","last_clean":"2024-09-21T09:13:34.293642+0000","last_became_active":"2024-09-21T09:13:19.160915+0000","last_became_peered":"2024-09-21T09:13:19.160915+0000","last_unstale":"2024-09-21T09:13:34.293642+0000","last_undegraded":"2024-09-21T09:13:34.293642+0000","last_fullsized":"2024-09-21T09:13:34.293642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:00.863610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297928+0000","last_change":"2024-09-21T09:10:58.825880+0000","last_active":"2024-09-21T09:13:34.297928+0000","last_peered":"2024-09-21T09:13:34.297928+0000","last_clean":"2024-09-21T09:13:34.297928+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:13:34.297928+0000","last_undegraded":"2024-09-21T09:13:34.297928+0000","last_fullsized":"2024-09-21T09:13:34.297928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:46.662637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"66'5","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294804+0000","last_change":"2024-09-21T09:10:56.851331+0000","last_active":"2024-09-21T09:13:34.294804+0000","last_peered":"2024-09-21T09:13:34.294804+0000","last_clean":"2024-09-21T09:13:34.294804+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:13:34.294804+0000","last_undegraded":"2024-09-21T09:13:34.294804+0000","last_fullsized":"2024-09-21T09:13:34.294804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"62'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298620+0000","last_change":"2024-09-21T09:13:20.336460+0000","last_active":"2024-09-21T09:13:34.298620+0000","last_peered":"2024-09-21T09:13:34.298620+0000","last_clean":"2024-09-21T09:13:34.298620+0000","last_became_active":"2024-09-21T09:13:19.164775+0000","last_became_peered":"2024-09-21T09:13:19.164775+0000","last_unstale":"2024-09-21T09:13:34.298620+0000","last_undegraded":"2024-09-21T09:13:34.298620+0000","last_fullsized":"2024-09-21T09:13:34.298620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:16.166364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"67'11","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955584+0000","last_change":"2024-09-21T09:10:56.864409+0000","last_active":"2024-09-21T09:13:34.955584+0000","last_peered":"2024-09-21T09:13:34.955584+0000","last_clean":"2024-09-21T09:13:34.955584+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:13:34.955584+0000","last_undegraded":"2024-09-21T09:13:34.955584+0000","last_fullsized":"2024-09-21T09:13:34.955584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"62'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958533+0000","last_change":"2024-09-21T09:10:58.837006+0000","last_active":"2024-09-21T09:13:34.958533+0000","last_peered":"2024-09-21T09:13:34.958533+0000","last_clean":"2024-09-21T09:13:34.958533+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:13:34.958533+0000","last_undegraded":"2024-09-21T09:13:34.958533+0000","last_fullsized":"2024-09-21T09:13:34.958533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:52.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482026+0000","last_change":"2024-09-21T09:10:58.853249+0000","last_active":"2024-09-21T09:13:34.482026+0000","last_peered":"2024-09-21T09:13:34.482026+0000","last_clean":"2024-09-21T09:13:34.482026+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:13:34.482026+0000","last_undegraded":"2024-09-21T09:13:34.482026+0000","last_fullsized":"2024-09-21T09:13:34.482026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:03.692219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"66'11","reported_seq":149,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.294419+0000","last_change":"2024-09-21T09:10:56.838955+0000","last_active":"2024-09-21T09:13:33.294419+0000","last_peered":"2024-09-21T09:13:33.294419+0000","last_clean":"2024-09-21T09:13:33.294419+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:13:33.294419+0000","last_undegraded":"2024-09-21T09:13:33.294419+0000","last_fullsized":"2024-09-21T09:13:33.294419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294467+0000","last_change":"2024-09-21T09:10:58.869303+0000","last_active":"2024-09-21T09:13:34.294467+0000","last_peered":"2024-09-21T09:13:34.294467+0000","last_clean":"2024-09-21T09:13:34.294467+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:13:34.294467+0000","last_undegraded":"2024-09-21T09:13:34.294467+0000","last_fullsized":"2024-09-21T09:13:34.294467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"67'7","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298558+0000","last_change":"2024-09-21T09:13:21.021044+0000","last_active":"2024-09-21T09:13:34.298558+0000","last_peered":"2024-09-21T09:13:34.298558+0000","last_clean":"2024-09-21T09:13:34.298558+0000","last_became_active":"2024-09-21T09:13:19.154413+0000","last_became_peered":"2024-09-21T09:13:19.154413+0000","last_unstale":"2024-09-21T09:13:34.298558+0000","last_undegraded":"2024-09-21T09:13:34.298558+0000","last_fullsized":"2024-09-21T09:13:34.298558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'8","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292232+0000","last_change":"2024-09-21T09:10:58.840976+0000","last_active":"2024-09-21T09:13:33.292232+0000","last_peered":"2024-09-21T09:13:33.292232+0000","last_clean":"2024-09-21T09:13:33.292232+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:13:33.292232+0000","last_undegraded":"2024-09-21T09:13:33.292232+0000","last_fullsized":"2024-09-21T09:13:33.292232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"66'9","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298092+0000","last_change":"2024-09-21T09:10:56.853888+0000","last_active":"2024-09-21T09:13:34.298092+0000","last_peered":"2024-09-21T09:13:34.298092+0000","last_clean":"2024-09-21T09:13:34.298092+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:13:34.298092+0000","last_undegraded":"2024-09-21T09:13:34.298092+0000","last_fullsized":"2024-09-21T09:13:34.298092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294562+0000","last_change":"2024-09-21T09:10:58.838132+0000","last_active":"2024-09-21T09:13:34.294562+0000","last_peered":"2024-09-21T09:13:34.294562+0000","last_clean":"2024-09-21T09:13:34.294562+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:13:34.294562+0000","last_undegraded":"2024-09-21T09:13:34.294562+0000","last_fullsized":"2024-09-21T09:13:34.294562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"66'10","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296777+0000","last_change":"2024-09-21T09:10:56.845923+0000","last_active":"2024-09-21T09:13:34.296777+0000","last_peered":"2024-09-21T09:13:34.296777+0000","last_clean":"2024-09-21T09:13:34.296777+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:13:34.296777+0000","last_undegraded":"2024-09-21T09:13:34.296777+0000","last_fullsized":"2024-09-21T09:13:34.296777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'8","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956761+0000","last_change":"2024-09-21T09:10:58.848326+0000","last_active":"2024-09-21T09:13:34.956761+0000","last_peered":"2024-09-21T09:13:34.956761+0000","last_clean":"2024-09-21T09:13:34.956761+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:13:34.956761+0000","last_undegraded":"2024-09-21T09:13:34.956761+0000","last_fullsized":"2024-09-21T09:13:34.956761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:44.318321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"71'12","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295345+0000","last_change":"2024-09-21T09:10:56.859019+0000","last_active":"2024-09-21T09:13:34.295345+0000","last_peered":"2024-09-21T09:13:34.295345+0000","last_clean":"2024-09-21T09:13:34.295345+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:13:34.295345+0000","last_undegraded":"2024-09-21T09:13:34.295345+0000","last_fullsized":"2024-09-21T09:13:34.295345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"62'4","reported_seq":144,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292467+0000","last_change":"2024-09-21T09:10:58.830335+0000","last_active":"2024-09-21T09:13:33.292467+0000","last_peered":"2024-09-21T09:13:33.292467+0000","last_clean":"2024-09-21T09:13:33.292467+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:13:33.292467+0000","last_undegraded":"2024-09-21T09:13:33.292467+0000","last_fullsized":"2024-09-21T09:13:33.292467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"67'7","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294674+0000","last_change":"2024-09-21T09:10:56.862662+0000","last_active":"2024-09-21T09:13:34.294674+0000","last_peered":"2024-09-21T09:13:34.294674+0000","last_clean":"2024-09-21T09:13:34.294674+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:13:34.294674+0000","last_undegraded":"2024-09-21T09:13:34.294674+0000","last_fullsized":"2024-09-21T09:13:34.294674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295061+0000","last_change":"2024-09-21T09:11:06.898983+0000","last_active":"2024-09-21T09:13:34.295061+0000","last_peered":"2024-09-21T09:13:34.295061+0000","last_clean":"2024-09-21T09:13:34.295061+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:13:34.295061+0000","last_undegraded":"2024-09-21T09:13:34.295061+0000","last_fullsized":"2024-09-21T09:13:34.295061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294904+0000","last_change":"2024-09-21T09:10:58.876069+0000","last_active":"2024-09-21T09:13:34.294904+0000","last_peered":"2024-09-21T09:13:34.294904+0000","last_clean":"2024-09-21T09:13:34.294904+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:13:34.294904+0000","last_undegraded":"2024-09-21T09:13:34.294904+0000","last_fullsized":"2024-09-21T09:13:34.294904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"66'4","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482459+0000","last_change":"2024-09-21T09:10:56.848523+0000","last_active":"2024-09-21T09:13:34.482459+0000","last_peered":"2024-09-21T09:13:34.482459+0000","last_clean":"2024-09-21T09:13:34.482459+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:13:34.482459+0000","last_undegraded":"2024-09-21T09:13:34.482459+0000","last_fullsized":"2024-09-21T09:13:34.482459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:19.819608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483302+0000","last_change":"2024-09-21T09:11:00.842168+0000","last_active":"2024-09-21T09:13:34.483302+0000","last_peered":"2024-09-21T09:13:34.483302+0000","last_clean":"2024-09-21T09:13:34.483302+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:13:34.483302+0000","last_undegraded":"2024-09-21T09:13:34.483302+0000","last_fullsized":"2024-09-21T09:13:34.483302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:33.920548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"71'15","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287270+0000","last_change":"2024-09-21T09:11:02.866403+0000","last_active":"2024-09-21T09:13:33.287270+0000","last_peered":"2024-09-21T09:13:33.287270+0000","last_clean":"2024-09-21T09:13:33.287270+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:13:33.287270+0000","last_undegraded":"2024-09-21T09:13:33.287270+0000","last_fullsized":"2024-09-21T09:13:33.287270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:12.124539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291274+0000","last_change":"2024-09-21T09:11:04.894715+0000","last_active":"2024-09-21T09:13:33.291274+0000","last_peered":"2024-09-21T09:13:33.291274+0000","last_clean":"2024-09-21T09:13:33.291274+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:13:33.291274+0000","last_undegraded":"2024-09-21T09:13:33.291274+0000","last_fullsized":"2024-09-21T09:13:33.291274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:59.579572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"58'2","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293978+0000","last_change":"2024-09-21T09:11:06.885484+0000","last_active":"2024-09-21T09:13:33.293978+0000","last_peered":"2024-09-21T09:13:33.293978+0000","last_clean":"2024-09-21T09:13:33.293978+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:13:33.293978+0000","last_undegraded":"2024-09-21T09:13:33.293978+0000","last_fullsized":"2024-09-21T09:13:33.293978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:13.165470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"61'6","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483104+0000","last_change":"2024-09-21T09:10:58.842832+0000","last_active":"2024-09-21T09:13:34.483104+0000","last_peered":"2024-09-21T09:13:34.483104+0000","last_clean":"2024-09-21T09:13:34.483104+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:13:34.483104+0000","last_undegraded":"2024-09-21T09:13:34.483104+0000","last_fullsized":"2024-09-21T09:13:34.483104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:12.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:56.849428+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285845+0000","last_change":"2024-09-21T09:13:19.156069+0000","last_active":"2024-09-21T09:13:33.285845+0000","last_peered":"2024-09-21T09:13:33.285845+0000","last_clean":"2024-09-21T09:13:33.285845+0000","last_became_active":"2024-09-21T09:13:19.153940+0000","last_became_peered":"2024-09-21T09:13:19.153940+0000","last_unstale":"2024-09-21T09:13:33.285845+0000","last_undegraded":"2024-09-21T09:13:33.285845+0000","last_fullsized":"2024-09-21T09:13:33.285845+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:57.795849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":135,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293848+0000","last_change":"2024-09-21T09:11:02.866594+0000","last_active":"2024-09-21T09:13:33.293848+0000","last_peered":"2024-09-21T09:13:33.293848+0000","last_clean":"2024-09-21T09:13:33.293848+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:13:33.293848+0000","last_undegraded":"2024-09-21T09:13:33.293848+0000","last_fullsized":"2024-09-21T09:13:33.293848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292703+0000","last_change":"2024-09-21T09:11:04.887299+0000","last_active":"2024-09-21T09:13:33.292703+0000","last_peered":"2024-09-21T09:13:33.292703+0000","last_clean":"2024-09-21T09:13:33.292703+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:13:33.292703+0000","last_undegraded":"2024-09-21T09:13:33.292703+0000","last_fullsized":"2024-09-21T09:13:33.292703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:08.490686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":129,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294124+0000","last_change":"2024-09-21T09:13:19.145016+0000","last_active":"2024-09-21T09:13:34.294124+0000","last_peered":"2024-09-21T09:13:34.294124+0000","last_clean":"2024-09-21T09:13:34.294124+0000","last_became_active":"2024-09-21T09:13:19.144143+0000","last_became_peered":"2024-09-21T09:13:19.144143+0000","last_unstale":"2024-09-21T09:13:34.294124+0000","last_undegraded":"2024-09-21T09:13:34.294124+0000","last_fullsized":"2024-09-21T09:13:34.294124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957751+0000","last_change":"2024-09-21T09:10:58.851370+0000","last_active":"2024-09-21T09:13:34.957751+0000","last_peered":"2024-09-21T09:13:34.957751+0000","last_clean":"2024-09-21T09:13:34.957751+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:13:34.957751+0000","last_undegraded":"2024-09-21T09:13:34.957751+0000","last_fullsized":"2024-09-21T09:13:34.957751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:05.984687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"66'4","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482409+0000","last_change":"2024-09-21T09:13:21.119832+0000","last_active":"2024-09-21T09:13:34.482409+0000","last_peered":"2024-09-21T09:13:34.482409+0000","last_clean":"2024-09-21T09:13:34.482409+0000","last_became_active":"2024-09-21T09:13:19.159398+0000","last_became_peered":"2024-09-21T09:13:19.159398+0000","last_unstale":"2024-09-21T09:13:34.482409+0000","last_undegraded":"2024-09-21T09:13:34.482409+0000","last_fullsized":"2024-09-21T09:13:34.482409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:40.942331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287538+0000","last_change":"2024-09-21T09:11:00.845836+0000","last_active":"2024-09-21T09:13:33.287538+0000","last_peered":"2024-09-21T09:13:33.287538+0000","last_clean":"2024-09-21T09:13:33.287538+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:13:33.287538+0000","last_undegraded":"2024-09-21T09:13:33.287538+0000","last_fullsized":"2024-09-21T09:13:33.287538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:06.353993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":144,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285940+0000","last_change":"2024-09-21T09:11:02.852500+0000","last_active":"2024-09-21T09:13:33.285940+0000","last_peered":"2024-09-21T09:13:33.285940+0000","last_clean":"2024-09-21T09:13:33.285940+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:13:33.285940+0000","last_undegraded":"2024-09-21T09:13:33.285940+0000","last_fullsized":"2024-09-21T09:13:33.285940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:19.073540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"71'101","reported_seq":327,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483341+0000","last_change":"2024-09-21T09:11:04.895087+0000","last_active":"2024-09-21T09:13:34.483341+0000","last_peered":"2024-09-21T09:13:34.483341+0000","last_clean":"2024-09-21T09:13:34.483341+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:13:34.483341+0000","last_undegraded":"2024-09-21T09:13:34.483341+0000","last_fullsized":"2024-09-21T09:13:34.483341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:11.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295621+0000","last_change":"2024-09-21T09:13:19.162437+0000","last_active":"2024-09-21T09:13:34.295621+0000","last_peered":"2024-09-21T09:13:34.295621+0000","last_clean":"2024-09-21T09:13:34.295621+0000","last_became_active":"2024-09-21T09:13:19.161659+0000","last_became_peered":"2024-09-21T09:13:19.161659+0000","last_unstale":"2024-09-21T09:13:34.295621+0000","last_undegraded":"2024-09-21T09:13:34.295621+0000","last_fullsized":"2024-09-21T09:13:34.295621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:59.822101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958090+0000","last_change":"2024-09-21T09:10:58.837602+0000","last_active":"2024-09-21T09:13:34.958090+0000","last_peered":"2024-09-21T09:13:34.958090+0000","last_clean":"2024-09-21T09:13:34.958090+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:13:34.958090+0000","last_undegraded":"2024-09-21T09:13:34.958090+0000","last_fullsized":"2024-09-21T09:13:34.958090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:36.269116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"67'17","reported_seq":155,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292857+0000","last_change":"2024-09-21T09:10:56.844292+0000","last_active":"2024-09-21T09:13:33.292857+0000","last_peered":"2024-09-21T09:13:33.292857+0000","last_clean":"2024-09-21T09:13:33.292857+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:13:33.292857+0000","last_undegraded":"2024-09-21T09:13:33.292857+0000","last_fullsized":"2024-09-21T09:13:33.292857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482929+0000","last_change":"2024-09-21T09:11:00.852984+0000","last_active":"2024-09-21T09:13:34.482929+0000","last_peered":"2024-09-21T09:13:34.482929+0000","last_clean":"2024-09-21T09:13:34.482929+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:13:34.482929+0000","last_undegraded":"2024-09-21T09:13:34.482929+0000","last_fullsized":"2024-09-21T09:13:34.482929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:33.175145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"71'15","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299712+0000","last_change":"2024-09-21T09:13:19.543924+0000","last_active":"2024-09-21T09:13:34.299712+0000","last_peered":"2024-09-21T09:13:34.299712+0000","last_clean":"2024-09-21T09:13:34.299712+0000","last_became_active":"2024-09-21T09:13:19.160798+0000","last_became_peered":"2024-09-21T09:13:19.160798+0000","last_unstale":"2024-09-21T09:13:34.299712+0000","last_undegraded":"2024-09-21T09:13:34.299712+0000","last_fullsized":"2024-09-21T09:13:34.299712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"71'101","reported_seq":301,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956966+0000","last_change":"2024-09-21T09:11:04.894947+0000","last_active":"2024-09-21T09:13:34.956966+0000","last_peered":"2024-09-21T09:13:34.956966+0000","last_clean":"2024-09-21T09:13:34.956966+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:13:34.956966+0000","last_undegraded":"2024-09-21T09:13:34.956966+0000","last_fullsized":"2024-09-21T09:13:34.956966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:21.481386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482063+0000","last_change":"2024-09-21T09:10:58.841384+0000","last_active":"2024-09-21T09:13:34.482063+0000","last_peered":"2024-09-21T09:13:34.482063+0000","last_clean":"2024-09-21T09:13:34.482063+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:13:34.482063+0000","last_undegraded":"2024-09-21T09:13:34.482063+0000","last_fullsized":"2024-09-21T09:13:34.482063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:08.308265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"67'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299480+0000","last_change":"2024-09-21T09:10:56.846710+0000","last_active":"2024-09-21T09:13:34.299480+0000","last_peered":"2024-09-21T09:13:34.299480+0000","last_clean":"2024-09-21T09:13:34.299480+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:13:34.299480+0000","last_undegraded":"2024-09-21T09:13:34.299480+0000","last_fullsized":"2024-09-21T09:13:34.299480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":130,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.290582+0000","last_change":"2024-09-21T09:11:00.839560+0000","last_active":"2024-09-21T09:13:33.290582+0000","last_peered":"2024-09-21T09:13:33.290582+0000","last_clean":"2024-09-21T09:13:33.290582+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:13:33.290582+0000","last_undegraded":"2024-09-21T09:13:33.290582+0000","last_fullsized":"2024-09-21T09:13:33.290582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:41.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"71'26","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295964+0000","last_change":"2024-09-21T09:11:02.872323+0000","last_active":"2024-09-21T09:13:34.295964+0000","last_peered":"2024-09-21T09:13:34.295964+0000","last_clean":"2024-09-21T09:13:34.295964+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:13:34.295964+0000","last_undegraded":"2024-09-21T09:13:34.295964+0000","last_fullsized":"2024-09-21T09:13:34.295964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294211+0000","last_change":"2024-09-21T09:13:19.150862+0000","last_active":"2024-09-21T09:13:34.294211+0000","last_peered":"2024-09-21T09:13:34.294211+0000","last_clean":"2024-09-21T09:13:34.294211+0000","last_became_active":"2024-09-21T09:13:19.149936+0000","last_became_peered":"2024-09-21T09:13:19.149936+0000","last_unstale":"2024-09-21T09:13:34.294211+0000","last_undegraded":"2024-09-21T09:13:34.294211+0000","last_fullsized":"2024-09-21T09:13:34.294211+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.535171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"62'12","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298350+0000","last_change":"2024-09-21T09:13:20.340381+0000","last_active":"2024-09-21T09:13:34.298350+0000","last_peered":"2024-09-21T09:13:34.298350+0000","last_clean":"2024-09-21T09:13:34.298350+0000","last_became_active":"2024-09-21T09:13:19.165108+0000","last_became_peered":"2024-09-21T09:13:19.165108+0000","last_unstale":"2024-09-21T09:13:34.298350+0000","last_undegraded":"2024-09-21T09:13:34.298350+0000","last_fullsized":"2024-09-21T09:13:34.298350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:41.830217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.294230+0000","last_change":"2024-09-21T09:10:58.839960+0000","last_active":"2024-09-21T09:13:33.294230+0000","last_peered":"2024-09-21T09:13:33.294230+0000","last_clean":"2024-09-21T09:13:33.294230+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:13:33.294230+0000","last_undegraded":"2024-09-21T09:13:33.294230+0000","last_fullsized":"2024-09-21T09:13:33.294230+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"67'7","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298110+0000","last_change":"2024-09-21T09:13:20.333955+0000","last_active":"2024-09-21T09:13:34.298110+0000","last_peered":"2024-09-21T09:13:34.298110+0000","last_clean":"2024-09-21T09:13:34.298110+0000","last_became_active":"2024-09-21T09:13:19.162605+0000","last_became_peered":"2024-09-21T09:13:19.162605+0000","last_unstale":"2024-09-21T09:13:34.298110+0000","last_undegraded":"2024-09-21T09:13:34.298110+0000","last_fullsized":"2024-09-21T09:13:34.298110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:21.030407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293432+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.293432+0000","last_peered":"2024-09-21T09:13:34.293432+0000","last_clean":"2024-09-21T09:13:34.293432+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:13:34.293432+0000","last_undegraded":"2024-09-21T09:13:34.293432+0000","last_fullsized":"2024-09-21T09:13:34.293432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:48.669684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"71'16","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285608+0000","last_change":"2024-09-21T09:11:02.866165+0000","last_active":"2024-09-21T09:13:33.285608+0000","last_peered":"2024-09-21T09:13:33.285608+0000","last_clean":"2024-09-21T09:13:33.285608+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:13:33.285608+0000","last_undegraded":"2024-09-21T09:13:33.285608+0000","last_fullsized":"2024-09-21T09:13:33.285608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:54:48.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285336+0000","last_change":"2024-09-21T09:11:04.871999+0000","last_active":"2024-09-21T09:13:33.285336+0000","last_peered":"2024-09-21T09:13:33.285336+0000","last_clean":"2024-09-21T09:13:33.285336+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:13:33.285336+0000","last_undegraded":"2024-09-21T09:13:33.285336+0000","last_fullsized":"2024-09-21T09:13:33.285336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:03.218684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"58'2","reported_seq":138,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291130+0000","last_change":"2024-09-21T09:13:19.709890+0000","last_active":"2024-09-21T09:13:33.291130+0000","last_peered":"2024-09-21T09:13:33.291130+0000","last_clean":"2024-09-21T09:13:33.291130+0000","last_became_active":"2024-09-21T09:13:19.167145+0000","last_became_peered":"2024-09-21T09:13:19.167145+0000","last_unstale":"2024-09-21T09:13:33.291130+0000","last_undegraded":"2024-09-21T09:13:33.291130+0000","last_fullsized":"2024-09-21T09:13:33.291130+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294491+0000","last_change":"2024-09-21T09:13:19.528866+0000","last_active":"2024-09-21T09:13:34.294491+0000","last_peered":"2024-09-21T09:13:34.294491+0000","last_clean":"2024-09-21T09:13:34.294491+0000","last_became_active":"2024-09-21T09:13:19.158113+0000","last_became_peered":"2024-09-21T09:13:19.158113+0000","last_unstale":"2024-09-21T09:13:34.294491+0000","last_undegraded":"2024-09-21T09:13:34.294491+0000","last_fullsized":"2024-09-21T09:13:34.294491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:48.503141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"66'18","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482839+0000","last_change":"2024-09-21T09:10:56.842697+0000","last_active":"2024-09-21T09:13:34.482839+0000","last_peered":"2024-09-21T09:13:34.482839+0000","last_clean":"2024-09-21T09:13:34.482839+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:13:34.482839+0000","last_undegraded":"2024-09-21T09:13:34.482839+0000","last_fullsized":"2024-09-21T09:13:34.482839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:42.311166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957018+0000","last_change":"2024-09-21T09:11:00.852970+0000","last_active":"2024-09-21T09:13:34.957018+0000","last_peered":"2024-09-21T09:13:34.957018+0000","last_clean":"2024-09-21T09:13:34.957018+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:13:34.957018+0000","last_undegraded":"2024-09-21T09:13:34.957018+0000","last_fullsized":"2024-09-21T09:13:34.957018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:35.201984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"71'21","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481917+0000","last_change":"2024-09-21T09:11:02.859081+0000","last_active":"2024-09-21T09:13:34.481917+0000","last_peered":"2024-09-21T09:13:34.481917+0000","last_clean":"2024-09-21T09:13:34.481917+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:13:34.481917+0000","last_undegraded":"2024-09-21T09:13:34.481917+0000","last_fullsized":"2024-09-21T09:13:34.481917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:19.576627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"71'101","reported_seq":256,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955287+0000","last_change":"2024-09-21T09:11:04.895980+0000","last_active":"2024-09-21T09:13:34.955287+0000","last_peered":"2024-09-21T09:13:34.955287+0000","last_clean":"2024-09-21T09:13:34.955287+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:13:34.955287+0000","last_undegraded":"2024-09-21T09:13:34.955287+0000","last_fullsized":"2024-09-21T09:13:34.955287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:57.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295156+0000","last_change":"2024-09-21T09:13:20.635132+0000","last_active":"2024-09-21T09:13:34.295156+0000","last_peered":"2024-09-21T09:13:34.295156+0000","last_clean":"2024-09-21T09:13:34.295156+0000","last_became_active":"2024-09-21T09:13:19.159646+0000","last_became_peered":"2024-09-21T09:13:19.159646+0000","last_unstale":"2024-09-21T09:13:34.295156+0000","last_undegraded":"2024-09-21T09:13:34.295156+0000","last_fullsized":"2024-09-21T09:13:34.295156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:10.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956296+0000","last_change":"2024-09-21T09:10:58.871951+0000","last_active":"2024-09-21T09:13:34.956296+0000","last_peered":"2024-09-21T09:13:34.956296+0000","last_clean":"2024-09-21T09:13:34.956296+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:13:34.956296+0000","last_undegraded":"2024-09-21T09:13:34.956296+0000","last_fullsized":"2024-09-21T09:13:34.956296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:16.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"66'7","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297543+0000","last_change":"2024-09-21T09:10:56.855073+0000","last_active":"2024-09-21T09:13:34.297543+0000","last_peered":"2024-09-21T09:13:34.297543+0000","last_clean":"2024-09-21T09:13:34.297543+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:13:34.297543+0000","last_undegraded":"2024-09-21T09:13:34.297543+0000","last_fullsized":"2024-09-21T09:13:34.297543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:43.818365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294089+0000","last_change":"2024-09-21T09:11:00.845552+0000","last_active":"2024-09-21T09:13:34.294089+0000","last_peered":"2024-09-21T09:13:34.294089+0000","last_clean":"2024-09-21T09:13:34.294089+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:13:34.294089+0000","last_undegraded":"2024-09-21T09:13:34.294089+0000","last_fullsized":"2024-09-21T09:13:34.294089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:44.841947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"71'24","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.284864+0000","last_change":"2024-09-21T09:11:02.868260+0000","last_active":"2024-09-21T09:13:33.284864+0000","last_peered":"2024-09-21T09:13:33.284864+0000","last_clean":"2024-09-21T09:13:33.284864+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:13:33.284864+0000","last_undegraded":"2024-09-21T09:13:33.284864+0000","last_fullsized":"2024-09-21T09:13:33.284864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:38.299285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955882+0000","last_change":"2024-09-21T09:11:04.890815+0000","last_active":"2024-09-21T09:13:34.955882+0000","last_peered":"2024-09-21T09:13:34.955882+0000","last_clean":"2024-09-21T09:13:34.955882+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:13:34.955882+0000","last_undegraded":"2024-09-21T09:13:34.955882+0000","last_fullsized":"2024-09-21T09:13:34.955882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:26.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527522+0000","last_change":"2024-09-21T09:11:06.888148+0000","last_active":"2024-09-21T09:13:34.527522+0000","last_peered":"2024-09-21T09:13:34.527522+0000","last_clean":"2024-09-21T09:13:34.527522+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:13:34.527522+0000","last_undegraded":"2024-09-21T09:13:34.527522+0000","last_fullsized":"2024-09-21T09:13:34.527522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296971+0000","last_change":"2024-09-21T09:10:58.871840+0000","last_active":"2024-09-21T09:13:34.296971+0000","last_peered":"2024-09-21T09:13:34.296971+0000","last_clean":"2024-09-21T09:13:34.296971+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:13:34.296971+0000","last_undegraded":"2024-09-21T09:13:34.296971+0000","last_fullsized":"2024-09-21T09:13:34.296971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"67'7","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526772+0000","last_change":"2024-09-21T09:10:56.855886+0000","last_active":"2024-09-21T09:13:34.526772+0000","last_peered":"2024-09-21T09:13:34.526772+0000","last_clean":"2024-09-21T09:13:34.526772+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:13:34.526772+0000","last_undegraded":"2024-09-21T09:13:34.526772+0000","last_fullsized":"2024-09-21T09:13:34.526772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526968+0000","last_change":"2024-09-21T09:11:00.850308+0000","last_active":"2024-09-21T09:13:34.526968+0000","last_peered":"2024-09-21T09:13:34.526968+0000","last_clean":"2024-09-21T09:13:34.526968+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:13:34.526968+0000","last_undegraded":"2024-09-21T09:13:34.526968+0000","last_fullsized":"2024-09-21T09:13:34.526968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:13.608546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"71'17","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293192+0000","last_change":"2024-09-21T09:11:02.866122+0000","last_active":"2024-09-21T09:13:33.293192+0000","last_peered":"2024-09-21T09:13:33.293192+0000","last_clean":"2024-09-21T09:13:33.293192+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:13:33.293192+0000","last_undegraded":"2024-09-21T09:13:33.293192+0000","last_fullsized":"2024-09-21T09:13:33.293192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527462+0000","last_change":"2024-09-21T09:11:04.880608+0000","last_active":"2024-09-21T09:13:34.527462+0000","last_peered":"2024-09-21T09:13:34.527462+0000","last_clean":"2024-09-21T09:13:34.527462+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:13:34.527462+0000","last_undegraded":"2024-09-21T09:13:34.527462+0000","last_fullsized":"2024-09-21T09:13:34.527462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:39.226968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955061+0000","last_change":"2024-09-21T09:11:06.892201+0000","last_active":"2024-09-21T09:13:34.955061+0000","last_peered":"2024-09-21T09:13:34.955061+0000","last_clean":"2024-09-21T09:13:34.955061+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:13:34.955061+0000","last_undegraded":"2024-09-21T09:13:34.955061+0000","last_fullsized":"2024-09-21T09:13:34.955061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:32.463353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483248+0000","last_change":"2024-09-21T09:10:58.838223+0000","last_active":"2024-09-21T09:13:34.483248+0000","last_peered":"2024-09-21T09:13:34.483248+0000","last_clean":"2024-09-21T09:13:34.483248+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:13:34.483248+0000","last_undegraded":"2024-09-21T09:13:34.483248+0000","last_fullsized":"2024-09-21T09:13:34.483248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:01.253234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"67'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482527+0000","last_change":"2024-09-21T09:10:56.841106+0000","last_active":"2024-09-21T09:13:34.482527+0000","last_peered":"2024-09-21T09:13:34.482527+0000","last_clean":"2024-09-21T09:13:34.482527+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:13:34.482527+0000","last_undegraded":"2024-09-21T09:13:34.482527+0000","last_fullsized":"2024-09-21T09:13:34.482527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:40.827746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956508+0000","last_change":"2024-09-21T09:11:00.841164+0000","last_active":"2024-09-21T09:13:34.956508+0000","last_peered":"2024-09-21T09:13:34.956508+0000","last_clean":"2024-09-21T09:13:34.956508+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:13:34.956508+0000","last_undegraded":"2024-09-21T09:13:34.956508+0000","last_fullsized":"2024-09-21T09:13:34.956508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:05.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"71'23","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957641+0000","last_change":"2024-09-21T09:11:02.852292+0000","last_active":"2024-09-21T09:13:34.957641+0000","last_peered":"2024-09-21T09:13:34.957641+0000","last_clean":"2024-09-21T09:13:34.957641+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:13:34.957641+0000","last_undegraded":"2024-09-21T09:13:34.957641+0000","last_fullsized":"2024-09-21T09:13:34.957641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:12.322229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"71'101","reported_seq":295,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527407+0000","last_change":"2024-09-21T09:11:04.892391+0000","last_active":"2024-09-21T09:13:34.527407+0000","last_peered":"2024-09-21T09:13:34.527407+0000","last_clean":"2024-09-21T09:13:34.527407+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:13:34.527407+0000","last_undegraded":"2024-09-21T09:13:34.527407+0000","last_fullsized":"2024-09-21T09:13:34.527407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:52.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293567+0000","last_change":"2024-09-21T09:11:06.883898+0000","last_active":"2024-09-21T09:13:34.293567+0000","last_peered":"2024-09-21T09:13:34.293567+0000","last_clean":"2024-09-21T09:13:34.293567+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:13:34.293567+0000","last_undegraded":"2024-09-21T09:13:34.293567+0000","last_fullsized":"2024-09-21T09:13:34.293567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298809+0000","last_change":"2024-09-21T09:13:20.217794+0000","last_active":"2024-09-21T09:13:34.298809+0000","last_peered":"2024-09-21T09:13:34.298809+0000","last_clean":"2024-09-21T09:13:34.298809+0000","last_became_active":"2024-09-21T09:13:19.161819+0000","last_became_peered":"2024-09-21T09:13:19.161819+0000","last_unstale":"2024-09-21T09:13:34.298809+0000","last_undegraded":"2024-09-21T09:13:34.298809+0000","last_fullsized":"2024-09-21T09:13:34.298809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:41.176970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"67'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482438+0000","last_change":"2024-09-21T09:10:56.844590+0000","last_active":"2024-09-21T09:13:34.482438+0000","last_peered":"2024-09-21T09:13:34.482438+0000","last_clean":"2024-09-21T09:13:34.482438+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:13:34.482438+0000","last_undegraded":"2024-09-21T09:13:34.482438+0000","last_fullsized":"2024-09-21T09:13:34.482438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:20.839825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":266,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.290719+0000","last_change":"2024-09-21T09:11:00.839056+0000","last_active":"2024-09-21T09:13:33.290719+0000","last_peered":"2024-09-21T09:13:33.290719+0000","last_clean":"2024-09-21T09:13:33.290719+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:13:33.290719+0000","last_undegraded":"2024-09-21T09:13:33.290719+0000","last_fullsized":"2024-09-21T09:13:33.290719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:07.991734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"65'11","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294566+0000","last_change":"2024-09-21T09:11:02.876439+0000","last_active":"2024-09-21T09:13:34.294566+0000","last_peered":"2024-09-21T09:13:34.294566+0000","last_clean":"2024-09-21T09:13:34.294566+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:13:34.294566+0000","last_undegraded":"2024-09-21T09:13:34.294566+0000","last_fullsized":"2024-09-21T09:13:34.294566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"71'101","reported_seq":307,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292393+0000","last_change":"2024-09-21T09:11:04.884790+0000","last_active":"2024-09-21T09:13:33.292393+0000","last_peered":"2024-09-21T09:13:33.292393+0000","last_clean":"2024-09-21T09:13:33.292393+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:13:33.292393+0000","last_undegraded":"2024-09-21T09:13:33.292393+0000","last_fullsized":"2024-09-21T09:13:33.292393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:00.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294059+0000","last_change":"2024-09-21T09:13:19.158996+0000","last_active":"2024-09-21T09:13:34.294059+0000","last_peered":"2024-09-21T09:13:34.294059+0000","last_clean":"2024-09-21T09:13:34.294059+0000","last_became_active":"2024-09-21T09:13:19.139533+0000","last_became_peered":"2024-09-21T09:13:19.139533+0000","last_unstale":"2024-09-21T09:13:34.294059+0000","last_undegraded":"2024-09-21T09:13:34.294059+0000","last_fullsized":"2024-09-21T09:13:34.294059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:03.695046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527899+0000","last_change":"2024-09-21T09:10:58.873730+0000","last_active":"2024-09-21T09:13:34.527899+0000","last_peered":"2024-09-21T09:13:34.527899+0000","last_clean":"2024-09-21T09:13:34.527899+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:13:34.527899+0000","last_undegraded":"2024-09-21T09:13:34.527899+0000","last_fullsized":"2024-09-21T09:13:34.527899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"67'2","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286334+0000","last_change":"2024-09-21T09:10:56.849104+0000","last_active":"2024-09-21T09:13:33.286334+0000","last_peered":"2024-09-21T09:13:33.286334+0000","last_clean":"2024-09-21T09:13:33.286334+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:13:33.286334+0000","last_undegraded":"2024-09-21T09:13:33.286334+0000","last_fullsized":"2024-09-21T09:13:33.286334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:34.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483039+0000","last_change":"2024-09-21T09:11:00.841893+0000","last_active":"2024-09-21T09:13:34.483039+0000","last_peered":"2024-09-21T09:13:34.483039+0000","last_clean":"2024-09-21T09:13:34.483039+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:13:34.483039+0000","last_undegraded":"2024-09-21T09:13:34.483039+0000","last_fullsized":"2024-09-21T09:13:34.483039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:55.253483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"71'23","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291929+0000","last_change":"2024-09-21T09:11:02.867833+0000","last_active":"2024-09-21T09:13:33.291929+0000","last_peered":"2024-09-21T09:13:33.291929+0000","last_clean":"2024-09-21T09:13:33.291929+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:13:33.291929+0000","last_undegraded":"2024-09-21T09:13:33.291929+0000","last_fullsized":"2024-09-21T09:13:33.291929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298750+0000","last_change":"2024-09-21T09:13:19.166139+0000","last_active":"2024-09-21T09:13:34.298750+0000","last_peered":"2024-09-21T09:13:34.298750+0000","last_clean":"2024-09-21T09:13:34.298750+0000","last_became_active":"2024-09-21T09:13:19.164969+0000","last_became_peered":"2024-09-21T09:13:19.164969+0000","last_unstale":"2024-09-21T09:13:34.298750+0000","last_undegraded":"2024-09-21T09:13:34.298750+0000","last_fullsized":"2024-09-21T09:13:34.298750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:05.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"62'12","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526114+0000","last_change":"2024-09-21T09:11:06.883751+0000","last_active":"2024-09-21T09:13:34.526114+0000","last_peered":"2024-09-21T09:13:34.526114+0000","last_clean":"2024-09-21T09:13:34.526114+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:13:34.526114+0000","last_undegraded":"2024-09-21T09:13:34.526114+0000","last_fullsized":"2024-09-21T09:13:34.526114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:09.296705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482855+0000","last_change":"2024-09-21T09:10:58.838888+0000","last_active":"2024-09-21T09:13:34.482855+0000","last_peered":"2024-09-21T09:13:34.482855+0000","last_clean":"2024-09-21T09:13:34.482855+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:13:34.482855+0000","last_undegraded":"2024-09-21T09:13:34.482855+0000","last_fullsized":"2024-09-21T09:13:34.482855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:53.547541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":302,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293123+0000","last_change":"2024-09-21T09:10:44.726458+0000","last_active":"2024-09-21T09:13:33.293123+0000","last_peered":"2024-09-21T09:13:33.293123+0000","last_clean":"2024-09-21T09:13:33.293123+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:13:33.293123+0000","last_undegraded":"2024-09-21T09:13:33.293123+0000","last_fullsized":"2024-09-21T09:13:33.293123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_clean_scrub_stamp":"2024-09-21T09:10:43.702491+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:07.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482574+0000","last_change":"2024-09-21T09:13:20.381044+0000","last_active":"2024-09-21T09:13:34.482574+0000","last_peered":"2024-09-21T09:13:34.482574+0000","last_clean":"2024-09-21T09:13:34.482574+0000","last_became_active":"2024-09-21T09:13:19.155065+0000","last_became_peered":"2024-09-21T09:13:19.155065+0000","last_unstale":"2024-09-21T09:13:34.482574+0000","last_undegraded":"2024-09-21T09:13:34.482574+0000","last_fullsized":"2024-09-21T09:13:34.482574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:51.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":202,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286594+0000","last_change":"2024-09-21T09:13:19.483993+0000","last_active":"2024-09-21T09:13:33.286594+0000","last_peered":"2024-09-21T09:13:33.286594+0000","last_clean":"2024-09-21T09:13:33.286594+0000","last_became_active":"2024-09-21T09:13:19.152677+0000","last_became_peered":"2024-09-21T09:13:19.152677+0000","last_unstale":"2024-09-21T09:13:33.286594+0000","last_undegraded":"2024-09-21T09:13:33.286594+0000","last_fullsized":"2024-09-21T09:13:33.286594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:26.411630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:11:00.845448+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"71'33","reported_seq":175,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483133+0000","last_change":"2024-09-21T09:11:02.863275+0000","last_active":"2024-09-21T09:13:34.483133+0000","last_peered":"2024-09-21T09:13:34.483133+0000","last_clean":"2024-09-21T09:13:34.483133+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:13:34.483133+0000","last_undegraded":"2024-09-21T09:13:34.483133+0000","last_fullsized":"2024-09-21T09:13:34.483133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:39.968749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4873,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957584+0000","last_change":"2024-09-21T09:11:04.894538+0000","last_active":"2024-09-21T09:13:34.957584+0000","last_peered":"2024-09-21T09:13:34.957584+0000","last_clean":"2024-09-21T09:13:34.957584+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:13:34.957584+0000","last_undegraded":"2024-09-21T09:13:34.957584+0000","last_fullsized":"2024-09-21T09:13:34.957584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.154030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"71'6","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294223+0000","last_change":"2024-09-21T09:13:19.487021+0000","last_active":"2024-09-21T09:13:34.294223+0000","last_peered":"2024-09-21T09:13:34.294223+0000","last_clean":"2024-09-21T09:13:34.294223+0000","last_became_active":"2024-09-21T09:13:19.153438+0000","last_became_peered":"2024-09-21T09:13:19.153438+0000","last_unstale":"2024-09-21T09:13:34.294223+0000","last_undegraded":"2024-09-21T09:13:34.294223+0000","last_fullsized":"2024-09-21T09:13:34.294223+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:22.759172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":422,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957786+0000","last_change":"2024-09-21T09:10:58.855489+0000","last_active":"2024-09-21T09:13:34.957786+0000","last_peered":"2024-09-21T09:13:34.957786+0000","last_clean":"2024-09-21T09:13:34.957786+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:13:34.957786+0000","last_undegraded":"2024-09-21T09:13:34.957786+0000","last_fullsized":"2024-09-21T09:13:34.957786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:04.859633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482280+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:13:34.482280+0000","last_peered":"2024-09-21T09:13:34.482280+0000","last_clean":"2024-09-21T09:13:34.482280+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:13:34.482280+0000","last_undegraded":"2024-09-21T09:13:34.482280+0000","last_fullsized":"2024-09-21T09:13:34.482280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:09.405380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"66'7","reported_seq":188,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294349+0000","last_change":"2024-09-21T09:13:19.304956+0000","last_active":"2024-09-21T09:13:34.294349+0000","last_peered":"2024-09-21T09:13:34.294349+0000","last_clean":"2024-09-21T09:13:34.294349+0000","last_became_active":"2024-09-21T09:13:19.142666+0000","last_became_peered":"2024-09-21T09:13:19.142666+0000","last_unstale":"2024-09-21T09:13:34.294349+0000","last_undegraded":"2024-09-21T09:13:34.294349+0000","last_fullsized":"2024-09-21T09:13:34.294349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:08.103741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483007+0000","last_change":"2024-09-21T09:11:00.845917+0000","last_active":"2024-09-21T09:13:34.483007+0000","last_peered":"2024-09-21T09:13:34.483007+0000","last_clean":"2024-09-21T09:13:34.483007+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:13:34.483007+0000","last_undegraded":"2024-09-21T09:13:34.483007+0000","last_fullsized":"2024-09-21T09:13:34.483007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:59.152254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"71'108","reported_seq":318,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526731+0000","last_change":"2024-09-21T09:11:02.871422+0000","last_active":"2024-09-21T09:13:34.526731+0000","last_peered":"2024-09-21T09:13:34.526731+0000","last_clean":"2024-09-21T09:13:34.526731+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:13:34.526731+0000","last_undegraded":"2024-09-21T09:13:34.526731+0000","last_fullsized":"2024-09-21T09:13:34.526731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:57.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61997,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":28,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483210+0000","last_change":"2024-09-21T09:11:04.893734+0000","last_active":"2024-09-21T09:13:34.483210+0000","last_peered":"2024-09-21T09:13:34.483210+0000","last_clean":"2024-09-21T09:13:34.483210+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:34.483210+0000","last_undegraded":"2024-09-21T09:13:34.483210+0000","last_fullsized":"2024-09-21T09:13:34.483210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.709917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"58'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955754+0000","last_change":"2024-09-21T09:11:06.895362+0000","last_active":"2024-09-21T09:13:34.955754+0000","last_peered":"2024-09-21T09:13:34.955754+0000","last_clean":"2024-09-21T09:13:34.955754+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:13:34.955754+0000","last_undegraded":"2024-09-21T09:13:34.955754+0000","last_fullsized":"2024-09-21T09:13:34.955754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:23.606134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:10:58.831552+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526089+0000","last_change":"2024-09-21T09:10:51.587265+0000","last_active":"2024-09-21T09:13:34.526089+0000","last_peered":"2024-09-21T09:13:34.526089+0000","last_clean":"2024-09-21T09:13:34.526089+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:13:34.526089+0000","last_undegraded":"2024-09-21T09:13:34.526089+0000","last_fullsized":"2024-09-21T09:13:34.526089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"66'11","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955635+0000","last_change":"2024-09-21T09:10:56.866005+0000","last_active":"2024-09-21T09:13:34.955635+0000","last_peered":"2024-09-21T09:13:34.955635+0000","last_clean":"2024-09-21T09:13:34.955635+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:13:34.955635+0000","last_undegraded":"2024-09-21T09:13:34.955635+0000","last_fullsized":"2024-09-21T09:13:34.955635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527710+0000","last_change":"2024-09-21T09:11:00.850206+0000","last_active":"2024-09-21T09:13:34.527710+0000","last_peered":"2024-09-21T09:13:34.527710+0000","last_clean":"2024-09-21T09:13:34.527710+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:13:34.527710+0000","last_undegraded":"2024-09-21T09:13:34.527710+0000","last_fullsized":"2024-09-21T09:13:34.527710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:26.137691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297661+0000","last_change":"2024-09-21T09:11:02.873117+0000","last_active":"2024-09-21T09:13:34.297661+0000","last_peered":"2024-09-21T09:13:34.297661+0000","last_clean":"2024-09-21T09:13:34.297661+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:13:34.297661+0000","last_undegraded":"2024-09-21T09:13:34.297661+0000","last_fullsized":"2024-09-21T09:13:34.297661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286345+0000","last_change":"2024-09-21T09:11:04.873369+0000","last_active":"2024-09-21T09:13:33.286345+0000","last_peered":"2024-09-21T09:13:33.286345+0000","last_clean":"2024-09-21T09:13:33.286345+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:13:33.286345+0000","last_undegraded":"2024-09-21T09:13:33.286345+0000","last_fullsized":"2024-09-21T09:13:33.286345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.868816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285253+0000","last_change":"2024-09-21T09:11:06.896298+0000","last_active":"2024-09-21T09:13:33.285253+0000","last_peered":"2024-09-21T09:13:33.285253+0000","last_clean":"2024-09-21T09:13:33.285253+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:13:33.285253+0000","last_undegraded":"2024-09-21T09:13:33.285253+0000","last_fullsized":"2024-09-21T09:13:33.285253+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:42.784843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"58'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:58.838558+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482642+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:13:34.482642+0000","last_peered":"2024-09-21T09:13:34.482642+0000","last_clean":"2024-09-21T09:13:34.482642+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:13:34.482642+0000","last_undegraded":"2024-09-21T09:13:34.482642+0000","last_fullsized":"2024-09-21T09:13:34.482642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:07.894252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"66'7","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296736+0000","last_change":"2024-09-21T09:13:20.378657+0000","last_active":"2024-09-21T09:13:34.296736+0000","last_peered":"2024-09-21T09:13:34.296736+0000","last_clean":"2024-09-21T09:13:34.296736+0000","last_became_active":"2024-09-21T09:13:19.153710+0000","last_became_peered":"2024-09-21T09:13:19.153710+0000","last_unstale":"2024-09-21T09:13:34.296736+0000","last_undegraded":"2024-09-21T09:13:34.296736+0000","last_fullsized":"2024-09-21T09:13:34.296736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526975+0000","last_change":"2024-09-21T09:11:00.852944+0000","last_active":"2024-09-21T09:13:34.526975+0000","last_peered":"2024-09-21T09:13:34.526975+0000","last_clean":"2024-09-21T09:13:34.526975+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:13:34.526975+0000","last_undegraded":"2024-09-21T09:13:34.526975+0000","last_fullsized":"2024-09-21T09:13:34.526975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:24.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.954874+0000","last_change":"2024-09-21T09:11:02.856485+0000","last_active":"2024-09-21T09:13:34.954874+0000","last_peered":"2024-09-21T09:13:34.954874+0000","last_clean":"2024-09-21T09:13:34.954874+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:13:34.954874+0000","last_undegraded":"2024-09-21T09:13:34.954874+0000","last_fullsized":"2024-09-21T09:13:34.954874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:05.267197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483296+0000","last_change":"2024-09-21T09:11:04.880602+0000","last_active":"2024-09-21T09:13:34.483296+0000","last_peered":"2024-09-21T09:13:34.483296+0000","last_clean":"2024-09-21T09:13:34.483296+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:13:34.483296+0000","last_undegraded":"2024-09-21T09:13:34.483296+0000","last_fullsized":"2024-09-21T09:13:34.483296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:56.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"62'4","reported_seq":123,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.290729+0000","last_change":"2024-09-21T09:11:06.869065+0000","last_active":"2024-09-21T09:13:33.290729+0000","last_peered":"2024-09-21T09:13:33.290729+0000","last_clean":"2024-09-21T09:13:33.290729+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:13:33.290729+0000","last_undegraded":"2024-09-21T09:13:33.290729+0000","last_fullsized":"2024-09-21T09:13:33.290729+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:28.667296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"71'12","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294295+0000","last_change":"2024-09-21T09:10:58.846835+0000","last_active":"2024-09-21T09:13:34.294295+0000","last_peered":"2024-09-21T09:13:34.294295+0000","last_clean":"2024-09-21T09:13:34.294295+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:13:34.294295+0000","last_undegraded":"2024-09-21T09:13:34.294295+0000","last_fullsized":"2024-09-21T09:13:34.294295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"66'10","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299651+0000","last_change":"2024-09-21T09:13:19.380704+0000","last_active":"2024-09-21T09:13:34.299651+0000","last_peered":"2024-09-21T09:13:34.299651+0000","last_clean":"2024-09-21T09:13:34.299651+0000","last_became_active":"2024-09-21T09:13:19.142534+0000","last_became_peered":"2024-09-21T09:13:19.142534+0000","last_unstale":"2024-09-21T09:13:34.299651+0000","last_undegraded":"2024-09-21T09:13:34.299651+0000","last_fullsized":"2024-09-21T09:13:34.299651+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957216+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:13:34.957216+0000","last_peered":"2024-09-21T09:13:34.957216+0000","last_clean":"2024-09-21T09:13:34.957216+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:13:34.957216+0000","last_undegraded":"2024-09-21T09:13:34.957216+0000","last_fullsized":"2024-09-21T09:13:34.957216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285944+0000","last_change":"2024-09-21T09:11:00.855241+0000","last_active":"2024-09-21T09:13:33.285944+0000","last_peered":"2024-09-21T09:13:33.285944+0000","last_clean":"2024-09-21T09:13:33.285944+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:13:33.285944+0000","last_undegraded":"2024-09-21T09:13:33.285944+0000","last_fullsized":"2024-09-21T09:13:33.285944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:56:14.401301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"71'30","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525679+0000","last_change":"2024-09-21T09:11:02.864623+0000","last_active":"2024-09-21T09:13:34.525679+0000","last_peered":"2024-09-21T09:13:34.525679+0000","last_clean":"2024-09-21T09:13:34.525679+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:13:34.525679+0000","last_undegraded":"2024-09-21T09:13:34.525679+0000","last_fullsized":"2024-09-21T09:13:34.525679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:12.141735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297500+0000","last_change":"2024-09-21T09:13:19.146039+0000","last_active":"2024-09-21T09:13:34.297500+0000","last_peered":"2024-09-21T09:13:34.297500+0000","last_clean":"2024-09-21T09:13:34.297500+0000","last_became_active":"2024-09-21T09:13:19.145677+0000","last_became_peered":"2024-09-21T09:13:19.145677+0000","last_unstale":"2024-09-21T09:13:34.297500+0000","last_undegraded":"2024-09-21T09:13:34.297500+0000","last_fullsized":"2024-09-21T09:13:34.297500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:04.909499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"62'4","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957412+0000","last_change":"2024-09-21T09:11:06.896833+0000","last_active":"2024-09-21T09:13:34.957412+0000","last_peered":"2024-09-21T09:13:34.957412+0000","last_clean":"2024-09-21T09:13:34.957412+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:13:34.957412+0000","last_undegraded":"2024-09-21T09:13:34.957412+0000","last_fullsized":"2024-09-21T09:13:34.957412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:38.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"61'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294846+0000","last_change":"2024-09-21T09:10:58.825808+0000","last_active":"2024-09-21T09:13:34.294846+0000","last_peered":"2024-09-21T09:13:34.294846+0000","last_clean":"2024-09-21T09:13:34.294846+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:13:34.294846+0000","last_undegraded":"2024-09-21T09:13:34.294846+0000","last_fullsized":"2024-09-21T09:13:34.294846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"67'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295613+0000","last_change":"2024-09-21T09:10:56.851643+0000","last_active":"2024-09-21T09:13:34.295613+0000","last_peered":"2024-09-21T09:13:34.295613+0000","last_clean":"2024-09-21T09:13:34.295613+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:13:34.295613+0000","last_undegraded":"2024-09-21T09:13:34.295613+0000","last_fullsized":"2024-09-21T09:13:34.295613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482740+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:13:34.482740+0000","last_peered":"2024-09-21T09:13:34.482740+0000","last_clean":"2024-09-21T09:13:34.482740+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:13:34.482740+0000","last_undegraded":"2024-09-21T09:13:34.482740+0000","last_fullsized":"2024-09-21T09:13:34.482740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:24.356684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295776+0000","last_change":"2024-09-21T09:11:00.847115+0000","last_active":"2024-09-21T09:13:34.295776+0000","last_peered":"2024-09-21T09:13:34.295776+0000","last_clean":"2024-09-21T09:13:34.295776+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:13:34.295776+0000","last_undegraded":"2024-09-21T09:13:34.295776+0000","last_fullsized":"2024-09-21T09:13:34.295776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:55.012417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293962+0000","last_change":"2024-09-21T09:11:02.862921+0000","last_active":"2024-09-21T09:13:34.293962+0000","last_peered":"2024-09-21T09:13:34.293962+0000","last_clean":"2024-09-21T09:13:34.293962+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:13:34.293962+0000","last_undegraded":"2024-09-21T09:13:34.293962+0000","last_fullsized":"2024-09-21T09:13:34.293962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"71'101","reported_seq":259,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291252+0000","last_change":"2024-09-21T09:11:04.894220+0000","last_active":"2024-09-21T09:13:33.291252+0000","last_peered":"2024-09-21T09:13:33.291252+0000","last_clean":"2024-09-21T09:13:33.291252+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:13:33.291252+0000","last_undegraded":"2024-09-21T09:13:33.291252+0000","last_fullsized":"2024-09-21T09:13:33.291252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:07.285264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527292+0000","last_change":"2024-09-21T09:11:06.881113+0000","last_active":"2024-09-21T09:13:34.527292+0000","last_peered":"2024-09-21T09:13:34.527292+0000","last_clean":"2024-09-21T09:13:34.527292+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:13:34.527292+0000","last_undegraded":"2024-09-21T09:13:34.527292+0000","last_fullsized":"2024-09-21T09:13:34.527292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285828+0000","last_change":"2024-09-21T09:10:58.868894+0000","last_active":"2024-09-21T09:13:33.285828+0000","last_peered":"2024-09-21T09:13:33.285828+0000","last_clean":"2024-09-21T09:13:33.285828+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:13:33.285828+0000","last_undegraded":"2024-09-21T09:13:33.285828+0000","last_fullsized":"2024-09-21T09:13:33.285828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:41.448227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"66'4","reported_seq":145,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.288030+0000","last_change":"2024-09-21T09:10:56.853201+0000","last_active":"2024-09-21T09:13:33.288030+0000","last_peered":"2024-09-21T09:13:33.288030+0000","last_clean":"2024-09-21T09:13:33.288030+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:13:33.288030+0000","last_undegraded":"2024-09-21T09:13:33.288030+0000","last_fullsized":"2024-09-21T09:13:33.288030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:58.587669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287949+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:13:33.287949+0000","last_peered":"2024-09-21T09:13:33.287949+0000","last_clean":"2024-09-21T09:13:33.287949+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:13:33.287949+0000","last_undegraded":"2024-09-21T09:13:33.287949+0000","last_fullsized":"2024-09-21T09:13:33.287949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:03.383843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:11:00.850095+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:17.456402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"62'11","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482326+0000","last_change":"2024-09-21T09:11:02.853229+0000","last_active":"2024-09-21T09:13:34.482326+0000","last_peered":"2024-09-21T09:13:34.482326+0000","last_clean":"2024-09-21T09:13:34.482326+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:13:34.482326+0000","last_undegraded":"2024-09-21T09:13:34.482326+0000","last_fullsized":"2024-09-21T09:13:34.482326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:25.468451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"79'105","reported_seq":285,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955898+0000","last_change":"2024-09-21T09:13:22.165756+0000","last_active":"2024-09-21T09:13:34.955898+0000","last_peered":"2024-09-21T09:13:34.955898+0000","last_clean":"2024-09-21T09:13:34.955898+0000","last_became_active":"2024-09-21T09:13:22.164964+0000","last_became_peered":"2024-09-21T09:13:22.164964+0000","last_unstale":"2024-09-21T09:13:34.955898+0000","last_undegraded":"2024-09-21T09:13:34.955898+0000","last_fullsized":"2024-09-21T09:13:34.955898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:18.044791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"62'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956097+0000","last_change":"2024-09-21T09:11:06.887900+0000","last_active":"2024-09-21T09:13:34.956097+0000","last_peered":"2024-09-21T09:13:34.956097+0000","last_clean":"2024-09-21T09:13:34.956097+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:13:34.956097+0000","last_undegraded":"2024-09-21T09:13:34.956097+0000","last_fullsized":"2024-09-21T09:13:34.956097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:03.433485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297268+0000","last_change":"2024-09-21T09:13:19.160539+0000","last_active":"2024-09-21T09:13:34.297268+0000","last_peered":"2024-09-21T09:13:34.297268+0000","last_clean":"2024-09-21T09:13:34.297268+0000","last_became_active":"2024-09-21T09:13:19.158513+0000","last_became_peered":"2024-09-21T09:13:19.158513+0000","last_unstale":"2024-09-21T09:13:34.297268+0000","last_undegraded":"2024-09-21T09:13:34.297268+0000","last_fullsized":"2024-09-21T09:13:34.297268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:56.953433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"66'6","reported_seq":147,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287792+0000","last_change":"2024-09-21T09:10:56.849803+0000","last_active":"2024-09-21T09:13:33.287792+0000","last_peered":"2024-09-21T09:13:33.287792+0000","last_clean":"2024-09-21T09:13:33.287792+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:13:33.287792+0000","last_undegraded":"2024-09-21T09:13:33.287792+0000","last_fullsized":"2024-09-21T09:13:33.287792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:47.709157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483413+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:13:34.483413+0000","last_peered":"2024-09-21T09:13:34.483413+0000","last_clean":"2024-09-21T09:13:34.483413+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:13:34.483413+0000","last_undegraded":"2024-09-21T09:13:34.483413+0000","last_fullsized":"2024-09-21T09:13:34.483413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:33.465317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285098+0000","last_change":"2024-09-21T09:13:19.154303+0000","last_active":"2024-09-21T09:13:33.285098+0000","last_peered":"2024-09-21T09:13:33.285098+0000","last_clean":"2024-09-21T09:13:33.285098+0000","last_became_active":"2024-09-21T09:13:19.152735+0000","last_became_peered":"2024-09-21T09:13:19.152735+0000","last_unstale":"2024-09-21T09:13:33.285098+0000","last_undegraded":"2024-09-21T09:13:33.285098+0000","last_fullsized":"2024-09-21T09:13:33.285098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:24.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"71'37","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295954+0000","last_change":"2024-09-21T09:11:02.856720+0000","last_active":"2024-09-21T09:13:34.295954+0000","last_peered":"2024-09-21T09:13:34.295954+0000","last_clean":"2024-09-21T09:13:34.295954+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:13:34.295954+0000","last_undegraded":"2024-09-21T09:13:34.295954+0000","last_fullsized":"2024-09-21T09:13:34.295954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286249+0000","last_change":"2024-09-21T09:11:04.872979+0000","last_active":"2024-09-21T09:13:33.286249+0000","last_peered":"2024-09-21T09:13:33.286249+0000","last_clean":"2024-09-21T09:13:33.286249+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:13:33.286249+0000","last_undegraded":"2024-09-21T09:13:33.286249+0000","last_fullsized":"2024-09-21T09:13:33.286249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:17.499450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"71'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299731+0000","last_change":"2024-09-21T09:13:19.169497+0000","last_active":"2024-09-21T09:13:34.299731+0000","last_peered":"2024-09-21T09:13:34.299731+0000","last_clean":"2024-09-21T09:13:34.299731+0000","last_became_active":"2024-09-21T09:13:19.140926+0000","last_became_peered":"2024-09-21T09:13:19.140926+0000","last_unstale":"2024-09-21T09:13:34.299731+0000","last_undegraded":"2024-09-21T09:13:34.299731+0000","last_fullsized":"2024-09-21T09:13:34.299731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:44.853024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":426,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287242+0000","last_change":"2024-09-21T09:11:06.900571+0000","last_active":"2024-09-21T09:13:33.287242+0000","last_peered":"2024-09-21T09:13:33.287242+0000","last_clean":"2024-09-21T09:13:33.287242+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:13:33.287242+0000","last_undegraded":"2024-09-21T09:13:33.287242+0000","last_fullsized":"2024-09-21T09:13:33.287242+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:40.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295838+0000","last_change":"2024-09-21T09:13:19.531538+0000","last_active":"2024-09-21T09:13:34.295838+0000","last_peered":"2024-09-21T09:13:34.295838+0000","last_clean":"2024-09-21T09:13:34.295838+0000","last_became_active":"2024-09-21T09:13:19.158305+0000","last_became_peered":"2024-09-21T09:13:19.158305+0000","last_unstale":"2024-09-21T09:13:34.295838+0000","last_undegraded":"2024-09-21T09:13:34.295838+0000","last_fullsized":"2024-09-21T09:13:34.295838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:10.110896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"66'8","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482868+0000","last_change":"2024-09-21T09:13:21.278992+0000","last_active":"2024-09-21T09:13:34.482868+0000","last_peered":"2024-09-21T09:13:34.482868+0000","last_clean":"2024-09-21T09:13:34.482868+0000","last_became_active":"2024-09-21T09:13:19.168562+0000","last_became_peered":"2024-09-21T09:13:19.168562+0000","last_unstale":"2024-09-21T09:13:34.482868+0000","last_undegraded":"2024-09-21T09:13:34.482868+0000","last_fullsized":"2024-09-21T09:13:34.482868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:29.147931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294332+0000","last_change":"2024-09-21T09:11:00.839217+0000","last_active":"2024-09-21T09:13:34.294332+0000","last_peered":"2024-09-21T09:13:34.294332+0000","last_clean":"2024-09-21T09:13:34.294332+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:13:34.294332+0000","last_undegraded":"2024-09-21T09:13:34.294332+0000","last_fullsized":"2024-09-21T09:13:34.294332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:23.833810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"71'18","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293754+0000","last_change":"2024-09-21T09:11:02.872614+0000","last_active":"2024-09-21T09:13:34.293754+0000","last_peered":"2024-09-21T09:13:34.293754+0000","last_clean":"2024-09-21T09:13:34.293754+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:13:34.293754+0000","last_undegraded":"2024-09-21T09:13:34.293754+0000","last_fullsized":"2024-09-21T09:13:34.293754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525609+0000","last_change":"2024-09-21T09:11:04.882308+0000","last_active":"2024-09-21T09:13:34.525609+0000","last_peered":"2024-09-21T09:13:34.525609+0000","last_clean":"2024-09-21T09:13:34.525609+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:13:34.525609+0000","last_undegraded":"2024-09-21T09:13:34.525609+0000","last_fullsized":"2024-09-21T09:13:34.525609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:42.301147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"61'16","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527236+0000","last_change":"2024-09-21T09:11:06.892382+0000","last_active":"2024-09-21T09:13:34.527236+0000","last_peered":"2024-09-21T09:13:34.527236+0000","last_clean":"2024-09-21T09:13:34.527236+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:13:34.527236+0000","last_undegraded":"2024-09-21T09:13:34.527236+0000","last_fullsized":"2024-09-21T09:13:34.527236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:20.449346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"62'6","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285980+0000","last_change":"2024-09-21T09:10:58.869150+0000","last_active":"2024-09-21T09:13:33.285980+0000","last_peered":"2024-09-21T09:13:33.285980+0000","last_clean":"2024-09-21T09:13:33.285980+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:13:33.285980+0000","last_undegraded":"2024-09-21T09:13:33.285980+0000","last_fullsized":"2024-09-21T09:13:33.285980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:58.386210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"66'9","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298150+0000","last_change":"2024-09-21T09:10:56.854764+0000","last_active":"2024-09-21T09:13:34.298150+0000","last_peered":"2024-09-21T09:13:34.298150+0000","last_clean":"2024-09-21T09:13:34.298150+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:13:34.298150+0000","last_undegraded":"2024-09-21T09:13:34.298150+0000","last_fullsized":"2024-09-21T09:13:34.298150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285663+0000","last_change":"2024-09-21T09:11:00.839265+0000","last_active":"2024-09-21T09:13:33.285663+0000","last_peered":"2024-09-21T09:13:33.285663+0000","last_clean":"2024-09-21T09:13:33.285663+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:13:33.285663+0000","last_undegraded":"2024-09-21T09:13:33.285663+0000","last_fullsized":"2024-09-21T09:13:33.285663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:14.524942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"45'5","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.284804+0000","last_change":"2024-09-21T09:13:20.848665+0000","last_active":"2024-09-21T09:13:33.284804+0000","last_peered":"2024-09-21T09:13:33.284804+0000","last_clean":"2024-09-21T09:13:33.284804+0000","last_became_active":"2024-09-21T09:13:19.154000+0000","last_became_peered":"2024-09-21T09:13:19.154000+0000","last_unstale":"2024-09-21T09:13:33.284804+0000","last_undegraded":"2024-09-21T09:13:33.284804+0000","last_fullsized":"2024-09-21T09:13:33.284804+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:40.242838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297539+0000","last_change":"2024-09-21T09:13:19.160157+0000","last_active":"2024-09-21T09:13:34.297539+0000","last_peered":"2024-09-21T09:13:34.297539+0000","last_clean":"2024-09-21T09:13:34.297539+0000","last_became_active":"2024-09-21T09:13:19.157523+0000","last_became_peered":"2024-09-21T09:13:19.157523+0000","last_unstale":"2024-09-21T09:13:34.297539+0000","last_undegraded":"2024-09-21T09:13:34.297539+0000","last_fullsized":"2024-09-21T09:13:34.297539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:07.414777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294652+0000","last_change":"2024-09-21T09:11:06.879042+0000","last_active":"2024-09-21T09:13:34.294652+0000","last_peered":"2024-09-21T09:13:34.294652+0000","last_clean":"2024-09-21T09:13:34.294652+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:13:34.294652+0000","last_undegraded":"2024-09-21T09:13:34.294652+0000","last_fullsized":"2024-09-21T09:13:34.294652+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:34.670949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285427+0000","last_change":"2024-09-21T09:10:58.864481+0000","last_active":"2024-09-21T09:13:33.285427+0000","last_peered":"2024-09-21T09:13:33.285427+0000","last_clean":"2024-09-21T09:13:33.285427+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:13:33.285427+0000","last_undegraded":"2024-09-21T09:13:33.285427+0000","last_fullsized":"2024-09-21T09:13:33.285427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:33.405020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"67'12","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298309+0000","last_change":"2024-09-21T09:13:20.071816+0000","last_active":"2024-09-21T09:13:34.298309+0000","last_peered":"2024-09-21T09:13:34.298309+0000","last_clean":"2024-09-21T09:13:34.298309+0000","last_became_active":"2024-09-21T09:13:19.160370+0000","last_became_peered":"2024-09-21T09:13:19.160370+0000","last_unstale":"2024-09-21T09:13:34.298309+0000","last_undegraded":"2024-09-21T09:13:34.298309+0000","last_fullsized":"2024-09-21T09:13:34.298309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:13.089799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292818+0000","last_change":"2024-09-21T09:13:19.145601+0000","last_active":"2024-09-21T09:13:34.292818+0000","last_peered":"2024-09-21T09:13:34.292818+0000","last_clean":"2024-09-21T09:13:34.292818+0000","last_became_active":"2024-09-21T09:13:19.142672+0000","last_became_peered":"2024-09-21T09:13:19.142672+0000","last_unstale":"2024-09-21T09:13:34.292818+0000","last_undegraded":"2024-09-21T09:13:34.292818+0000","last_fullsized":"2024-09-21T09:13:34.292818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.000309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"71'17","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526668+0000","last_change":"2024-09-21T09:11:02.869796+0000","last_active":"2024-09-21T09:13:34.526668+0000","last_peered":"2024-09-21T09:13:34.526668+0000","last_clean":"2024-09-21T09:13:34.526668+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:13:34.526668+0000","last_undegraded":"2024-09-21T09:13:34.526668+0000","last_fullsized":"2024-09-21T09:13:34.526668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:48.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291159+0000","last_change":"2024-09-21T09:11:04.893727+0000","last_active":"2024-09-21T09:13:33.291159+0000","last_peered":"2024-09-21T09:13:33.291159+0000","last_clean":"2024-09-21T09:13:33.291159+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:33.291159+0000","last_undegraded":"2024-09-21T09:13:33.291159+0000","last_fullsized":"2024-09-21T09:13:33.291159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:18.437905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"71'7","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482615+0000","last_change":"2024-09-21T09:13:21.128242+0000","last_active":"2024-09-21T09:13:34.482615+0000","last_peered":"2024-09-21T09:13:34.482615+0000","last_clean":"2024-09-21T09:13:34.482615+0000","last_became_active":"2024-09-21T09:13:19.167169+0000","last_became_peered":"2024-09-21T09:13:19.167169+0000","last_unstale":"2024-09-21T09:13:34.482615+0000","last_undegraded":"2024-09-21T09:13:34.482615+0000","last_fullsized":"2024-09-21T09:13:34.482615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:46.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526036+0000","last_change":"2024-09-21T09:10:58.859005+0000","last_active":"2024-09-21T09:13:34.526036+0000","last_peered":"2024-09-21T09:13:34.526036+0000","last_clean":"2024-09-21T09:13:34.526036+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:13:34.526036+0000","last_undegraded":"2024-09-21T09:13:34.526036+0000","last_fullsized":"2024-09-21T09:13:34.526036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:38.110596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"66'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958780+0000","last_change":"2024-09-21T09:10:56.860416+0000","last_active":"2024-09-21T09:13:34.958780+0000","last_peered":"2024-09-21T09:13:34.958780+0000","last_clean":"2024-09-21T09:13:34.958780+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:13:34.958780+0000","last_undegraded":"2024-09-21T09:13:34.958780+0000","last_fullsized":"2024-09-21T09:13:34.958780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:48.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482021+0000","last_change":"2024-09-21T09:13:19.153082+0000","last_active":"2024-09-21T09:13:34.482021+0000","last_peered":"2024-09-21T09:13:34.482021+0000","last_clean":"2024-09-21T09:13:34.482021+0000","last_became_active":"2024-09-21T09:13:19.152722+0000","last_became_peered":"2024-09-21T09:13:19.152722+0000","last_unstale":"2024-09-21T09:13:34.482021+0000","last_undegraded":"2024-09-21T09:13:34.482021+0000","last_fullsized":"2024-09-21T09:13:34.482021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:26.550403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"71'16","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295783+0000","last_change":"2024-09-21T09:11:02.872950+0000","last_active":"2024-09-21T09:13:34.295783+0000","last_peered":"2024-09-21T09:13:34.295783+0000","last_clean":"2024-09-21T09:13:34.295783+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:13:34.295783+0000","last_undegraded":"2024-09-21T09:13:34.295783+0000","last_fullsized":"2024-09-21T09:13:34.295783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526197+0000","last_change":"2024-09-21T09:13:19.144593+0000","last_active":"2024-09-21T09:13:34.526197+0000","last_peered":"2024-09-21T09:13:34.526197+0000","last_clean":"2024-09-21T09:13:34.526197+0000","last_became_active":"2024-09-21T09:13:19.143577+0000","last_became_peered":"2024-09-21T09:13:19.143577+0000","last_unstale":"2024-09-21T09:13:34.526197+0000","last_undegraded":"2024-09-21T09:13:34.526197+0000","last_fullsized":"2024-09-21T09:13:34.526197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:02.985464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483155+0000","last_change":"2024-09-21T09:10:58.839092+0000","last_active":"2024-09-21T09:13:34.483155+0000","last_peered":"2024-09-21T09:13:34.483155+0000","last_clean":"2024-09-21T09:13:34.483155+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:13:34.483155+0000","last_undegraded":"2024-09-21T09:13:34.483155+0000","last_fullsized":"2024-09-21T09:13:34.483155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:02.458655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"66'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956457+0000","last_change":"2024-09-21T09:10:56.865435+0000","last_active":"2024-09-21T09:13:34.956457+0000","last_peered":"2024-09-21T09:13:34.956457+0000","last_clean":"2024-09-21T09:13:34.956457+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:13:34.956457+0000","last_undegraded":"2024-09-21T09:13:34.956457+0000","last_fullsized":"2024-09-21T09:13:34.956457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295267+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.295267+0000","last_peered":"2024-09-21T09:13:34.295267+0000","last_clean":"2024-09-21T09:13:34.295267+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:13:34.295267+0000","last_undegraded":"2024-09-21T09:13:34.295267+0000","last_fullsized":"2024-09-21T09:13:34.295267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:10.134818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"71'24","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294966+0000","last_change":"2024-09-21T09:11:02.879895+0000","last_active":"2024-09-21T09:13:34.294966+0000","last_peered":"2024-09-21T09:13:34.294966+0000","last_clean":"2024-09-21T09:13:34.294966+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:13:34.294966+0000","last_undegraded":"2024-09-21T09:13:34.294966+0000","last_fullsized":"2024-09-21T09:13:34.294966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298886+0000","last_change":"2024-09-21T09:13:19.166381+0000","last_active":"2024-09-21T09:13:34.298886+0000","last_peered":"2024-09-21T09:13:34.298886+0000","last_clean":"2024-09-21T09:13:34.298886+0000","last_became_active":"2024-09-21T09:13:19.165859+0000","last_became_peered":"2024-09-21T09:13:19.165859+0000","last_unstale":"2024-09-21T09:13:34.298886+0000","last_undegraded":"2024-09-21T09:13:34.298886+0000","last_fullsized":"2024-09-21T09:13:34.298886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:20.747731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957270+0000","last_change":"2024-09-21T09:11:06.896002+0000","last_active":"2024-09-21T09:13:34.957270+0000","last_peered":"2024-09-21T09:13:34.957270+0000","last_clean":"2024-09-21T09:13:34.957270+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:13:34.957270+0000","last_undegraded":"2024-09-21T09:13:34.957270+0000","last_fullsized":"2024-09-21T09:13:34.957270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:01.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"71'10","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287684+0000","last_change":"2024-09-21T09:10:58.868892+0000","last_active":"2024-09-21T09:13:33.287684+0000","last_peered":"2024-09-21T09:13:33.287684+0000","last_clean":"2024-09-21T09:13:33.287684+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:13:33.287684+0000","last_undegraded":"2024-09-21T09:13:33.287684+0000","last_fullsized":"2024-09-21T09:13:33.287684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"66'5","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286015+0000","last_change":"2024-09-21T09:10:56.827351+0000","last_active":"2024-09-21T09:13:33.286015+0000","last_peered":"2024-09-21T09:13:33.286015+0000","last_clean":"2024-09-21T09:13:33.286015+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:13:33.286015+0000","last_undegraded":"2024-09-21T09:13:33.286015+0000","last_fullsized":"2024-09-21T09:13:33.286015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:49.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298002+0000","last_change":"2024-09-21T09:13:19.159092+0000","last_active":"2024-09-21T09:13:34.298002+0000","last_peered":"2024-09-21T09:13:34.298002+0000","last_clean":"2024-09-21T09:13:34.298002+0000","last_became_active":"2024-09-21T09:13:19.158652+0000","last_became_peered":"2024-09-21T09:13:19.158652+0000","last_unstale":"2024-09-21T09:13:34.298002+0000","last_undegraded":"2024-09-21T09:13:34.298002+0000","last_fullsized":"2024-09-21T09:13:34.298002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:32.340994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"71'22","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482767+0000","last_change":"2024-09-21T09:13:21.165572+0000","last_active":"2024-09-21T09:13:34.482767+0000","last_peered":"2024-09-21T09:13:34.482767+0000","last_clean":"2024-09-21T09:13:34.482767+0000","last_became_active":"2024-09-21T09:13:19.167344+0000","last_became_peered":"2024-09-21T09:13:19.167344+0000","last_unstale":"2024-09-21T09:13:34.482767+0000","last_undegraded":"2024-09-21T09:13:34.482767+0000","last_fullsized":"2024-09-21T09:13:34.482767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:05.930094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956301+0000","last_change":"2024-09-21T09:11:04.890782+0000","last_active":"2024-09-21T09:13:34.956301+0000","last_peered":"2024-09-21T09:13:34.956301+0000","last_clean":"2024-09-21T09:13:34.956301+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:13:34.956301+0000","last_undegraded":"2024-09-21T09:13:34.956301+0000","last_fullsized":"2024-09-21T09:13:34.956301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:42.740558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"71'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482532+0000","last_change":"2024-09-21T09:11:06.889510+0000","last_active":"2024-09-21T09:13:34.482532+0000","last_peered":"2024-09-21T09:13:34.482532+0000","last_clean":"2024-09-21T09:13:34.482532+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:13:34.482532+0000","last_undegraded":"2024-09-21T09:13:34.482532+0000","last_fullsized":"2024-09-21T09:13:34.482532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:38.377418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527248+0000","last_change":"2024-09-21T09:10:58.854750+0000","last_active":"2024-09-21T09:13:34.527248+0000","last_peered":"2024-09-21T09:13:34.527248+0000","last_clean":"2024-09-21T09:13:34.527248+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:13:34.527248+0000","last_undegraded":"2024-09-21T09:13:34.527248+0000","last_fullsized":"2024-09-21T09:13:34.527248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.559151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"67'10","reported_seq":148,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293570+0000","last_change":"2024-09-21T09:10:56.863198+0000","last_active":"2024-09-21T09:13:33.293570+0000","last_peered":"2024-09-21T09:13:33.293570+0000","last_clean":"2024-09-21T09:13:33.293570+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:13:33.293570+0000","last_undegraded":"2024-09-21T09:13:33.293570+0000","last_fullsized":"2024-09-21T09:13:33.293570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298158+0000","last_change":"2024-09-21T09:13:20.592162+0000","last_active":"2024-09-21T09:13:34.298158+0000","last_peered":"2024-09-21T09:13:34.298158+0000","last_clean":"2024-09-21T09:13:34.298158+0000","last_became_active":"2024-09-21T09:13:19.165929+0000","last_became_peered":"2024-09-21T09:13:19.165929+0000","last_unstale":"2024-09-21T09:13:34.298158+0000","last_undegraded":"2024-09-21T09:13:34.298158+0000","last_fullsized":"2024-09-21T09:13:34.298158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:41.372526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"71'17","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295570+0000","last_change":"2024-09-21T09:11:02.879188+0000","last_active":"2024-09-21T09:13:34.295570+0000","last_peered":"2024-09-21T09:13:34.295570+0000","last_clean":"2024-09-21T09:13:34.295570+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:13:34.295570+0000","last_undegraded":"2024-09-21T09:13:34.295570+0000","last_fullsized":"2024-09-21T09:13:34.295570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:37.208901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527107+0000","last_change":"2024-09-21T09:11:04.880786+0000","last_active":"2024-09-21T09:13:34.527107+0000","last_peered":"2024-09-21T09:13:34.527107+0000","last_clean":"2024-09-21T09:13:34.527107+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:13:34.527107+0000","last_undegraded":"2024-09-21T09:13:34.527107+0000","last_fullsized":"2024-09-21T09:13:34.527107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:54.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"62'10","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481914+0000","last_change":"2024-09-21T09:11:06.898517+0000","last_active":"2024-09-21T09:13:34.481914+0000","last_peered":"2024-09-21T09:13:34.481914+0000","last_clean":"2024-09-21T09:13:34.481914+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:13:34.481914+0000","last_undegraded":"2024-09-21T09:13:34.481914+0000","last_fullsized":"2024-09-21T09:13:34.481914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:46.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":39,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":147,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286952+0000","last_change":"2024-09-21T09:10:58.868807+0000","last_active":"2024-09-21T09:13:33.286952+0000","last_peered":"2024-09-21T09:13:33.286952+0000","last_clean":"2024-09-21T09:13:33.286952+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:13:33.286952+0000","last_undegraded":"2024-09-21T09:13:33.286952+0000","last_fullsized":"2024-09-21T09:13:33.286952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.574650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"67'12","reported_seq":153,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287187+0000","last_change":"2024-09-21T09:10:56.851205+0000","last_active":"2024-09-21T09:13:33.287187+0000","last_peered":"2024-09-21T09:13:33.287187+0000","last_clean":"2024-09-21T09:13:33.287187+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:13:33.287187+0000","last_undegraded":"2024-09-21T09:13:33.287187+0000","last_fullsized":"2024-09-21T09:13:33.287187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:52.423650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287169+0000","last_change":"2024-09-21T09:11:00.856830+0000","last_active":"2024-09-21T09:13:33.287169+0000","last_peered":"2024-09-21T09:13:33.287169+0000","last_clean":"2024-09-21T09:13:33.287169+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:13:33.287169+0000","last_undegraded":"2024-09-21T09:13:33.287169+0000","last_fullsized":"2024-09-21T09:13:33.287169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:45.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"74'14","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483000+0000","last_change":"2024-09-21T09:13:21.153990+0000","last_active":"2024-09-21T09:13:34.483000+0000","last_peered":"2024-09-21T09:13:34.483000+0000","last_clean":"2024-09-21T09:13:34.483000+0000","last_became_active":"2024-09-21T09:13:19.167321+0000","last_became_peered":"2024-09-21T09:13:19.167321+0000","last_unstale":"2024-09-21T09:13:34.483000+0000","last_undegraded":"2024-09-21T09:13:34.483000+0000","last_fullsized":"2024-09-21T09:13:34.483000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:34.649177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"71'101","reported_seq":269,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298386+0000","last_change":"2024-09-21T09:11:04.870463+0000","last_active":"2024-09-21T09:13:34.298386+0000","last_peered":"2024-09-21T09:13:34.298386+0000","last_clean":"2024-09-21T09:13:34.298386+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:13:34.298386+0000","last_undegraded":"2024-09-21T09:13:34.298386+0000","last_fullsized":"2024-09-21T09:13:34.298386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:30.495090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"58'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481854+0000","last_change":"2024-09-21T09:11:06.883550+0000","last_active":"2024-09-21T09:13:34.481854+0000","last_peered":"2024-09-21T09:13:34.481854+0000","last_clean":"2024-09-21T09:13:34.481854+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:13:34.481854+0000","last_undegraded":"2024-09-21T09:13:34.481854+0000","last_fullsized":"2024-09-21T09:13:34.481854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:56.825424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"71'10","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296041+0000","last_change":"2024-09-21T09:13:19.537524+0000","last_active":"2024-09-21T09:13:34.296041+0000","last_peered":"2024-09-21T09:13:34.296041+0000","last_clean":"2024-09-21T09:13:34.296041+0000","last_became_active":"2024-09-21T09:13:19.159904+0000","last_became_peered":"2024-09-21T09:13:19.159904+0000","last_unstale":"2024-09-21T09:13:34.296041+0000","last_undegraded":"2024-09-21T09:13:34.296041+0000","last_fullsized":"2024-09-21T09:13:34.296041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:12.531734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"67'12","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293240+0000","last_change":"2024-09-21T09:10:56.852586+0000","last_active":"2024-09-21T09:13:33.293240+0000","last_peered":"2024-09-21T09:13:33.293240+0000","last_clean":"2024-09-21T09:13:33.293240+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:13:33.293240+0000","last_undegraded":"2024-09-21T09:13:33.293240+0000","last_fullsized":"2024-09-21T09:13:33.293240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":130,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.290596+0000","last_change":"2024-09-21T09:11:00.839800+0000","last_active":"2024-09-21T09:13:33.290596+0000","last_peered":"2024-09-21T09:13:33.290596+0000","last_clean":"2024-09-21T09:13:33.290596+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:13:33.290596+0000","last_undegraded":"2024-09-21T09:13:33.290596+0000","last_fullsized":"2024-09-21T09:13:33.290596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:21.140377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"71'22","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293383+0000","last_change":"2024-09-21T09:11:02.857087+0000","last_active":"2024-09-21T09:13:34.293383+0000","last_peered":"2024-09-21T09:13:34.293383+0000","last_clean":"2024-09-21T09:13:34.293383+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:13:34.293383+0000","last_undegraded":"2024-09-21T09:13:34.293383+0000","last_fullsized":"2024-09-21T09:13:34.293383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.284978+0000","last_change":"2024-09-21T09:11:04.872303+0000","last_active":"2024-09-21T09:13:33.284978+0000","last_peered":"2024-09-21T09:13:33.284978+0000","last_clean":"2024-09-21T09:13:33.284978+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:13:33.284978+0000","last_undegraded":"2024-09-21T09:13:33.284978+0000","last_fullsized":"2024-09-21T09:13:33.284978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.517451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"71'10","reported_seq":135,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293321+0000","last_change":"2024-09-21T09:11:06.873636+0000","last_active":"2024-09-21T09:13:33.293321+0000","last_peered":"2024-09-21T09:13:33.293321+0000","last_clean":"2024-09-21T09:13:33.293321+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:13:33.293321+0000","last_undegraded":"2024-09-21T09:13:33.293321+0000","last_fullsized":"2024-09-21T09:13:33.293321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:52.693664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293210+0000","last_change":"2024-09-21T09:13:19.144377+0000","last_active":"2024-09-21T09:13:34.293210+0000","last_peered":"2024-09-21T09:13:34.293210+0000","last_clean":"2024-09-21T09:13:34.293210+0000","last_became_active":"2024-09-21T09:13:19.143746+0000","last_became_peered":"2024-09-21T09:13:19.143746+0000","last_unstale":"2024-09-21T09:13:34.293210+0000","last_undegraded":"2024-09-21T09:13:34.293210+0000","last_fullsized":"2024-09-21T09:13:34.293210+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:48.781954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"67'15","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482960+0000","last_change":"2024-09-21T09:11:34.170912+0000","last_active":"2024-09-21T09:13:34.482960+0000","last_peered":"2024-09-21T09:13:34.482960+0000","last_clean":"2024-09-21T09:13:34.482960+0000","last_became_active":"2024-09-21T09:11:34.170599+0000","last_became_peered":"2024-09-21T09:11:34.170599+0000","last_unstale":"2024-09-21T09:13:34.482960+0000","last_undegraded":"2024-09-21T09:13:34.482960+0000","last_fullsized":"2024-09-21T09:13:34.482960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296362+0000","last_change":"2024-09-21T09:13:19.144365+0000","last_active":"2024-09-21T09:13:34.296362+0000","last_peered":"2024-09-21T09:13:34.296362+0000","last_clean":"2024-09-21T09:13:34.296362+0000","last_became_active":"2024-09-21T09:13:19.141404+0000","last_became_peered":"2024-09-21T09:13:19.141404+0000","last_unstale":"2024-09-21T09:13:34.296362+0000","last_undegraded":"2024-09-21T09:13:34.296362+0000","last_fullsized":"2024-09-21T09:13:34.296362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:05.438476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"71'16","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285721+0000","last_change":"2024-09-21T09:11:02.847926+0000","last_active":"2024-09-21T09:13:33.285721+0000","last_peered":"2024-09-21T09:13:33.285721+0000","last_clean":"2024-09-21T09:13:33.285721+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:13:33.285721+0000","last_undegraded":"2024-09-21T09:13:33.285721+0000","last_fullsized":"2024-09-21T09:13:33.285721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:15.592269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482045+0000","last_change":"2024-09-21T09:11:04.880866+0000","last_active":"2024-09-21T09:13:34.482045+0000","last_peered":"2024-09-21T09:13:34.482045+0000","last_clean":"2024-09-21T09:13:34.482045+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:13:34.482045+0000","last_undegraded":"2024-09-21T09:13:34.482045+0000","last_fullsized":"2024-09-21T09:13:34.482045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:02.568576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957411+0000","last_change":"2024-09-21T09:11:06.899493+0000","last_active":"2024-09-21T09:13:34.957411+0000","last_peered":"2024-09-21T09:13:34.957411+0000","last_clean":"2024-09-21T09:13:34.957411+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:13:34.957411+0000","last_undegraded":"2024-09-21T09:13:34.957411+0000","last_fullsized":"2024-09-21T09:13:34.957411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:50.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525954+0000","last_change":"2024-09-21T09:10:58.856310+0000","last_active":"2024-09-21T09:13:34.525954+0000","last_peered":"2024-09-21T09:13:34.525954+0000","last_clean":"2024-09-21T09:13:34.525954+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:13:34.525954+0000","last_undegraded":"2024-09-21T09:13:34.525954+0000","last_fullsized":"2024-09-21T09:13:34.525954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:12.549438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"66'11","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958076+0000","last_change":"2024-09-21T09:13:20.628384+0000","last_active":"2024-09-21T09:13:34.958076+0000","last_peered":"2024-09-21T09:13:34.958076+0000","last_clean":"2024-09-21T09:13:34.958076+0000","last_became_active":"2024-09-21T09:13:19.169569+0000","last_became_peered":"2024-09-21T09:13:19.169569+0000","last_unstale":"2024-09-21T09:13:34.958076+0000","last_undegraded":"2024-09-21T09:13:34.958076+0000","last_fullsized":"2024-09-21T09:13:34.958076+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:00.389819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":130,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.290406+0000","last_change":"2024-09-21T09:11:00.837141+0000","last_active":"2024-09-21T09:13:33.290406+0000","last_peered":"2024-09-21T09:13:33.290406+0000","last_clean":"2024-09-21T09:13:33.290406+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:13:33.290406+0000","last_undegraded":"2024-09-21T09:13:33.290406+0000","last_fullsized":"2024-09-21T09:13:33.290406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"71'11","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294478+0000","last_change":"2024-09-21T09:13:20.076515+0000","last_active":"2024-09-21T09:13:34.294478+0000","last_peered":"2024-09-21T09:13:34.294478+0000","last_clean":"2024-09-21T09:13:34.294478+0000","last_became_active":"2024-09-21T09:13:19.150207+0000","last_became_peered":"2024-09-21T09:13:19.150207+0000","last_unstale":"2024-09-21T09:13:34.294478+0000","last_undegraded":"2024-09-21T09:13:34.294478+0000","last_fullsized":"2024-09-21T09:13:34.294478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482052+0000","last_change":"2024-09-21T09:11:04.887172+0000","last_active":"2024-09-21T09:13:34.482052+0000","last_peered":"2024-09-21T09:13:34.482052+0000","last_clean":"2024-09-21T09:13:34.482052+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:13:34.482052+0000","last_undegraded":"2024-09-21T09:13:34.482052+0000","last_fullsized":"2024-09-21T09:13:34.482052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:01.250555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482536+0000","last_change":"2024-09-21T09:13:19.157682+0000","last_active":"2024-09-21T09:13:34.482536+0000","last_peered":"2024-09-21T09:13:34.482536+0000","last_clean":"2024-09-21T09:13:34.482536+0000","last_became_active":"2024-09-21T09:13:19.157306+0000","last_became_peered":"2024-09-21T09:13:19.157306+0000","last_unstale":"2024-09-21T09:13:34.482536+0000","last_undegraded":"2024-09-21T09:13:34.482536+0000","last_fullsized":"2024-09-21T09:13:34.482536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.786122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292810+0000","last_change":"2024-09-21T09:13:19.713138+0000","last_active":"2024-09-21T09:13:34.292810+0000","last_peered":"2024-09-21T09:13:34.292810+0000","last_clean":"2024-09-21T09:13:34.292810+0000","last_became_active":"2024-09-21T09:13:19.161496+0000","last_became_peered":"2024-09-21T09:13:19.161496+0000","last_unstale":"2024-09-21T09:13:34.292810+0000","last_undegraded":"2024-09-21T09:13:34.292810+0000","last_fullsized":"2024-09-21T09:13:34.292810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:42.440821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958517+0000","last_change":"2024-09-21T09:10:56.861373+0000","last_active":"2024-09-21T09:13:34.958517+0000","last_peered":"2024-09-21T09:13:34.958517+0000","last_clean":"2024-09-21T09:13:34.958517+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:13:34.958517+0000","last_undegraded":"2024-09-21T09:13:34.958517+0000","last_fullsized":"2024-09-21T09:13:34.958517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:45.846021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":134,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285038+0000","last_change":"2024-09-21T09:11:00.838647+0000","last_active":"2024-09-21T09:13:33.285038+0000","last_peered":"2024-09-21T09:13:33.285038+0000","last_clean":"2024-09-21T09:13:33.285038+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:13:33.285038+0000","last_undegraded":"2024-09-21T09:13:33.285038+0000","last_fullsized":"2024-09-21T09:13:33.285038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:16.279789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"71'17","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482115+0000","last_change":"2024-09-21T09:11:02.877357+0000","last_active":"2024-09-21T09:13:34.482115+0000","last_peered":"2024-09-21T09:13:34.482115+0000","last_clean":"2024-09-21T09:13:34.482115+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:13:34.482115+0000","last_undegraded":"2024-09-21T09:13:34.482115+0000","last_fullsized":"2024-09-21T09:13:34.482115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:46.845302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67351,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286326+0000","last_change":"2024-09-21T09:11:04.896698+0000","last_active":"2024-09-21T09:13:33.286326+0000","last_peered":"2024-09-21T09:13:33.286326+0000","last_clean":"2024-09-21T09:13:33.286326+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:13:33.286326+0000","last_undegraded":"2024-09-21T09:13:33.286326+0000","last_fullsized":"2024-09-21T09:13:33.286326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:59.924890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297318+0000","last_change":"2024-09-21T09:13:20.646926+0000","last_active":"2024-09-21T09:13:34.297318+0000","last_peered":"2024-09-21T09:13:34.297318+0000","last_clean":"2024-09-21T09:13:34.297318+0000","last_became_active":"2024-09-21T09:13:19.153765+0000","last_became_peered":"2024-09-21T09:13:19.153765+0000","last_unstale":"2024-09-21T09:13:34.297318+0000","last_undegraded":"2024-09-21T09:13:34.297318+0000","last_fullsized":"2024-09-21T09:13:34.297318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'6","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287998+0000","last_change":"2024-09-21T09:10:58.865842+0000","last_active":"2024-09-21T09:13:33.287998+0000","last_peered":"2024-09-21T09:13:33.287998+0000","last_clean":"2024-09-21T09:13:33.287998+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:13:33.287998+0000","last_undegraded":"2024-09-21T09:13:33.287998+0000","last_fullsized":"2024-09-21T09:13:33.287998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:10.069785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"66'7","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293255+0000","last_change":"2024-09-21T09:13:19.522324+0000","last_active":"2024-09-21T09:13:34.293255+0000","last_peered":"2024-09-21T09:13:34.293255+0000","last_clean":"2024-09-21T09:13:34.293255+0000","last_became_active":"2024-09-21T09:13:19.143052+0000","last_became_peered":"2024-09-21T09:13:19.143052+0000","last_unstale":"2024-09-21T09:13:34.293255+0000","last_undegraded":"2024-09-21T09:13:34.293255+0000","last_fullsized":"2024-09-21T09:13:34.293255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:36.362618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"71'8","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527890+0000","last_change":"2024-09-21T09:10:58.871267+0000","last_active":"2024-09-21T09:13:34.527890+0000","last_peered":"2024-09-21T09:13:34.527890+0000","last_clean":"2024-09-21T09:13:34.527890+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:13:34.527890+0000","last_undegraded":"2024-09-21T09:13:34.527890+0000","last_fullsized":"2024-09-21T09:13:34.527890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"66'8","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525789+0000","last_change":"2024-09-21T09:10:56.847914+0000","last_active":"2024-09-21T09:13:34.525789+0000","last_peered":"2024-09-21T09:13:34.525789+0000","last_clean":"2024-09-21T09:13:34.525789+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:13:34.525789+0000","last_undegraded":"2024-09-21T09:13:34.525789+0000","last_fullsized":"2024-09-21T09:13:34.525789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482765+0000","last_change":"2024-09-21T09:10:58.837841+0000","last_active":"2024-09-21T09:13:34.482765+0000","last_peered":"2024-09-21T09:13:34.482765+0000","last_clean":"2024-09-21T09:13:34.482765+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:13:34.482765+0000","last_undegraded":"2024-09-21T09:13:34.482765+0000","last_fullsized":"2024-09-21T09:13:34.482765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:54.101397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"67'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482421+0000","last_change":"2024-09-21T09:10:56.861995+0000","last_active":"2024-09-21T09:13:34.482421+0000","last_peered":"2024-09-21T09:13:34.482421+0000","last_clean":"2024-09-21T09:13:34.482421+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:13:34.482421+0000","last_undegraded":"2024-09-21T09:13:34.482421+0000","last_fullsized":"2024-09-21T09:13:34.482421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:44.655482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"58'4","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957038+0000","last_change":"2024-09-21T09:13:20.835461+0000","last_active":"2024-09-21T09:13:34.957038+0000","last_peered":"2024-09-21T09:13:34.957038+0000","last_clean":"2024-09-21T09:13:34.957038+0000","last_became_active":"2024-09-21T09:13:19.169698+0000","last_became_peered":"2024-09-21T09:13:19.169698+0000","last_unstale":"2024-09-21T09:13:34.957038+0000","last_undegraded":"2024-09-21T09:13:34.957038+0000","last_fullsized":"2024-09-21T09:13:34.957038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:00.406380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"62'6","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955827+0000","last_change":"2024-09-21T09:10:56.866139+0000","last_active":"2024-09-21T09:13:34.955827+0000","last_peered":"2024-09-21T09:13:34.955827+0000","last_clean":"2024-09-21T09:13:34.955827+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:13:34.955827+0000","last_undegraded":"2024-09-21T09:13:34.955827+0000","last_fullsized":"2024-09-21T09:13:34.955827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:33.551996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"58'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956535+0000","last_change":"2024-09-21T09:10:58.840408+0000","last_active":"2024-09-21T09:13:34.956535+0000","last_peered":"2024-09-21T09:13:34.956535+0000","last_clean":"2024-09-21T09:13:34.956535+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:13:34.956535+0000","last_undegraded":"2024-09-21T09:13:34.956535+0000","last_fullsized":"2024-09-21T09:13:34.956535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:42.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"66'8","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295479+0000","last_change":"2024-09-21T09:10:56.860054+0000","last_active":"2024-09-21T09:13:34.295479+0000","last_peered":"2024-09-21T09:13:34.295479+0000","last_clean":"2024-09-21T09:13:34.295479+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:13:34.295479+0000","last_undegraded":"2024-09-21T09:13:34.295479+0000","last_fullsized":"2024-09-21T09:13:34.295479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296113+0000","last_change":"2024-09-21T09:10:58.836500+0000","last_active":"2024-09-21T09:13:34.296113+0000","last_peered":"2024-09-21T09:13:34.296113+0000","last_clean":"2024-09-21T09:13:34.296113+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:13:34.296113+0000","last_undegraded":"2024-09-21T09:13:34.296113+0000","last_fullsized":"2024-09-21T09:13:34.296113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"66'8","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295940+0000","last_change":"2024-09-21T09:10:56.862765+0000","last_active":"2024-09-21T09:13:34.295940+0000","last_peered":"2024-09-21T09:13:34.295940+0000","last_clean":"2024-09-21T09:13:34.295940+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:13:34.295940+0000","last_undegraded":"2024-09-21T09:13:34.295940+0000","last_fullsized":"2024-09-21T09:13:34.295940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"62'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294186+0000","last_change":"2024-09-21T09:10:58.826466+0000","last_active":"2024-09-21T09:13:34.294186+0000","last_peered":"2024-09-21T09:13:34.294186+0000","last_clean":"2024-09-21T09:13:34.294186+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:13:34.294186+0000","last_undegraded":"2024-09-21T09:13:34.294186+0000","last_fullsized":"2024-09-21T09:13:34.294186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"66'9","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299107+0000","last_change":"2024-09-21T09:13:20.211974+0000","last_active":"2024-09-21T09:13:34.299107+0000","last_peered":"2024-09-21T09:13:34.299107+0000","last_clean":"2024-09-21T09:13:34.299107+0000","last_became_active":"2024-09-21T09:13:19.161214+0000","last_became_peered":"2024-09-21T09:13:19.161214+0000","last_unstale":"2024-09-21T09:13:34.299107+0000","last_undegraded":"2024-09-21T09:13:34.299107+0000","last_fullsized":"2024-09-21T09:13:34.299107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:40:58.281738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"62'2","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292575+0000","last_change":"2024-09-21T09:10:58.872072+0000","last_active":"2024-09-21T09:13:33.292575+0000","last_peered":"2024-09-21T09:13:33.292575+0000","last_clean":"2024-09-21T09:13:33.292575+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:13:33.292575+0000","last_undegraded":"2024-09-21T09:13:33.292575+0000","last_fullsized":"2024-09-21T09:13:33.292575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"67'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958252+0000","last_change":"2024-09-21T09:10:56.861072+0000","last_active":"2024-09-21T09:13:34.958252+0000","last_peered":"2024-09-21T09:13:34.958252+0000","last_clean":"2024-09-21T09:13:34.958252+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:13:34.958252+0000","last_undegraded":"2024-09-21T09:13:34.958252+0000","last_fullsized":"2024-09-21T09:13:34.958252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527799+0000","last_change":"2024-09-21T09:10:58.856982+0000","last_active":"2024-09-21T09:13:34.527799+0000","last_peered":"2024-09-21T09:13:34.527799+0000","last_clean":"2024-09-21T09:13:34.527799+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:13:34.527799+0000","last_undegraded":"2024-09-21T09:13:34.527799+0000","last_fullsized":"2024-09-21T09:13:34.527799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"66'7","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482177+0000","last_change":"2024-09-21T09:10:56.847793+0000","last_active":"2024-09-21T09:13:34.482177+0000","last_peered":"2024-09-21T09:13:34.482177+0000","last_clean":"2024-09-21T09:13:34.482177+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:13:34.482177+0000","last_undegraded":"2024-09-21T09:13:34.482177+0000","last_fullsized":"2024-09-21T09:13:34.482177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:22.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"62'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298133+0000","last_change":"2024-09-21T09:10:58.851481+0000","last_active":"2024-09-21T09:13:34.298133+0000","last_peered":"2024-09-21T09:13:34.298133+0000","last_clean":"2024-09-21T09:13:34.298133+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:13:34.298133+0000","last_undegraded":"2024-09-21T09:13:34.298133+0000","last_fullsized":"2024-09-21T09:13:34.298133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:42.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"67'12","reported_seq":215,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956033+0000","last_change":"2024-09-21T09:13:20.068227+0000","last_active":"2024-09-21T09:13:34.956033+0000","last_peered":"2024-09-21T09:13:34.956033+0000","last_clean":"2024-09-21T09:13:34.956033+0000","last_became_active":"2024-09-21T09:13:19.169480+0000","last_became_peered":"2024-09-21T09:13:19.169480+0000","last_unstale":"2024-09-21T09:13:34.956033+0000","last_undegraded":"2024-09-21T09:13:34.956033+0000","last_fullsized":"2024-09-21T09:13:34.956033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:08.928533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957005+0000","last_change":"2024-09-21T09:10:58.843673+0000","last_active":"2024-09-21T09:13:34.957005+0000","last_peered":"2024-09-21T09:13:34.957005+0000","last_clean":"2024-09-21T09:13:34.957005+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:13:34.957005+0000","last_undegraded":"2024-09-21T09:13:34.957005+0000","last_fullsized":"2024-09-21T09:13:34.957005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:19.133330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"67'6","reported_seq":145,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292760+0000","last_change":"2024-09-21T09:10:56.838835+0000","last_active":"2024-09-21T09:13:33.292760+0000","last_peered":"2024-09-21T09:13:33.292760+0000","last_clean":"2024-09-21T09:13:33.292760+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:13:33.292760+0000","last_undegraded":"2024-09-21T09:13:33.292760+0000","last_fullsized":"2024-09-21T09:13:33.292760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'2","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292340+0000","last_change":"2024-09-21T09:10:58.869168+0000","last_active":"2024-09-21T09:13:33.292340+0000","last_peered":"2024-09-21T09:13:33.292340+0000","last_clean":"2024-09-21T09:13:33.292340+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:13:33.292340+0000","last_undegraded":"2024-09-21T09:13:33.292340+0000","last_fullsized":"2024-09-21T09:13:33.292340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"66'13","reported_seq":220,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.286863+0000","last_change":"2024-09-21T09:13:20.275872+0000","last_active":"2024-09-21T09:13:33.286863+0000","last_peered":"2024-09-21T09:13:33.286863+0000","last_clean":"2024-09-21T09:13:33.286863+0000","last_became_active":"2024-09-21T09:13:19.153073+0000","last_became_peered":"2024-09-21T09:13:19.153073+0000","last_unstale":"2024-09-21T09:13:33.286863+0000","last_undegraded":"2024-09-21T09:13:33.286863+0000","last_fullsized":"2024-09-21T09:13:33.286863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:51.699749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":134,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.291462+0000","last_change":"2024-09-21T09:10:58.840930+0000","last_active":"2024-09-21T09:13:33.291462+0000","last_peered":"2024-09-21T09:13:33.291462+0000","last_clean":"2024-09-21T09:13:33.291462+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:13:33.291462+0000","last_undegraded":"2024-09-21T09:13:33.291462+0000","last_fullsized":"2024-09-21T09:13:33.291462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"67'13","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297144+0000","last_change":"2024-09-21T09:10:56.841366+0000","last_active":"2024-09-21T09:13:34.297144+0000","last_peered":"2024-09-21T09:13:34.297144+0000","last_clean":"2024-09-21T09:13:34.297144+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:13:34.297144+0000","last_undegraded":"2024-09-21T09:13:34.297144+0000","last_fullsized":"2024-09-21T09:13:34.297144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:15.948479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526167+0000","last_change":"2024-09-21T09:10:58.873865+0000","last_active":"2024-09-21T09:13:34.526167+0000","last_peered":"2024-09-21T09:13:34.526167+0000","last_clean":"2024-09-21T09:13:34.526167+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:13:34.526167+0000","last_undegraded":"2024-09-21T09:13:34.526167+0000","last_fullsized":"2024-09-21T09:13:34.526167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"67'5","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482963+0000","last_change":"2024-09-21T09:10:56.843359+0000","last_active":"2024-09-21T09:13:34.482963+0000","last_peered":"2024-09-21T09:13:34.482963+0000","last_clean":"2024-09-21T09:13:34.482963+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:13:34.482963+0000","last_undegraded":"2024-09-21T09:13:34.482963+0000","last_fullsized":"2024-09-21T09:13:34.482963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:17.126175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"71'4","reported_seq":147,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.285718+0000","last_change":"2024-09-21T09:10:58.864268+0000","last_active":"2024-09-21T09:13:33.285718+0000","last_peered":"2024-09-21T09:13:33.285718+0000","last_clean":"2024-09-21T09:13:33.285718+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:13:33.285718+0000","last_undegraded":"2024-09-21T09:13:33.285718+0000","last_fullsized":"2024-09-21T09:13:33.285718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:22.929821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"66'10","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.528171+0000","last_change":"2024-09-21T09:13:19.704634+0000","last_active":"2024-09-21T09:13:34.528171+0000","last_peered":"2024-09-21T09:13:34.528171+0000","last_clean":"2024-09-21T09:13:34.528171+0000","last_became_active":"2024-09-21T09:13:19.159408+0000","last_became_peered":"2024-09-21T09:13:19.159408+0000","last_unstale":"2024-09-21T09:13:34.528171+0000","last_undegraded":"2024-09-21T09:13:34.528171+0000","last_fullsized":"2024-09-21T09:13:34.528171+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:49.771475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":149,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.292265+0000","last_change":"2024-09-21T09:10:58.840040+0000","last_active":"2024-09-21T09:13:33.292265+0000","last_peered":"2024-09-21T09:13:33.292265+0000","last_clean":"2024-09-21T09:13:33.292265+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:13:33.292265+0000","last_undegraded":"2024-09-21T09:13:33.292265+0000","last_fullsized":"2024-09-21T09:13:33.292265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"66'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483406+0000","last_change":"2024-09-21T09:10:56.845828+0000","last_active":"2024-09-21T09:13:34.483406+0000","last_peered":"2024-09-21T09:13:34.483406+0000","last_clean":"2024-09-21T09:13:34.483406+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:13:34.483406+0000","last_undegraded":"2024-09-21T09:13:34.483406+0000","last_fullsized":"2024-09-21T09:13:34.483406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:37.489093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"67'8","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:13:20.828458+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:13:19.155182+0000","last_became_peered":"2024-09-21T09:13:19.155182+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:34.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.287801+0000","last_change":"2024-09-21T09:10:58.871879+0000","last_active":"2024-09-21T09:13:33.287801+0000","last_peered":"2024-09-21T09:13:33.287801+0000","last_clean":"2024-09-21T09:13:33.287801+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:13:33.287801+0000","last_undegraded":"2024-09-21T09:13:33.287801+0000","last_fullsized":"2024-09-21T09:13:33.287801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:28.117298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"66'10","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955726+0000","last_change":"2024-09-21T09:10:56.862439+0000","last_active":"2024-09-21T09:13:34.955726+0000","last_peered":"2024-09-21T09:13:34.955726+0000","last_clean":"2024-09-21T09:13:34.955726+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:13:34.955726+0000","last_undegraded":"2024-09-21T09:13:34.955726+0000","last_fullsized":"2024-09-21T09:13:34.955726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"62'4","reported_seq":144,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T09:13:33.293887+0000","last_change":"2024-09-21T09:10:58.828974+0000","last_active":"2024-09-21T09:13:33.293887+0000","last_peered":"2024-09-21T09:13:33.293887+0000","last_clean":"2024-09-21T09:13:33.293887+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:13:33.293887+0000","last_undegraded":"2024-09-21T09:13:33.293887+0000","last_fullsized":"2024-09-21T09:13:33.293887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":233,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":848,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":812,"ondisk_log_size":812,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":156302,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":813,"num_read_kb":575,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":660,"num_keys_recovered":24,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":272744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":545,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":23,"num_write":644,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":1149239296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384652,"kb_used_data":349304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93987188,"statfs":{"total":96636764160,"available":96242880512,"internally_reserved":0,"allocated":357687296,"data_stored":357174157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":511572,"kb_used_data":476224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93860268,"statfs":{"total":96636764160,"available":96112914432,"internally_reserved":0,"allocated":487653376,"data_stored":487144593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":790668,"kb_used_data":755316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93581172,"statfs":{"total":96636764160,"available":95827120128,"internally_reserved":0,"allocated":773443584,"data_stored":772934975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763532,"kb_used_data":728184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93608308,"statfs":{"total":96636764160,"available":95854907392,"internally_reserved":0,"allocated":745660416,"data_stored":745152324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":677440,"kb_used_data":642084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93694400,"statfs":{"total":96636764160,"available":95943065600,"internally_reserved":0,"allocated":657494016,"data_stored":657008169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":594152,"kb_used_data":558804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93777688,"statfs":{"total":96636764160,"available":96028352512,"internally_reserved":0,"allocated":572215296,"data_stored":571677178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":794296,"kb_used_data":758940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93577544,"statfs":{"total":96636764160,"available":95823405056,"internally_reserved":0,"allocated":777154560,"data_stored":776616419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462480,"kb_used_data":422964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93909360,"statfs":{"total":96636764160,"available":96163184640,"internally_reserved":0,"allocated":433115136,"data_stored":432605908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":775946240,"data_stored":775946240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":570425344,"data_stored":570425344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":656408576,"data_stored":656408576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":744488960,"data_stored":744488960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":432013312,"data_stored":432013312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":771751936,"data_stored":771751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":486539264,"data_stored":486539264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":356515840,"data_stored":356515840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":70250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":6483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":58451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:13:38.306 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T09:13:38.307 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-21T09:13:38.652 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-21T09:13:38.666 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-21T09:13:38.666 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:13:38.667 INFO:tasks.rgw.client.0.smithi007.stdout:2024-09-21T09:13:38.662+0000 7f1753181640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 32525) UID: 0 2024-09-21T09:13:38.667 INFO:tasks.rgw.client.0.smithi007.stdout:2024-09-21T09:13:38.662+0000 7f17569c9a40 -1 shutting down 2024-09-21T09:13:44.768 INFO:tasks.rgw.client.0:Stopped 2024-09-21T09:13:44.768 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-21T09:13:44.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/vault-root-token 2024-09-21T09:13:44.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-21T09:13:44.890 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-21T09:13:44.890 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-21T09:13:44.890 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-21T09:13:45.631 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T09:13:45.648 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T09:13:45.648 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:13:45.991 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:13:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:13:46.013 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-21T09:13:45.024801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397793038,"num_objects":773,"num_object_clones":0,"num_object_copies":1546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":773,"num_whiteouts":0,"num_read":2000,"num_read_kb":1716,"num_write":1739,"num_write_kb":2368151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":1149241676,"num_keys_recovered":26,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2531,"ondisk_log_size":2531,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4978788,"kb_used_data":4691856,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":749995932,"statfs":{"total":773094113280,"available":767995834368,"internally_reserved":0,"allocated":4804460544,"data_stored":4800336832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.735051"},"pg_stats":[{"pgid":"3.3f","version":"66'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299072+0000","last_change":"2024-09-21T09:10:56.846463+0000","last_active":"2024-09-21T09:13:34.299072+0000","last_peered":"2024-09-21T09:13:34.299072+0000","last_clean":"2024-09-21T09:13:34.299072+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:13:34.299072+0000","last_undegraded":"2024-09-21T09:13:34.299072+0000","last_fullsized":"2024-09-21T09:13:34.299072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527158+0000","last_change":"2024-09-21T09:10:58.836923+0000","last_active":"2024-09-21T09:13:35.527158+0000","last_peered":"2024-09-21T09:13:35.527158+0000","last_clean":"2024-09-21T09:13:35.527158+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:13:35.527158+0000","last_undegraded":"2024-09-21T09:13:35.527158+0000","last_fullsized":"2024-09-21T09:13:35.527158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:30.880333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"67'13","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957928+0000","last_change":"2024-09-21T09:10:56.865056+0000","last_active":"2024-09-21T09:13:34.957928+0000","last_peered":"2024-09-21T09:13:34.957928+0000","last_clean":"2024-09-21T09:13:34.957928+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:13:34.957928+0000","last_undegraded":"2024-09-21T09:13:34.957928+0000","last_fullsized":"2024-09-21T09:13:34.957928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482290+0000","last_change":"2024-09-21T09:10:58.835355+0000","last_active":"2024-09-21T09:13:34.482290+0000","last_peered":"2024-09-21T09:13:34.482290+0000","last_clean":"2024-09-21T09:13:34.482290+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:13:34.482290+0000","last_undegraded":"2024-09-21T09:13:34.482290+0000","last_fullsized":"2024-09-21T09:13:34.482290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:24.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"67'13","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957115+0000","last_change":"2024-09-21T09:10:56.861504+0000","last_active":"2024-09-21T09:13:34.957115+0000","last_peered":"2024-09-21T09:13:34.957115+0000","last_clean":"2024-09-21T09:13:34.957115+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:13:34.957115+0000","last_undegraded":"2024-09-21T09:13:34.957115+0000","last_fullsized":"2024-09-21T09:13:34.957115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:00.409267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482198+0000","last_change":"2024-09-21T09:13:19.490368+0000","last_active":"2024-09-21T09:13:34.482198+0000","last_peered":"2024-09-21T09:13:34.482198+0000","last_clean":"2024-09-21T09:13:34.482198+0000","last_became_active":"2024-09-21T09:13:19.153424+0000","last_became_peered":"2024-09-21T09:13:19.153424+0000","last_unstale":"2024-09-21T09:13:34.482198+0000","last_undegraded":"2024-09-21T09:13:34.482198+0000","last_fullsized":"2024-09-21T09:13:34.482198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:25.154789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"66'13","reported_seq":68,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298556+0000","last_change":"2024-09-21T09:13:20.586732+0000","last_active":"2024-09-21T09:13:34.298556+0000","last_peered":"2024-09-21T09:13:34.298556+0000","last_clean":"2024-09-21T09:13:34.298556+0000","last_became_active":"2024-09-21T09:13:19.165441+0000","last_became_peered":"2024-09-21T09:13:19.165441+0000","last_unstale":"2024-09-21T09:13:34.298556+0000","last_undegraded":"2024-09-21T09:13:34.298556+0000","last_fullsized":"2024-09-21T09:13:34.298556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:51.794446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"58'4","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375167+0000","last_change":"2024-09-21T09:13:20.643217+0000","last_active":"2024-09-21T09:13:35.375167+0000","last_peered":"2024-09-21T09:13:35.375167+0000","last_clean":"2024-09-21T09:13:35.375167+0000","last_became_active":"2024-09-21T09:13:19.153875+0000","last_became_peered":"2024-09-21T09:13:19.153875+0000","last_unstale":"2024-09-21T09:13:35.375167+0000","last_undegraded":"2024-09-21T09:13:35.375167+0000","last_fullsized":"2024-09-21T09:13:35.375167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:03.004434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"67'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296553+0000","last_change":"2024-09-21T09:10:56.863607+0000","last_active":"2024-09-21T09:13:34.296553+0000","last_peered":"2024-09-21T09:13:34.296553+0000","last_clean":"2024-09-21T09:13:34.296553+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:13:34.296553+0000","last_undegraded":"2024-09-21T09:13:34.296553+0000","last_fullsized":"2024-09-21T09:13:34.296553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296333+0000","last_change":"2024-09-21T09:10:58.851357+0000","last_active":"2024-09-21T09:13:34.296333+0000","last_peered":"2024-09-21T09:13:34.296333+0000","last_clean":"2024-09-21T09:13:34.296333+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:13:34.296333+0000","last_undegraded":"2024-09-21T09:13:34.296333+0000","last_fullsized":"2024-09-21T09:13:34.296333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"66'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293642+0000","last_change":"2024-09-21T09:13:19.704935+0000","last_active":"2024-09-21T09:13:34.293642+0000","last_peered":"2024-09-21T09:13:34.293642+0000","last_clean":"2024-09-21T09:13:34.293642+0000","last_became_active":"2024-09-21T09:13:19.160915+0000","last_became_peered":"2024-09-21T09:13:19.160915+0000","last_unstale":"2024-09-21T09:13:34.293642+0000","last_undegraded":"2024-09-21T09:13:34.293642+0000","last_fullsized":"2024-09-21T09:13:34.293642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:00.863610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297928+0000","last_change":"2024-09-21T09:10:58.825880+0000","last_active":"2024-09-21T09:13:34.297928+0000","last_peered":"2024-09-21T09:13:34.297928+0000","last_clean":"2024-09-21T09:13:34.297928+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:13:34.297928+0000","last_undegraded":"2024-09-21T09:13:34.297928+0000","last_fullsized":"2024-09-21T09:13:34.297928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:46.662637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"66'5","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294804+0000","last_change":"2024-09-21T09:10:56.851331+0000","last_active":"2024-09-21T09:13:34.294804+0000","last_peered":"2024-09-21T09:13:34.294804+0000","last_clean":"2024-09-21T09:13:34.294804+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:13:34.294804+0000","last_undegraded":"2024-09-21T09:13:34.294804+0000","last_fullsized":"2024-09-21T09:13:34.294804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"62'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298620+0000","last_change":"2024-09-21T09:13:20.336460+0000","last_active":"2024-09-21T09:13:34.298620+0000","last_peered":"2024-09-21T09:13:34.298620+0000","last_clean":"2024-09-21T09:13:34.298620+0000","last_became_active":"2024-09-21T09:13:19.164775+0000","last_became_peered":"2024-09-21T09:13:19.164775+0000","last_unstale":"2024-09-21T09:13:34.298620+0000","last_undegraded":"2024-09-21T09:13:34.298620+0000","last_fullsized":"2024-09-21T09:13:34.298620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:16.166364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"67'11","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955584+0000","last_change":"2024-09-21T09:10:56.864409+0000","last_active":"2024-09-21T09:13:34.955584+0000","last_peered":"2024-09-21T09:13:34.955584+0000","last_clean":"2024-09-21T09:13:34.955584+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:13:34.955584+0000","last_undegraded":"2024-09-21T09:13:34.955584+0000","last_fullsized":"2024-09-21T09:13:34.955584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"62'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958533+0000","last_change":"2024-09-21T09:10:58.837006+0000","last_active":"2024-09-21T09:13:34.958533+0000","last_peered":"2024-09-21T09:13:34.958533+0000","last_clean":"2024-09-21T09:13:34.958533+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:13:34.958533+0000","last_undegraded":"2024-09-21T09:13:34.958533+0000","last_fullsized":"2024-09-21T09:13:34.958533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:52.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482026+0000","last_change":"2024-09-21T09:10:58.853249+0000","last_active":"2024-09-21T09:13:34.482026+0000","last_peered":"2024-09-21T09:13:34.482026+0000","last_clean":"2024-09-21T09:13:34.482026+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:13:34.482026+0000","last_undegraded":"2024-09-21T09:13:34.482026+0000","last_fullsized":"2024-09-21T09:13:34.482026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:03.692219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"66'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528471+0000","last_change":"2024-09-21T09:10:56.838955+0000","last_active":"2024-09-21T09:13:35.528471+0000","last_peered":"2024-09-21T09:13:35.528471+0000","last_clean":"2024-09-21T09:13:35.528471+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:13:35.528471+0000","last_undegraded":"2024-09-21T09:13:35.528471+0000","last_fullsized":"2024-09-21T09:13:35.528471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294467+0000","last_change":"2024-09-21T09:10:58.869303+0000","last_active":"2024-09-21T09:13:34.294467+0000","last_peered":"2024-09-21T09:13:34.294467+0000","last_clean":"2024-09-21T09:13:34.294467+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:13:34.294467+0000","last_undegraded":"2024-09-21T09:13:34.294467+0000","last_fullsized":"2024-09-21T09:13:34.294467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"67'7","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298558+0000","last_change":"2024-09-21T09:13:21.021044+0000","last_active":"2024-09-21T09:13:34.298558+0000","last_peered":"2024-09-21T09:13:34.298558+0000","last_clean":"2024-09-21T09:13:34.298558+0000","last_became_active":"2024-09-21T09:13:19.154413+0000","last_became_peered":"2024-09-21T09:13:19.154413+0000","last_unstale":"2024-09-21T09:13:34.298558+0000","last_undegraded":"2024-09-21T09:13:34.298558+0000","last_fullsized":"2024-09-21T09:13:34.298558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'8","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528416+0000","last_change":"2024-09-21T09:10:58.840976+0000","last_active":"2024-09-21T09:13:35.528416+0000","last_peered":"2024-09-21T09:13:35.528416+0000","last_clean":"2024-09-21T09:13:35.528416+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:13:35.528416+0000","last_undegraded":"2024-09-21T09:13:35.528416+0000","last_fullsized":"2024-09-21T09:13:35.528416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"66'9","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298092+0000","last_change":"2024-09-21T09:10:56.853888+0000","last_active":"2024-09-21T09:13:34.298092+0000","last_peered":"2024-09-21T09:13:34.298092+0000","last_clean":"2024-09-21T09:13:34.298092+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:13:34.298092+0000","last_undegraded":"2024-09-21T09:13:34.298092+0000","last_fullsized":"2024-09-21T09:13:34.298092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294562+0000","last_change":"2024-09-21T09:10:58.838132+0000","last_active":"2024-09-21T09:13:34.294562+0000","last_peered":"2024-09-21T09:13:34.294562+0000","last_clean":"2024-09-21T09:13:34.294562+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:13:34.294562+0000","last_undegraded":"2024-09-21T09:13:34.294562+0000","last_fullsized":"2024-09-21T09:13:34.294562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"66'10","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296777+0000","last_change":"2024-09-21T09:10:56.845923+0000","last_active":"2024-09-21T09:13:34.296777+0000","last_peered":"2024-09-21T09:13:34.296777+0000","last_clean":"2024-09-21T09:13:34.296777+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:13:34.296777+0000","last_undegraded":"2024-09-21T09:13:34.296777+0000","last_fullsized":"2024-09-21T09:13:34.296777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'8","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956761+0000","last_change":"2024-09-21T09:10:58.848326+0000","last_active":"2024-09-21T09:13:34.956761+0000","last_peered":"2024-09-21T09:13:34.956761+0000","last_clean":"2024-09-21T09:13:34.956761+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:13:34.956761+0000","last_undegraded":"2024-09-21T09:13:34.956761+0000","last_fullsized":"2024-09-21T09:13:34.956761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:44.318321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"71'12","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295345+0000","last_change":"2024-09-21T09:10:56.859019+0000","last_active":"2024-09-21T09:13:34.295345+0000","last_peered":"2024-09-21T09:13:34.295345+0000","last_clean":"2024-09-21T09:13:34.295345+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:13:34.295345+0000","last_undegraded":"2024-09-21T09:13:34.295345+0000","last_fullsized":"2024-09-21T09:13:34.295345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529197+0000","last_change":"2024-09-21T09:10:58.830335+0000","last_active":"2024-09-21T09:13:35.529197+0000","last_peered":"2024-09-21T09:13:35.529197+0000","last_clean":"2024-09-21T09:13:35.529197+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:13:35.529197+0000","last_undegraded":"2024-09-21T09:13:35.529197+0000","last_fullsized":"2024-09-21T09:13:35.529197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"67'7","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294674+0000","last_change":"2024-09-21T09:10:56.862662+0000","last_active":"2024-09-21T09:13:34.294674+0000","last_peered":"2024-09-21T09:13:34.294674+0000","last_clean":"2024-09-21T09:13:34.294674+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:13:34.294674+0000","last_undegraded":"2024-09-21T09:13:34.294674+0000","last_fullsized":"2024-09-21T09:13:34.294674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295061+0000","last_change":"2024-09-21T09:11:06.898983+0000","last_active":"2024-09-21T09:13:34.295061+0000","last_peered":"2024-09-21T09:13:34.295061+0000","last_clean":"2024-09-21T09:13:34.295061+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:13:34.295061+0000","last_undegraded":"2024-09-21T09:13:34.295061+0000","last_fullsized":"2024-09-21T09:13:34.295061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294904+0000","last_change":"2024-09-21T09:10:58.876069+0000","last_active":"2024-09-21T09:13:34.294904+0000","last_peered":"2024-09-21T09:13:34.294904+0000","last_clean":"2024-09-21T09:13:34.294904+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:13:34.294904+0000","last_undegraded":"2024-09-21T09:13:34.294904+0000","last_fullsized":"2024-09-21T09:13:34.294904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"66'4","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482459+0000","last_change":"2024-09-21T09:10:56.848523+0000","last_active":"2024-09-21T09:13:34.482459+0000","last_peered":"2024-09-21T09:13:34.482459+0000","last_clean":"2024-09-21T09:13:34.482459+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:13:34.482459+0000","last_undegraded":"2024-09-21T09:13:34.482459+0000","last_fullsized":"2024-09-21T09:13:34.482459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:19.819608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483302+0000","last_change":"2024-09-21T09:11:00.842168+0000","last_active":"2024-09-21T09:13:34.483302+0000","last_peered":"2024-09-21T09:13:34.483302+0000","last_clean":"2024-09-21T09:13:34.483302+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:13:34.483302+0000","last_undegraded":"2024-09-21T09:13:34.483302+0000","last_fullsized":"2024-09-21T09:13:34.483302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:33.920548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"71'15","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377878+0000","last_change":"2024-09-21T09:11:02.866403+0000","last_active":"2024-09-21T09:13:35.377878+0000","last_peered":"2024-09-21T09:13:35.377878+0000","last_clean":"2024-09-21T09:13:35.377878+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:13:35.377878+0000","last_undegraded":"2024-09-21T09:13:35.377878+0000","last_fullsized":"2024-09-21T09:13:35.377878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:12.124539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527948+0000","last_change":"2024-09-21T09:11:04.894715+0000","last_active":"2024-09-21T09:13:35.527948+0000","last_peered":"2024-09-21T09:13:35.527948+0000","last_clean":"2024-09-21T09:13:35.527948+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:13:35.527948+0000","last_undegraded":"2024-09-21T09:13:35.527948+0000","last_fullsized":"2024-09-21T09:13:35.527948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:59.579572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"58'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527415+0000","last_change":"2024-09-21T09:11:06.885484+0000","last_active":"2024-09-21T09:13:35.527415+0000","last_peered":"2024-09-21T09:13:35.527415+0000","last_clean":"2024-09-21T09:13:35.527415+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:13:35.527415+0000","last_undegraded":"2024-09-21T09:13:35.527415+0000","last_fullsized":"2024-09-21T09:13:35.527415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:13.165470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"61'6","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483104+0000","last_change":"2024-09-21T09:10:58.842832+0000","last_active":"2024-09-21T09:13:34.483104+0000","last_peered":"2024-09-21T09:13:34.483104+0000","last_clean":"2024-09-21T09:13:34.483104+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:13:34.483104+0000","last_undegraded":"2024-09-21T09:13:34.483104+0000","last_fullsized":"2024-09-21T09:13:34.483104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:12.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:56.849428+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375922+0000","last_change":"2024-09-21T09:13:19.156069+0000","last_active":"2024-09-21T09:13:35.375922+0000","last_peered":"2024-09-21T09:13:35.375922+0000","last_clean":"2024-09-21T09:13:35.375922+0000","last_became_active":"2024-09-21T09:13:19.153940+0000","last_became_peered":"2024-09-21T09:13:19.153940+0000","last_unstale":"2024-09-21T09:13:35.375922+0000","last_undegraded":"2024-09-21T09:13:35.375922+0000","last_fullsized":"2024-09-21T09:13:35.375922+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:57.795849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526564+0000","last_change":"2024-09-21T09:11:02.866594+0000","last_active":"2024-09-21T09:13:35.526564+0000","last_peered":"2024-09-21T09:13:35.526564+0000","last_clean":"2024-09-21T09:13:35.526564+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:13:35.526564+0000","last_undegraded":"2024-09-21T09:13:35.526564+0000","last_fullsized":"2024-09-21T09:13:35.526564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526934+0000","last_change":"2024-09-21T09:11:04.887299+0000","last_active":"2024-09-21T09:13:35.526934+0000","last_peered":"2024-09-21T09:13:35.526934+0000","last_clean":"2024-09-21T09:13:35.526934+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:13:35.526934+0000","last_undegraded":"2024-09-21T09:13:35.526934+0000","last_fullsized":"2024-09-21T09:13:35.526934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:08.490686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":129,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294124+0000","last_change":"2024-09-21T09:13:19.145016+0000","last_active":"2024-09-21T09:13:34.294124+0000","last_peered":"2024-09-21T09:13:34.294124+0000","last_clean":"2024-09-21T09:13:34.294124+0000","last_became_active":"2024-09-21T09:13:19.144143+0000","last_became_peered":"2024-09-21T09:13:19.144143+0000","last_unstale":"2024-09-21T09:13:34.294124+0000","last_undegraded":"2024-09-21T09:13:34.294124+0000","last_fullsized":"2024-09-21T09:13:34.294124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957751+0000","last_change":"2024-09-21T09:10:58.851370+0000","last_active":"2024-09-21T09:13:34.957751+0000","last_peered":"2024-09-21T09:13:34.957751+0000","last_clean":"2024-09-21T09:13:34.957751+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:13:34.957751+0000","last_undegraded":"2024-09-21T09:13:34.957751+0000","last_fullsized":"2024-09-21T09:13:34.957751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:05.984687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"66'4","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482409+0000","last_change":"2024-09-21T09:13:21.119832+0000","last_active":"2024-09-21T09:13:34.482409+0000","last_peered":"2024-09-21T09:13:34.482409+0000","last_clean":"2024-09-21T09:13:34.482409+0000","last_became_active":"2024-09-21T09:13:19.159398+0000","last_became_peered":"2024-09-21T09:13:19.159398+0000","last_unstale":"2024-09-21T09:13:34.482409+0000","last_undegraded":"2024-09-21T09:13:34.482409+0000","last_fullsized":"2024-09-21T09:13:34.482409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:40.942331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377709+0000","last_change":"2024-09-21T09:11:00.845836+0000","last_active":"2024-09-21T09:13:35.377709+0000","last_peered":"2024-09-21T09:13:35.377709+0000","last_clean":"2024-09-21T09:13:35.377709+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:13:35.377709+0000","last_undegraded":"2024-09-21T09:13:35.377709+0000","last_fullsized":"2024-09-21T09:13:35.377709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:06.353993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376373+0000","last_change":"2024-09-21T09:11:02.852500+0000","last_active":"2024-09-21T09:13:35.376373+0000","last_peered":"2024-09-21T09:13:35.376373+0000","last_clean":"2024-09-21T09:13:35.376373+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:13:35.376373+0000","last_undegraded":"2024-09-21T09:13:35.376373+0000","last_fullsized":"2024-09-21T09:13:35.376373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:19.073540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"91'102","reported_seq":329,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042597+0000","last_change":"2024-09-21T09:11:04.895087+0000","last_active":"2024-09-21T09:13:36.042597+0000","last_peered":"2024-09-21T09:13:36.042597+0000","last_clean":"2024-09-21T09:13:36.042597+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:13:36.042597+0000","last_undegraded":"2024-09-21T09:13:36.042597+0000","last_fullsized":"2024-09-21T09:13:36.042597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:11.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295621+0000","last_change":"2024-09-21T09:13:19.162437+0000","last_active":"2024-09-21T09:13:34.295621+0000","last_peered":"2024-09-21T09:13:34.295621+0000","last_clean":"2024-09-21T09:13:34.295621+0000","last_became_active":"2024-09-21T09:13:19.161659+0000","last_became_peered":"2024-09-21T09:13:19.161659+0000","last_unstale":"2024-09-21T09:13:34.295621+0000","last_undegraded":"2024-09-21T09:13:34.295621+0000","last_fullsized":"2024-09-21T09:13:34.295621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:59.822101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958090+0000","last_change":"2024-09-21T09:10:58.837602+0000","last_active":"2024-09-21T09:13:34.958090+0000","last_peered":"2024-09-21T09:13:34.958090+0000","last_clean":"2024-09-21T09:13:34.958090+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:13:34.958090+0000","last_undegraded":"2024-09-21T09:13:34.958090+0000","last_fullsized":"2024-09-21T09:13:34.958090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:36.269116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"67'17","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527550+0000","last_change":"2024-09-21T09:10:56.844292+0000","last_active":"2024-09-21T09:13:35.527550+0000","last_peered":"2024-09-21T09:13:35.527550+0000","last_clean":"2024-09-21T09:13:35.527550+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:13:35.527550+0000","last_undegraded":"2024-09-21T09:13:35.527550+0000","last_fullsized":"2024-09-21T09:13:35.527550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482929+0000","last_change":"2024-09-21T09:11:00.852984+0000","last_active":"2024-09-21T09:13:34.482929+0000","last_peered":"2024-09-21T09:13:34.482929+0000","last_clean":"2024-09-21T09:13:34.482929+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:13:34.482929+0000","last_undegraded":"2024-09-21T09:13:34.482929+0000","last_fullsized":"2024-09-21T09:13:34.482929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:33.175145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"71'15","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299712+0000","last_change":"2024-09-21T09:13:19.543924+0000","last_active":"2024-09-21T09:13:34.299712+0000","last_peered":"2024-09-21T09:13:34.299712+0000","last_clean":"2024-09-21T09:13:34.299712+0000","last_became_active":"2024-09-21T09:13:19.160798+0000","last_became_peered":"2024-09-21T09:13:19.160798+0000","last_unstale":"2024-09-21T09:13:34.299712+0000","last_undegraded":"2024-09-21T09:13:34.299712+0000","last_fullsized":"2024-09-21T09:13:34.299712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"91'102","reported_seq":303,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042349+0000","last_change":"2024-09-21T09:11:04.894947+0000","last_active":"2024-09-21T09:13:36.042349+0000","last_peered":"2024-09-21T09:13:36.042349+0000","last_clean":"2024-09-21T09:13:36.042349+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:13:36.042349+0000","last_undegraded":"2024-09-21T09:13:36.042349+0000","last_fullsized":"2024-09-21T09:13:36.042349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:21.481386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482063+0000","last_change":"2024-09-21T09:10:58.841384+0000","last_active":"2024-09-21T09:13:34.482063+0000","last_peered":"2024-09-21T09:13:34.482063+0000","last_clean":"2024-09-21T09:13:34.482063+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:13:34.482063+0000","last_undegraded":"2024-09-21T09:13:34.482063+0000","last_fullsized":"2024-09-21T09:13:34.482063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:08.308265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"67'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299480+0000","last_change":"2024-09-21T09:10:56.846710+0000","last_active":"2024-09-21T09:13:34.299480+0000","last_peered":"2024-09-21T09:13:34.299480+0000","last_clean":"2024-09-21T09:13:34.299480+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:13:34.299480+0000","last_undegraded":"2024-09-21T09:13:34.299480+0000","last_fullsized":"2024-09-21T09:13:34.299480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527660+0000","last_change":"2024-09-21T09:11:00.839560+0000","last_active":"2024-09-21T09:13:35.527660+0000","last_peered":"2024-09-21T09:13:35.527660+0000","last_clean":"2024-09-21T09:13:35.527660+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:13:35.527660+0000","last_undegraded":"2024-09-21T09:13:35.527660+0000","last_fullsized":"2024-09-21T09:13:35.527660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:41.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"71'26","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295964+0000","last_change":"2024-09-21T09:11:02.872323+0000","last_active":"2024-09-21T09:13:34.295964+0000","last_peered":"2024-09-21T09:13:34.295964+0000","last_clean":"2024-09-21T09:13:34.295964+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:13:34.295964+0000","last_undegraded":"2024-09-21T09:13:34.295964+0000","last_fullsized":"2024-09-21T09:13:34.295964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294211+0000","last_change":"2024-09-21T09:13:19.150862+0000","last_active":"2024-09-21T09:13:34.294211+0000","last_peered":"2024-09-21T09:13:34.294211+0000","last_clean":"2024-09-21T09:13:34.294211+0000","last_became_active":"2024-09-21T09:13:19.149936+0000","last_became_peered":"2024-09-21T09:13:19.149936+0000","last_unstale":"2024-09-21T09:13:34.294211+0000","last_undegraded":"2024-09-21T09:13:34.294211+0000","last_fullsized":"2024-09-21T09:13:34.294211+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.535171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"62'12","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298350+0000","last_change":"2024-09-21T09:13:20.340381+0000","last_active":"2024-09-21T09:13:34.298350+0000","last_peered":"2024-09-21T09:13:34.298350+0000","last_clean":"2024-09-21T09:13:34.298350+0000","last_became_active":"2024-09-21T09:13:19.165108+0000","last_became_peered":"2024-09-21T09:13:19.165108+0000","last_unstale":"2024-09-21T09:13:34.298350+0000","last_undegraded":"2024-09-21T09:13:34.298350+0000","last_fullsized":"2024-09-21T09:13:34.298350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:41.830217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527807+0000","last_change":"2024-09-21T09:10:58.839960+0000","last_active":"2024-09-21T09:13:35.527807+0000","last_peered":"2024-09-21T09:13:35.527807+0000","last_clean":"2024-09-21T09:13:35.527807+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:13:35.527807+0000","last_undegraded":"2024-09-21T09:13:35.527807+0000","last_fullsized":"2024-09-21T09:13:35.527807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"67'7","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298110+0000","last_change":"2024-09-21T09:13:20.333955+0000","last_active":"2024-09-21T09:13:34.298110+0000","last_peered":"2024-09-21T09:13:34.298110+0000","last_clean":"2024-09-21T09:13:34.298110+0000","last_became_active":"2024-09-21T09:13:19.162605+0000","last_became_peered":"2024-09-21T09:13:19.162605+0000","last_unstale":"2024-09-21T09:13:34.298110+0000","last_undegraded":"2024-09-21T09:13:34.298110+0000","last_fullsized":"2024-09-21T09:13:34.298110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:21.030407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293432+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.293432+0000","last_peered":"2024-09-21T09:13:34.293432+0000","last_clean":"2024-09-21T09:13:34.293432+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:13:34.293432+0000","last_undegraded":"2024-09-21T09:13:34.293432+0000","last_fullsized":"2024-09-21T09:13:34.293432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:48.669684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"71'16","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376624+0000","last_change":"2024-09-21T09:11:02.866165+0000","last_active":"2024-09-21T09:13:35.376624+0000","last_peered":"2024-09-21T09:13:35.376624+0000","last_clean":"2024-09-21T09:13:35.376624+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:13:35.376624+0000","last_undegraded":"2024-09-21T09:13:35.376624+0000","last_fullsized":"2024-09-21T09:13:35.376624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:54:48.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376278+0000","last_change":"2024-09-21T09:11:04.871999+0000","last_active":"2024-09-21T09:13:35.376278+0000","last_peered":"2024-09-21T09:13:35.376278+0000","last_clean":"2024-09-21T09:13:35.376278+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:13:35.376278+0000","last_undegraded":"2024-09-21T09:13:35.376278+0000","last_fullsized":"2024-09-21T09:13:35.376278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:03.218684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"58'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528795+0000","last_change":"2024-09-21T09:13:19.709890+0000","last_active":"2024-09-21T09:13:35.528795+0000","last_peered":"2024-09-21T09:13:35.528795+0000","last_clean":"2024-09-21T09:13:35.528795+0000","last_became_active":"2024-09-21T09:13:19.167145+0000","last_became_peered":"2024-09-21T09:13:19.167145+0000","last_unstale":"2024-09-21T09:13:35.528795+0000","last_undegraded":"2024-09-21T09:13:35.528795+0000","last_fullsized":"2024-09-21T09:13:35.528795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294491+0000","last_change":"2024-09-21T09:13:19.528866+0000","last_active":"2024-09-21T09:13:34.294491+0000","last_peered":"2024-09-21T09:13:34.294491+0000","last_clean":"2024-09-21T09:13:34.294491+0000","last_became_active":"2024-09-21T09:13:19.158113+0000","last_became_peered":"2024-09-21T09:13:19.158113+0000","last_unstale":"2024-09-21T09:13:34.294491+0000","last_undegraded":"2024-09-21T09:13:34.294491+0000","last_fullsized":"2024-09-21T09:13:34.294491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:48.503141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"66'18","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482839+0000","last_change":"2024-09-21T09:10:56.842697+0000","last_active":"2024-09-21T09:13:34.482839+0000","last_peered":"2024-09-21T09:13:34.482839+0000","last_clean":"2024-09-21T09:13:34.482839+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:13:34.482839+0000","last_undegraded":"2024-09-21T09:13:34.482839+0000","last_fullsized":"2024-09-21T09:13:34.482839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:42.311166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957018+0000","last_change":"2024-09-21T09:11:00.852970+0000","last_active":"2024-09-21T09:13:34.957018+0000","last_peered":"2024-09-21T09:13:34.957018+0000","last_clean":"2024-09-21T09:13:34.957018+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:13:34.957018+0000","last_undegraded":"2024-09-21T09:13:34.957018+0000","last_fullsized":"2024-09-21T09:13:34.957018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:35.201984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"71'21","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481917+0000","last_change":"2024-09-21T09:11:02.859081+0000","last_active":"2024-09-21T09:13:34.481917+0000","last_peered":"2024-09-21T09:13:34.481917+0000","last_clean":"2024-09-21T09:13:34.481917+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:13:34.481917+0000","last_undegraded":"2024-09-21T09:13:34.481917+0000","last_fullsized":"2024-09-21T09:13:34.481917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:19.576627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"91'102","reported_seq":258,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042372+0000","last_change":"2024-09-21T09:11:04.895980+0000","last_active":"2024-09-21T09:13:36.042372+0000","last_peered":"2024-09-21T09:13:36.042372+0000","last_clean":"2024-09-21T09:13:36.042372+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:13:36.042372+0000","last_undegraded":"2024-09-21T09:13:36.042372+0000","last_fullsized":"2024-09-21T09:13:36.042372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:57.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295156+0000","last_change":"2024-09-21T09:13:20.635132+0000","last_active":"2024-09-21T09:13:34.295156+0000","last_peered":"2024-09-21T09:13:34.295156+0000","last_clean":"2024-09-21T09:13:34.295156+0000","last_became_active":"2024-09-21T09:13:19.159646+0000","last_became_peered":"2024-09-21T09:13:19.159646+0000","last_unstale":"2024-09-21T09:13:34.295156+0000","last_undegraded":"2024-09-21T09:13:34.295156+0000","last_fullsized":"2024-09-21T09:13:34.295156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:10.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956296+0000","last_change":"2024-09-21T09:10:58.871951+0000","last_active":"2024-09-21T09:13:34.956296+0000","last_peered":"2024-09-21T09:13:34.956296+0000","last_clean":"2024-09-21T09:13:34.956296+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:13:34.956296+0000","last_undegraded":"2024-09-21T09:13:34.956296+0000","last_fullsized":"2024-09-21T09:13:34.956296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:16.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"66'7","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297543+0000","last_change":"2024-09-21T09:10:56.855073+0000","last_active":"2024-09-21T09:13:34.297543+0000","last_peered":"2024-09-21T09:13:34.297543+0000","last_clean":"2024-09-21T09:13:34.297543+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:13:34.297543+0000","last_undegraded":"2024-09-21T09:13:34.297543+0000","last_fullsized":"2024-09-21T09:13:34.297543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:43.818365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294089+0000","last_change":"2024-09-21T09:11:00.845552+0000","last_active":"2024-09-21T09:13:34.294089+0000","last_peered":"2024-09-21T09:13:34.294089+0000","last_clean":"2024-09-21T09:13:34.294089+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:13:34.294089+0000","last_undegraded":"2024-09-21T09:13:34.294089+0000","last_fullsized":"2024-09-21T09:13:34.294089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:44.841947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"71'24","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376051+0000","last_change":"2024-09-21T09:11:02.868260+0000","last_active":"2024-09-21T09:13:35.376051+0000","last_peered":"2024-09-21T09:13:35.376051+0000","last_clean":"2024-09-21T09:13:35.376051+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:13:35.376051+0000","last_undegraded":"2024-09-21T09:13:35.376051+0000","last_fullsized":"2024-09-21T09:13:35.376051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:38.299285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955882+0000","last_change":"2024-09-21T09:11:04.890815+0000","last_active":"2024-09-21T09:13:34.955882+0000","last_peered":"2024-09-21T09:13:34.955882+0000","last_clean":"2024-09-21T09:13:34.955882+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:13:34.955882+0000","last_undegraded":"2024-09-21T09:13:34.955882+0000","last_fullsized":"2024-09-21T09:13:34.955882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:26.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527522+0000","last_change":"2024-09-21T09:11:06.888148+0000","last_active":"2024-09-21T09:13:34.527522+0000","last_peered":"2024-09-21T09:13:34.527522+0000","last_clean":"2024-09-21T09:13:34.527522+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:13:34.527522+0000","last_undegraded":"2024-09-21T09:13:34.527522+0000","last_fullsized":"2024-09-21T09:13:34.527522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296971+0000","last_change":"2024-09-21T09:10:58.871840+0000","last_active":"2024-09-21T09:13:34.296971+0000","last_peered":"2024-09-21T09:13:34.296971+0000","last_clean":"2024-09-21T09:13:34.296971+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:13:34.296971+0000","last_undegraded":"2024-09-21T09:13:34.296971+0000","last_fullsized":"2024-09-21T09:13:34.296971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"67'7","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526772+0000","last_change":"2024-09-21T09:10:56.855886+0000","last_active":"2024-09-21T09:13:34.526772+0000","last_peered":"2024-09-21T09:13:34.526772+0000","last_clean":"2024-09-21T09:13:34.526772+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:13:34.526772+0000","last_undegraded":"2024-09-21T09:13:34.526772+0000","last_fullsized":"2024-09-21T09:13:34.526772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526968+0000","last_change":"2024-09-21T09:11:00.850308+0000","last_active":"2024-09-21T09:13:34.526968+0000","last_peered":"2024-09-21T09:13:34.526968+0000","last_clean":"2024-09-21T09:13:34.526968+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:13:34.526968+0000","last_undegraded":"2024-09-21T09:13:34.526968+0000","last_fullsized":"2024-09-21T09:13:34.526968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:13.608546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"71'17","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526415+0000","last_change":"2024-09-21T09:11:02.866122+0000","last_active":"2024-09-21T09:13:35.526415+0000","last_peered":"2024-09-21T09:13:35.526415+0000","last_clean":"2024-09-21T09:13:35.526415+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:13:35.526415+0000","last_undegraded":"2024-09-21T09:13:35.526415+0000","last_fullsized":"2024-09-21T09:13:35.526415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527462+0000","last_change":"2024-09-21T09:11:04.880608+0000","last_active":"2024-09-21T09:13:34.527462+0000","last_peered":"2024-09-21T09:13:34.527462+0000","last_clean":"2024-09-21T09:13:34.527462+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:13:34.527462+0000","last_undegraded":"2024-09-21T09:13:34.527462+0000","last_fullsized":"2024-09-21T09:13:34.527462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:39.226968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955061+0000","last_change":"2024-09-21T09:11:06.892201+0000","last_active":"2024-09-21T09:13:34.955061+0000","last_peered":"2024-09-21T09:13:34.955061+0000","last_clean":"2024-09-21T09:13:34.955061+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:13:34.955061+0000","last_undegraded":"2024-09-21T09:13:34.955061+0000","last_fullsized":"2024-09-21T09:13:34.955061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:32.463353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483248+0000","last_change":"2024-09-21T09:10:58.838223+0000","last_active":"2024-09-21T09:13:34.483248+0000","last_peered":"2024-09-21T09:13:34.483248+0000","last_clean":"2024-09-21T09:13:34.483248+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:13:34.483248+0000","last_undegraded":"2024-09-21T09:13:34.483248+0000","last_fullsized":"2024-09-21T09:13:34.483248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:01.253234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"67'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482527+0000","last_change":"2024-09-21T09:10:56.841106+0000","last_active":"2024-09-21T09:13:34.482527+0000","last_peered":"2024-09-21T09:13:34.482527+0000","last_clean":"2024-09-21T09:13:34.482527+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:13:34.482527+0000","last_undegraded":"2024-09-21T09:13:34.482527+0000","last_fullsized":"2024-09-21T09:13:34.482527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:40.827746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956508+0000","last_change":"2024-09-21T09:11:00.841164+0000","last_active":"2024-09-21T09:13:34.956508+0000","last_peered":"2024-09-21T09:13:34.956508+0000","last_clean":"2024-09-21T09:13:34.956508+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:13:34.956508+0000","last_undegraded":"2024-09-21T09:13:34.956508+0000","last_fullsized":"2024-09-21T09:13:34.956508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:05.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"71'23","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957641+0000","last_change":"2024-09-21T09:11:02.852292+0000","last_active":"2024-09-21T09:13:34.957641+0000","last_peered":"2024-09-21T09:13:34.957641+0000","last_clean":"2024-09-21T09:13:34.957641+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:13:34.957641+0000","last_undegraded":"2024-09-21T09:13:34.957641+0000","last_fullsized":"2024-09-21T09:13:34.957641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:12.322229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"91'102","reported_seq":297,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042645+0000","last_change":"2024-09-21T09:11:04.892391+0000","last_active":"2024-09-21T09:13:36.042645+0000","last_peered":"2024-09-21T09:13:36.042645+0000","last_clean":"2024-09-21T09:13:36.042645+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:13:36.042645+0000","last_undegraded":"2024-09-21T09:13:36.042645+0000","last_fullsized":"2024-09-21T09:13:36.042645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:52.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293567+0000","last_change":"2024-09-21T09:11:06.883898+0000","last_active":"2024-09-21T09:13:34.293567+0000","last_peered":"2024-09-21T09:13:34.293567+0000","last_clean":"2024-09-21T09:13:34.293567+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:13:34.293567+0000","last_undegraded":"2024-09-21T09:13:34.293567+0000","last_fullsized":"2024-09-21T09:13:34.293567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298809+0000","last_change":"2024-09-21T09:13:20.217794+0000","last_active":"2024-09-21T09:13:34.298809+0000","last_peered":"2024-09-21T09:13:34.298809+0000","last_clean":"2024-09-21T09:13:34.298809+0000","last_became_active":"2024-09-21T09:13:19.161819+0000","last_became_peered":"2024-09-21T09:13:19.161819+0000","last_unstale":"2024-09-21T09:13:34.298809+0000","last_undegraded":"2024-09-21T09:13:34.298809+0000","last_fullsized":"2024-09-21T09:13:34.298809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:41.176970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"67'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482438+0000","last_change":"2024-09-21T09:10:56.844590+0000","last_active":"2024-09-21T09:13:34.482438+0000","last_peered":"2024-09-21T09:13:34.482438+0000","last_clean":"2024-09-21T09:13:34.482438+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:13:34.482438+0000","last_undegraded":"2024-09-21T09:13:34.482438+0000","last_fullsized":"2024-09-21T09:13:34.482438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:20.839825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":268,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528244+0000","last_change":"2024-09-21T09:11:00.839056+0000","last_active":"2024-09-21T09:13:35.528244+0000","last_peered":"2024-09-21T09:13:35.528244+0000","last_clean":"2024-09-21T09:13:35.528244+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:13:35.528244+0000","last_undegraded":"2024-09-21T09:13:35.528244+0000","last_fullsized":"2024-09-21T09:13:35.528244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:07.991734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"65'11","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294566+0000","last_change":"2024-09-21T09:11:02.876439+0000","last_active":"2024-09-21T09:13:34.294566+0000","last_peered":"2024-09-21T09:13:34.294566+0000","last_clean":"2024-09-21T09:13:34.294566+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:13:34.294566+0000","last_undegraded":"2024-09-21T09:13:34.294566+0000","last_fullsized":"2024-09-21T09:13:34.294566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"91'102","reported_seq":311,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042974+0000","last_change":"2024-09-21T09:11:04.884790+0000","last_active":"2024-09-21T09:13:36.042974+0000","last_peered":"2024-09-21T09:13:36.042974+0000","last_clean":"2024-09-21T09:13:36.042974+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:13:36.042974+0000","last_undegraded":"2024-09-21T09:13:36.042974+0000","last_fullsized":"2024-09-21T09:13:36.042974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:00.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294059+0000","last_change":"2024-09-21T09:13:19.158996+0000","last_active":"2024-09-21T09:13:34.294059+0000","last_peered":"2024-09-21T09:13:34.294059+0000","last_clean":"2024-09-21T09:13:34.294059+0000","last_became_active":"2024-09-21T09:13:19.139533+0000","last_became_peered":"2024-09-21T09:13:19.139533+0000","last_unstale":"2024-09-21T09:13:34.294059+0000","last_undegraded":"2024-09-21T09:13:34.294059+0000","last_fullsized":"2024-09-21T09:13:34.294059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:03.695046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527899+0000","last_change":"2024-09-21T09:10:58.873730+0000","last_active":"2024-09-21T09:13:34.527899+0000","last_peered":"2024-09-21T09:13:34.527899+0000","last_clean":"2024-09-21T09:13:34.527899+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:13:34.527899+0000","last_undegraded":"2024-09-21T09:13:34.527899+0000","last_fullsized":"2024-09-21T09:13:34.527899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"67'2","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377281+0000","last_change":"2024-09-21T09:10:56.849104+0000","last_active":"2024-09-21T09:13:35.377281+0000","last_peered":"2024-09-21T09:13:35.377281+0000","last_clean":"2024-09-21T09:13:35.377281+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:13:35.377281+0000","last_undegraded":"2024-09-21T09:13:35.377281+0000","last_fullsized":"2024-09-21T09:13:35.377281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:34.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483039+0000","last_change":"2024-09-21T09:11:00.841893+0000","last_active":"2024-09-21T09:13:34.483039+0000","last_peered":"2024-09-21T09:13:34.483039+0000","last_clean":"2024-09-21T09:13:34.483039+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:13:34.483039+0000","last_undegraded":"2024-09-21T09:13:34.483039+0000","last_fullsized":"2024-09-21T09:13:34.483039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:55.253483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"71'23","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528948+0000","last_change":"2024-09-21T09:11:02.867833+0000","last_active":"2024-09-21T09:13:35.528948+0000","last_peered":"2024-09-21T09:13:35.528948+0000","last_clean":"2024-09-21T09:13:35.528948+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:13:35.528948+0000","last_undegraded":"2024-09-21T09:13:35.528948+0000","last_fullsized":"2024-09-21T09:13:35.528948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298750+0000","last_change":"2024-09-21T09:13:19.166139+0000","last_active":"2024-09-21T09:13:34.298750+0000","last_peered":"2024-09-21T09:13:34.298750+0000","last_clean":"2024-09-21T09:13:34.298750+0000","last_became_active":"2024-09-21T09:13:19.164969+0000","last_became_peered":"2024-09-21T09:13:19.164969+0000","last_unstale":"2024-09-21T09:13:34.298750+0000","last_undegraded":"2024-09-21T09:13:34.298750+0000","last_fullsized":"2024-09-21T09:13:34.298750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:05.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"62'12","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526114+0000","last_change":"2024-09-21T09:11:06.883751+0000","last_active":"2024-09-21T09:13:34.526114+0000","last_peered":"2024-09-21T09:13:34.526114+0000","last_clean":"2024-09-21T09:13:34.526114+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:13:34.526114+0000","last_undegraded":"2024-09-21T09:13:34.526114+0000","last_fullsized":"2024-09-21T09:13:34.526114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:09.296705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482855+0000","last_change":"2024-09-21T09:10:58.838888+0000","last_active":"2024-09-21T09:13:34.482855+0000","last_peered":"2024-09-21T09:13:34.482855+0000","last_clean":"2024-09-21T09:13:34.482855+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:13:34.482855+0000","last_undegraded":"2024-09-21T09:13:34.482855+0000","last_fullsized":"2024-09-21T09:13:34.482855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:53.547541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":304,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527650+0000","last_change":"2024-09-21T09:10:44.726458+0000","last_active":"2024-09-21T09:13:35.527650+0000","last_peered":"2024-09-21T09:13:35.527650+0000","last_clean":"2024-09-21T09:13:35.527650+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:13:35.527650+0000","last_undegraded":"2024-09-21T09:13:35.527650+0000","last_fullsized":"2024-09-21T09:13:35.527650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_clean_scrub_stamp":"2024-09-21T09:10:43.702491+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:07.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482574+0000","last_change":"2024-09-21T09:13:20.381044+0000","last_active":"2024-09-21T09:13:34.482574+0000","last_peered":"2024-09-21T09:13:34.482574+0000","last_clean":"2024-09-21T09:13:34.482574+0000","last_became_active":"2024-09-21T09:13:19.155065+0000","last_became_peered":"2024-09-21T09:13:19.155065+0000","last_unstale":"2024-09-21T09:13:34.482574+0000","last_undegraded":"2024-09-21T09:13:34.482574+0000","last_fullsized":"2024-09-21T09:13:34.482574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:51.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":204,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375084+0000","last_change":"2024-09-21T09:13:19.483993+0000","last_active":"2024-09-21T09:13:35.375084+0000","last_peered":"2024-09-21T09:13:35.375084+0000","last_clean":"2024-09-21T09:13:35.375084+0000","last_became_active":"2024-09-21T09:13:19.152677+0000","last_became_peered":"2024-09-21T09:13:19.152677+0000","last_unstale":"2024-09-21T09:13:35.375084+0000","last_undegraded":"2024-09-21T09:13:35.375084+0000","last_fullsized":"2024-09-21T09:13:35.375084+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:26.411630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:11:00.845448+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"71'33","reported_seq":175,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483133+0000","last_change":"2024-09-21T09:11:02.863275+0000","last_active":"2024-09-21T09:13:34.483133+0000","last_peered":"2024-09-21T09:13:34.483133+0000","last_clean":"2024-09-21T09:13:34.483133+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:13:34.483133+0000","last_undegraded":"2024-09-21T09:13:34.483133+0000","last_fullsized":"2024-09-21T09:13:34.483133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:39.968749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4873,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957584+0000","last_change":"2024-09-21T09:11:04.894538+0000","last_active":"2024-09-21T09:13:34.957584+0000","last_peered":"2024-09-21T09:13:34.957584+0000","last_clean":"2024-09-21T09:13:34.957584+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:13:34.957584+0000","last_undegraded":"2024-09-21T09:13:34.957584+0000","last_fullsized":"2024-09-21T09:13:34.957584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.154030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"71'6","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294223+0000","last_change":"2024-09-21T09:13:19.487021+0000","last_active":"2024-09-21T09:13:34.294223+0000","last_peered":"2024-09-21T09:13:34.294223+0000","last_clean":"2024-09-21T09:13:34.294223+0000","last_became_active":"2024-09-21T09:13:19.153438+0000","last_became_peered":"2024-09-21T09:13:19.153438+0000","last_unstale":"2024-09-21T09:13:34.294223+0000","last_undegraded":"2024-09-21T09:13:34.294223+0000","last_fullsized":"2024-09-21T09:13:34.294223+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:22.759172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":422,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957786+0000","last_change":"2024-09-21T09:10:58.855489+0000","last_active":"2024-09-21T09:13:34.957786+0000","last_peered":"2024-09-21T09:13:34.957786+0000","last_clean":"2024-09-21T09:13:34.957786+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:13:34.957786+0000","last_undegraded":"2024-09-21T09:13:34.957786+0000","last_fullsized":"2024-09-21T09:13:34.957786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:04.859633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482280+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:13:34.482280+0000","last_peered":"2024-09-21T09:13:34.482280+0000","last_clean":"2024-09-21T09:13:34.482280+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:13:34.482280+0000","last_undegraded":"2024-09-21T09:13:34.482280+0000","last_fullsized":"2024-09-21T09:13:34.482280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:09.405380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"66'7","reported_seq":188,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294349+0000","last_change":"2024-09-21T09:13:19.304956+0000","last_active":"2024-09-21T09:13:34.294349+0000","last_peered":"2024-09-21T09:13:34.294349+0000","last_clean":"2024-09-21T09:13:34.294349+0000","last_became_active":"2024-09-21T09:13:19.142666+0000","last_became_peered":"2024-09-21T09:13:19.142666+0000","last_unstale":"2024-09-21T09:13:34.294349+0000","last_undegraded":"2024-09-21T09:13:34.294349+0000","last_fullsized":"2024-09-21T09:13:34.294349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:08.103741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483007+0000","last_change":"2024-09-21T09:11:00.845917+0000","last_active":"2024-09-21T09:13:34.483007+0000","last_peered":"2024-09-21T09:13:34.483007+0000","last_clean":"2024-09-21T09:13:34.483007+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:13:34.483007+0000","last_undegraded":"2024-09-21T09:13:34.483007+0000","last_fullsized":"2024-09-21T09:13:34.483007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:59.152254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"91'109","reported_seq":320,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042404+0000","last_change":"2024-09-21T09:11:02.871422+0000","last_active":"2024-09-21T09:13:36.042404+0000","last_peered":"2024-09-21T09:13:36.042404+0000","last_clean":"2024-09-21T09:13:36.042404+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:13:36.042404+0000","last_undegraded":"2024-09-21T09:13:36.042404+0000","last_fullsized":"2024-09-21T09:13:36.042404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:57.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61997,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":28,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483210+0000","last_change":"2024-09-21T09:11:04.893734+0000","last_active":"2024-09-21T09:13:34.483210+0000","last_peered":"2024-09-21T09:13:34.483210+0000","last_clean":"2024-09-21T09:13:34.483210+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:34.483210+0000","last_undegraded":"2024-09-21T09:13:34.483210+0000","last_fullsized":"2024-09-21T09:13:34.483210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.709917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"58'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955754+0000","last_change":"2024-09-21T09:11:06.895362+0000","last_active":"2024-09-21T09:13:34.955754+0000","last_peered":"2024-09-21T09:13:34.955754+0000","last_clean":"2024-09-21T09:13:34.955754+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:13:34.955754+0000","last_undegraded":"2024-09-21T09:13:34.955754+0000","last_fullsized":"2024-09-21T09:13:34.955754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:23.606134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:10:58.831552+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526089+0000","last_change":"2024-09-21T09:10:51.587265+0000","last_active":"2024-09-21T09:13:34.526089+0000","last_peered":"2024-09-21T09:13:34.526089+0000","last_clean":"2024-09-21T09:13:34.526089+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:13:34.526089+0000","last_undegraded":"2024-09-21T09:13:34.526089+0000","last_fullsized":"2024-09-21T09:13:34.526089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"66'11","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955635+0000","last_change":"2024-09-21T09:10:56.866005+0000","last_active":"2024-09-21T09:13:34.955635+0000","last_peered":"2024-09-21T09:13:34.955635+0000","last_clean":"2024-09-21T09:13:34.955635+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:13:34.955635+0000","last_undegraded":"2024-09-21T09:13:34.955635+0000","last_fullsized":"2024-09-21T09:13:34.955635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527710+0000","last_change":"2024-09-21T09:11:00.850206+0000","last_active":"2024-09-21T09:13:34.527710+0000","last_peered":"2024-09-21T09:13:34.527710+0000","last_clean":"2024-09-21T09:13:34.527710+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:13:34.527710+0000","last_undegraded":"2024-09-21T09:13:34.527710+0000","last_fullsized":"2024-09-21T09:13:34.527710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:26.137691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"91'16","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042418+0000","last_change":"2024-09-21T09:11:02.873117+0000","last_active":"2024-09-21T09:13:36.042418+0000","last_peered":"2024-09-21T09:13:36.042418+0000","last_clean":"2024-09-21T09:13:36.042418+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:13:36.042418+0000","last_undegraded":"2024-09-21T09:13:36.042418+0000","last_fullsized":"2024-09-21T09:13:36.042418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376851+0000","last_change":"2024-09-21T09:11:04.873369+0000","last_active":"2024-09-21T09:13:35.376851+0000","last_peered":"2024-09-21T09:13:35.376851+0000","last_clean":"2024-09-21T09:13:35.376851+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:13:35.376851+0000","last_undegraded":"2024-09-21T09:13:35.376851+0000","last_fullsized":"2024-09-21T09:13:35.376851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.868816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375992+0000","last_change":"2024-09-21T09:11:06.896298+0000","last_active":"2024-09-21T09:13:35.375992+0000","last_peered":"2024-09-21T09:13:35.375992+0000","last_clean":"2024-09-21T09:13:35.375992+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:13:35.375992+0000","last_undegraded":"2024-09-21T09:13:35.375992+0000","last_fullsized":"2024-09-21T09:13:35.375992+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:42.784843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"58'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:58.838558+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482642+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:13:34.482642+0000","last_peered":"2024-09-21T09:13:34.482642+0000","last_clean":"2024-09-21T09:13:34.482642+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:13:34.482642+0000","last_undegraded":"2024-09-21T09:13:34.482642+0000","last_fullsized":"2024-09-21T09:13:34.482642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:07.894252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"66'7","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296736+0000","last_change":"2024-09-21T09:13:20.378657+0000","last_active":"2024-09-21T09:13:34.296736+0000","last_peered":"2024-09-21T09:13:34.296736+0000","last_clean":"2024-09-21T09:13:34.296736+0000","last_became_active":"2024-09-21T09:13:19.153710+0000","last_became_peered":"2024-09-21T09:13:19.153710+0000","last_unstale":"2024-09-21T09:13:34.296736+0000","last_undegraded":"2024-09-21T09:13:34.296736+0000","last_fullsized":"2024-09-21T09:13:34.296736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526975+0000","last_change":"2024-09-21T09:11:00.852944+0000","last_active":"2024-09-21T09:13:34.526975+0000","last_peered":"2024-09-21T09:13:34.526975+0000","last_clean":"2024-09-21T09:13:34.526975+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:13:34.526975+0000","last_undegraded":"2024-09-21T09:13:34.526975+0000","last_fullsized":"2024-09-21T09:13:34.526975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:24.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.954874+0000","last_change":"2024-09-21T09:11:02.856485+0000","last_active":"2024-09-21T09:13:34.954874+0000","last_peered":"2024-09-21T09:13:34.954874+0000","last_clean":"2024-09-21T09:13:34.954874+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:13:34.954874+0000","last_undegraded":"2024-09-21T09:13:34.954874+0000","last_fullsized":"2024-09-21T09:13:34.954874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:05.267197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483296+0000","last_change":"2024-09-21T09:11:04.880602+0000","last_active":"2024-09-21T09:13:34.483296+0000","last_peered":"2024-09-21T09:13:34.483296+0000","last_clean":"2024-09-21T09:13:34.483296+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:13:34.483296+0000","last_undegraded":"2024-09-21T09:13:34.483296+0000","last_fullsized":"2024-09-21T09:13:34.483296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:56.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"62'4","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526697+0000","last_change":"2024-09-21T09:11:06.869065+0000","last_active":"2024-09-21T09:13:35.526697+0000","last_peered":"2024-09-21T09:13:35.526697+0000","last_clean":"2024-09-21T09:13:35.526697+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:13:35.526697+0000","last_undegraded":"2024-09-21T09:13:35.526697+0000","last_fullsized":"2024-09-21T09:13:35.526697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:28.667296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"71'12","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294295+0000","last_change":"2024-09-21T09:10:58.846835+0000","last_active":"2024-09-21T09:13:34.294295+0000","last_peered":"2024-09-21T09:13:34.294295+0000","last_clean":"2024-09-21T09:13:34.294295+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:13:34.294295+0000","last_undegraded":"2024-09-21T09:13:34.294295+0000","last_fullsized":"2024-09-21T09:13:34.294295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"66'10","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299651+0000","last_change":"2024-09-21T09:13:19.380704+0000","last_active":"2024-09-21T09:13:34.299651+0000","last_peered":"2024-09-21T09:13:34.299651+0000","last_clean":"2024-09-21T09:13:34.299651+0000","last_became_active":"2024-09-21T09:13:19.142534+0000","last_became_peered":"2024-09-21T09:13:19.142534+0000","last_unstale":"2024-09-21T09:13:34.299651+0000","last_undegraded":"2024-09-21T09:13:34.299651+0000","last_fullsized":"2024-09-21T09:13:34.299651+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957216+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:13:34.957216+0000","last_peered":"2024-09-21T09:13:34.957216+0000","last_clean":"2024-09-21T09:13:34.957216+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:13:34.957216+0000","last_undegraded":"2024-09-21T09:13:34.957216+0000","last_fullsized":"2024-09-21T09:13:34.957216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377768+0000","last_change":"2024-09-21T09:11:00.855241+0000","last_active":"2024-09-21T09:13:35.377768+0000","last_peered":"2024-09-21T09:13:35.377768+0000","last_clean":"2024-09-21T09:13:35.377768+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:13:35.377768+0000","last_undegraded":"2024-09-21T09:13:35.377768+0000","last_fullsized":"2024-09-21T09:13:35.377768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:56:14.401301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"71'30","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525679+0000","last_change":"2024-09-21T09:11:02.864623+0000","last_active":"2024-09-21T09:13:34.525679+0000","last_peered":"2024-09-21T09:13:34.525679+0000","last_clean":"2024-09-21T09:13:34.525679+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:13:34.525679+0000","last_undegraded":"2024-09-21T09:13:34.525679+0000","last_fullsized":"2024-09-21T09:13:34.525679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:12.141735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297500+0000","last_change":"2024-09-21T09:13:19.146039+0000","last_active":"2024-09-21T09:13:34.297500+0000","last_peered":"2024-09-21T09:13:34.297500+0000","last_clean":"2024-09-21T09:13:34.297500+0000","last_became_active":"2024-09-21T09:13:19.145677+0000","last_became_peered":"2024-09-21T09:13:19.145677+0000","last_unstale":"2024-09-21T09:13:34.297500+0000","last_undegraded":"2024-09-21T09:13:34.297500+0000","last_fullsized":"2024-09-21T09:13:34.297500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:04.909499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"62'4","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957412+0000","last_change":"2024-09-21T09:11:06.896833+0000","last_active":"2024-09-21T09:13:34.957412+0000","last_peered":"2024-09-21T09:13:34.957412+0000","last_clean":"2024-09-21T09:13:34.957412+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:13:34.957412+0000","last_undegraded":"2024-09-21T09:13:34.957412+0000","last_fullsized":"2024-09-21T09:13:34.957412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:38.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"61'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294846+0000","last_change":"2024-09-21T09:10:58.825808+0000","last_active":"2024-09-21T09:13:34.294846+0000","last_peered":"2024-09-21T09:13:34.294846+0000","last_clean":"2024-09-21T09:13:34.294846+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:13:34.294846+0000","last_undegraded":"2024-09-21T09:13:34.294846+0000","last_fullsized":"2024-09-21T09:13:34.294846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"67'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295613+0000","last_change":"2024-09-21T09:10:56.851643+0000","last_active":"2024-09-21T09:13:34.295613+0000","last_peered":"2024-09-21T09:13:34.295613+0000","last_clean":"2024-09-21T09:13:34.295613+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:13:34.295613+0000","last_undegraded":"2024-09-21T09:13:34.295613+0000","last_fullsized":"2024-09-21T09:13:34.295613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482740+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:13:34.482740+0000","last_peered":"2024-09-21T09:13:34.482740+0000","last_clean":"2024-09-21T09:13:34.482740+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:13:34.482740+0000","last_undegraded":"2024-09-21T09:13:34.482740+0000","last_fullsized":"2024-09-21T09:13:34.482740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:24.356684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295776+0000","last_change":"2024-09-21T09:11:00.847115+0000","last_active":"2024-09-21T09:13:34.295776+0000","last_peered":"2024-09-21T09:13:34.295776+0000","last_clean":"2024-09-21T09:13:34.295776+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:13:34.295776+0000","last_undegraded":"2024-09-21T09:13:34.295776+0000","last_fullsized":"2024-09-21T09:13:34.295776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:55.012417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293962+0000","last_change":"2024-09-21T09:11:02.862921+0000","last_active":"2024-09-21T09:13:34.293962+0000","last_peered":"2024-09-21T09:13:34.293962+0000","last_clean":"2024-09-21T09:13:34.293962+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:13:34.293962+0000","last_undegraded":"2024-09-21T09:13:34.293962+0000","last_fullsized":"2024-09-21T09:13:34.293962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"91'102","reported_seq":263,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042964+0000","last_change":"2024-09-21T09:11:04.894220+0000","last_active":"2024-09-21T09:13:36.042964+0000","last_peered":"2024-09-21T09:13:36.042964+0000","last_clean":"2024-09-21T09:13:36.042964+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:13:36.042964+0000","last_undegraded":"2024-09-21T09:13:36.042964+0000","last_fullsized":"2024-09-21T09:13:36.042964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:07.285264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527292+0000","last_change":"2024-09-21T09:11:06.881113+0000","last_active":"2024-09-21T09:13:34.527292+0000","last_peered":"2024-09-21T09:13:34.527292+0000","last_clean":"2024-09-21T09:13:34.527292+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:13:34.527292+0000","last_undegraded":"2024-09-21T09:13:34.527292+0000","last_fullsized":"2024-09-21T09:13:34.527292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376991+0000","last_change":"2024-09-21T09:10:58.868894+0000","last_active":"2024-09-21T09:13:35.376991+0000","last_peered":"2024-09-21T09:13:35.376991+0000","last_clean":"2024-09-21T09:13:35.376991+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:13:35.376991+0000","last_undegraded":"2024-09-21T09:13:35.376991+0000","last_fullsized":"2024-09-21T09:13:35.376991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:41.448227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"66'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378658+0000","last_change":"2024-09-21T09:10:56.853201+0000","last_active":"2024-09-21T09:13:35.378658+0000","last_peered":"2024-09-21T09:13:35.378658+0000","last_clean":"2024-09-21T09:13:35.378658+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:13:35.378658+0000","last_undegraded":"2024-09-21T09:13:35.378658+0000","last_fullsized":"2024-09-21T09:13:35.378658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:58.587669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378974+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:13:35.378974+0000","last_peered":"2024-09-21T09:13:35.378974+0000","last_clean":"2024-09-21T09:13:35.378974+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:13:35.378974+0000","last_undegraded":"2024-09-21T09:13:35.378974+0000","last_fullsized":"2024-09-21T09:13:35.378974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:03.383843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:11:00.850095+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:17.456402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"62'11","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482326+0000","last_change":"2024-09-21T09:11:02.853229+0000","last_active":"2024-09-21T09:13:34.482326+0000","last_peered":"2024-09-21T09:13:34.482326+0000","last_clean":"2024-09-21T09:13:34.482326+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:13:34.482326+0000","last_undegraded":"2024-09-21T09:13:34.482326+0000","last_fullsized":"2024-09-21T09:13:34.482326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:25.468451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"91'106","reported_seq":287,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042491+0000","last_change":"2024-09-21T09:13:22.165756+0000","last_active":"2024-09-21T09:13:36.042491+0000","last_peered":"2024-09-21T09:13:36.042491+0000","last_clean":"2024-09-21T09:13:36.042491+0000","last_became_active":"2024-09-21T09:13:22.164964+0000","last_became_peered":"2024-09-21T09:13:22.164964+0000","last_unstale":"2024-09-21T09:13:36.042491+0000","last_undegraded":"2024-09-21T09:13:36.042491+0000","last_fullsized":"2024-09-21T09:13:36.042491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:18.044791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"62'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956097+0000","last_change":"2024-09-21T09:11:06.887900+0000","last_active":"2024-09-21T09:13:34.956097+0000","last_peered":"2024-09-21T09:13:34.956097+0000","last_clean":"2024-09-21T09:13:34.956097+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:13:34.956097+0000","last_undegraded":"2024-09-21T09:13:34.956097+0000","last_fullsized":"2024-09-21T09:13:34.956097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:03.433485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297268+0000","last_change":"2024-09-21T09:13:19.160539+0000","last_active":"2024-09-21T09:13:34.297268+0000","last_peered":"2024-09-21T09:13:34.297268+0000","last_clean":"2024-09-21T09:13:34.297268+0000","last_became_active":"2024-09-21T09:13:19.158513+0000","last_became_peered":"2024-09-21T09:13:19.158513+0000","last_unstale":"2024-09-21T09:13:34.297268+0000","last_undegraded":"2024-09-21T09:13:34.297268+0000","last_fullsized":"2024-09-21T09:13:34.297268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:56.953433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"66'6","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378711+0000","last_change":"2024-09-21T09:10:56.849803+0000","last_active":"2024-09-21T09:13:35.378711+0000","last_peered":"2024-09-21T09:13:35.378711+0000","last_clean":"2024-09-21T09:13:35.378711+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:13:35.378711+0000","last_undegraded":"2024-09-21T09:13:35.378711+0000","last_fullsized":"2024-09-21T09:13:35.378711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:47.709157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483413+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:13:34.483413+0000","last_peered":"2024-09-21T09:13:34.483413+0000","last_clean":"2024-09-21T09:13:34.483413+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:13:34.483413+0000","last_undegraded":"2024-09-21T09:13:34.483413+0000","last_fullsized":"2024-09-21T09:13:34.483413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:33.465317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.374990+0000","last_change":"2024-09-21T09:13:19.154303+0000","last_active":"2024-09-21T09:13:35.374990+0000","last_peered":"2024-09-21T09:13:35.374990+0000","last_clean":"2024-09-21T09:13:35.374990+0000","last_became_active":"2024-09-21T09:13:19.152735+0000","last_became_peered":"2024-09-21T09:13:19.152735+0000","last_unstale":"2024-09-21T09:13:35.374990+0000","last_undegraded":"2024-09-21T09:13:35.374990+0000","last_fullsized":"2024-09-21T09:13:35.374990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:24.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"71'37","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295954+0000","last_change":"2024-09-21T09:11:02.856720+0000","last_active":"2024-09-21T09:13:34.295954+0000","last_peered":"2024-09-21T09:13:34.295954+0000","last_clean":"2024-09-21T09:13:34.295954+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:13:34.295954+0000","last_undegraded":"2024-09-21T09:13:34.295954+0000","last_fullsized":"2024-09-21T09:13:34.295954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376998+0000","last_change":"2024-09-21T09:11:04.872979+0000","last_active":"2024-09-21T09:13:35.376998+0000","last_peered":"2024-09-21T09:13:35.376998+0000","last_clean":"2024-09-21T09:13:35.376998+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:13:35.376998+0000","last_undegraded":"2024-09-21T09:13:35.376998+0000","last_fullsized":"2024-09-21T09:13:35.376998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:17.499450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"71'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299731+0000","last_change":"2024-09-21T09:13:19.169497+0000","last_active":"2024-09-21T09:13:34.299731+0000","last_peered":"2024-09-21T09:13:34.299731+0000","last_clean":"2024-09-21T09:13:34.299731+0000","last_became_active":"2024-09-21T09:13:19.140926+0000","last_became_peered":"2024-09-21T09:13:19.140926+0000","last_unstale":"2024-09-21T09:13:34.299731+0000","last_undegraded":"2024-09-21T09:13:34.299731+0000","last_fullsized":"2024-09-21T09:13:34.299731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:44.853024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":426,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377317+0000","last_change":"2024-09-21T09:11:06.900571+0000","last_active":"2024-09-21T09:13:35.377317+0000","last_peered":"2024-09-21T09:13:35.377317+0000","last_clean":"2024-09-21T09:13:35.377317+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:13:35.377317+0000","last_undegraded":"2024-09-21T09:13:35.377317+0000","last_fullsized":"2024-09-21T09:13:35.377317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:40.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295838+0000","last_change":"2024-09-21T09:13:19.531538+0000","last_active":"2024-09-21T09:13:34.295838+0000","last_peered":"2024-09-21T09:13:34.295838+0000","last_clean":"2024-09-21T09:13:34.295838+0000","last_became_active":"2024-09-21T09:13:19.158305+0000","last_became_peered":"2024-09-21T09:13:19.158305+0000","last_unstale":"2024-09-21T09:13:34.295838+0000","last_undegraded":"2024-09-21T09:13:34.295838+0000","last_fullsized":"2024-09-21T09:13:34.295838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:10.110896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"66'8","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482868+0000","last_change":"2024-09-21T09:13:21.278992+0000","last_active":"2024-09-21T09:13:34.482868+0000","last_peered":"2024-09-21T09:13:34.482868+0000","last_clean":"2024-09-21T09:13:34.482868+0000","last_became_active":"2024-09-21T09:13:19.168562+0000","last_became_peered":"2024-09-21T09:13:19.168562+0000","last_unstale":"2024-09-21T09:13:34.482868+0000","last_undegraded":"2024-09-21T09:13:34.482868+0000","last_fullsized":"2024-09-21T09:13:34.482868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:29.147931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294332+0000","last_change":"2024-09-21T09:11:00.839217+0000","last_active":"2024-09-21T09:13:34.294332+0000","last_peered":"2024-09-21T09:13:34.294332+0000","last_clean":"2024-09-21T09:13:34.294332+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:13:34.294332+0000","last_undegraded":"2024-09-21T09:13:34.294332+0000","last_fullsized":"2024-09-21T09:13:34.294332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:23.833810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"71'18","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293754+0000","last_change":"2024-09-21T09:11:02.872614+0000","last_active":"2024-09-21T09:13:34.293754+0000","last_peered":"2024-09-21T09:13:34.293754+0000","last_clean":"2024-09-21T09:13:34.293754+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:13:34.293754+0000","last_undegraded":"2024-09-21T09:13:34.293754+0000","last_fullsized":"2024-09-21T09:13:34.293754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525609+0000","last_change":"2024-09-21T09:11:04.882308+0000","last_active":"2024-09-21T09:13:34.525609+0000","last_peered":"2024-09-21T09:13:34.525609+0000","last_clean":"2024-09-21T09:13:34.525609+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:13:34.525609+0000","last_undegraded":"2024-09-21T09:13:34.525609+0000","last_fullsized":"2024-09-21T09:13:34.525609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:42.301147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"61'16","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527236+0000","last_change":"2024-09-21T09:11:06.892382+0000","last_active":"2024-09-21T09:13:34.527236+0000","last_peered":"2024-09-21T09:13:34.527236+0000","last_clean":"2024-09-21T09:13:34.527236+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:13:34.527236+0000","last_undegraded":"2024-09-21T09:13:34.527236+0000","last_fullsized":"2024-09-21T09:13:34.527236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:20.449346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"62'6","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376845+0000","last_change":"2024-09-21T09:10:58.869150+0000","last_active":"2024-09-21T09:13:35.376845+0000","last_peered":"2024-09-21T09:13:35.376845+0000","last_clean":"2024-09-21T09:13:35.376845+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:13:35.376845+0000","last_undegraded":"2024-09-21T09:13:35.376845+0000","last_fullsized":"2024-09-21T09:13:35.376845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:58.386210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"66'9","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298150+0000","last_change":"2024-09-21T09:10:56.854764+0000","last_active":"2024-09-21T09:13:34.298150+0000","last_peered":"2024-09-21T09:13:34.298150+0000","last_clean":"2024-09-21T09:13:34.298150+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:13:34.298150+0000","last_undegraded":"2024-09-21T09:13:34.298150+0000","last_fullsized":"2024-09-21T09:13:34.298150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376855+0000","last_change":"2024-09-21T09:11:00.839265+0000","last_active":"2024-09-21T09:13:35.376855+0000","last_peered":"2024-09-21T09:13:35.376855+0000","last_clean":"2024-09-21T09:13:35.376855+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:13:35.376855+0000","last_undegraded":"2024-09-21T09:13:35.376855+0000","last_fullsized":"2024-09-21T09:13:35.376855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:14.524942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"45'5","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375333+0000","last_change":"2024-09-21T09:13:20.848665+0000","last_active":"2024-09-21T09:13:35.375333+0000","last_peered":"2024-09-21T09:13:35.375333+0000","last_clean":"2024-09-21T09:13:35.375333+0000","last_became_active":"2024-09-21T09:13:19.154000+0000","last_became_peered":"2024-09-21T09:13:19.154000+0000","last_unstale":"2024-09-21T09:13:35.375333+0000","last_undegraded":"2024-09-21T09:13:35.375333+0000","last_fullsized":"2024-09-21T09:13:35.375333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:40.242838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297539+0000","last_change":"2024-09-21T09:13:19.160157+0000","last_active":"2024-09-21T09:13:34.297539+0000","last_peered":"2024-09-21T09:13:34.297539+0000","last_clean":"2024-09-21T09:13:34.297539+0000","last_became_active":"2024-09-21T09:13:19.157523+0000","last_became_peered":"2024-09-21T09:13:19.157523+0000","last_unstale":"2024-09-21T09:13:34.297539+0000","last_undegraded":"2024-09-21T09:13:34.297539+0000","last_fullsized":"2024-09-21T09:13:34.297539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:07.414777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294790+0000","last_change":"2024-09-21T09:11:06.879042+0000","last_active":"2024-09-21T09:13:34.294790+0000","last_peered":"2024-09-21T09:13:34.294790+0000","last_clean":"2024-09-21T09:13:34.294790+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:13:34.294790+0000","last_undegraded":"2024-09-21T09:13:34.294790+0000","last_fullsized":"2024-09-21T09:13:34.294790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:34.670949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377778+0000","last_change":"2024-09-21T09:10:58.864481+0000","last_active":"2024-09-21T09:13:35.377778+0000","last_peered":"2024-09-21T09:13:35.377778+0000","last_clean":"2024-09-21T09:13:35.377778+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:13:35.377778+0000","last_undegraded":"2024-09-21T09:13:35.377778+0000","last_fullsized":"2024-09-21T09:13:35.377778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:33.405020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"67'12","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298309+0000","last_change":"2024-09-21T09:13:20.071816+0000","last_active":"2024-09-21T09:13:34.298309+0000","last_peered":"2024-09-21T09:13:34.298309+0000","last_clean":"2024-09-21T09:13:34.298309+0000","last_became_active":"2024-09-21T09:13:19.160370+0000","last_became_peered":"2024-09-21T09:13:19.160370+0000","last_unstale":"2024-09-21T09:13:34.298309+0000","last_undegraded":"2024-09-21T09:13:34.298309+0000","last_fullsized":"2024-09-21T09:13:34.298309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:13.089799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292818+0000","last_change":"2024-09-21T09:13:19.145601+0000","last_active":"2024-09-21T09:13:34.292818+0000","last_peered":"2024-09-21T09:13:34.292818+0000","last_clean":"2024-09-21T09:13:34.292818+0000","last_became_active":"2024-09-21T09:13:19.142672+0000","last_became_peered":"2024-09-21T09:13:19.142672+0000","last_unstale":"2024-09-21T09:13:34.292818+0000","last_undegraded":"2024-09-21T09:13:34.292818+0000","last_fullsized":"2024-09-21T09:13:34.292818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.000309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"71'17","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526668+0000","last_change":"2024-09-21T09:11:02.869796+0000","last_active":"2024-09-21T09:13:34.526668+0000","last_peered":"2024-09-21T09:13:34.526668+0000","last_clean":"2024-09-21T09:13:34.526668+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:13:34.526668+0000","last_undegraded":"2024-09-21T09:13:34.526668+0000","last_fullsized":"2024-09-21T09:13:34.526668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:48.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528134+0000","last_change":"2024-09-21T09:11:04.893727+0000","last_active":"2024-09-21T09:13:35.528134+0000","last_peered":"2024-09-21T09:13:35.528134+0000","last_clean":"2024-09-21T09:13:35.528134+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:35.528134+0000","last_undegraded":"2024-09-21T09:13:35.528134+0000","last_fullsized":"2024-09-21T09:13:35.528134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:18.437905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"71'7","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482678+0000","last_change":"2024-09-21T09:13:21.128242+0000","last_active":"2024-09-21T09:13:34.482678+0000","last_peered":"2024-09-21T09:13:34.482678+0000","last_clean":"2024-09-21T09:13:34.482678+0000","last_became_active":"2024-09-21T09:13:19.167169+0000","last_became_peered":"2024-09-21T09:13:19.167169+0000","last_unstale":"2024-09-21T09:13:34.482678+0000","last_undegraded":"2024-09-21T09:13:34.482678+0000","last_fullsized":"2024-09-21T09:13:34.482678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:46.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526036+0000","last_change":"2024-09-21T09:10:58.859005+0000","last_active":"2024-09-21T09:13:34.526036+0000","last_peered":"2024-09-21T09:13:34.526036+0000","last_clean":"2024-09-21T09:13:34.526036+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:13:34.526036+0000","last_undegraded":"2024-09-21T09:13:34.526036+0000","last_fullsized":"2024-09-21T09:13:34.526036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:38.110596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"66'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958780+0000","last_change":"2024-09-21T09:10:56.860416+0000","last_active":"2024-09-21T09:13:34.958780+0000","last_peered":"2024-09-21T09:13:34.958780+0000","last_clean":"2024-09-21T09:13:34.958780+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:13:34.958780+0000","last_undegraded":"2024-09-21T09:13:34.958780+0000","last_fullsized":"2024-09-21T09:13:34.958780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:48.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482021+0000","last_change":"2024-09-21T09:13:19.153082+0000","last_active":"2024-09-21T09:13:34.482021+0000","last_peered":"2024-09-21T09:13:34.482021+0000","last_clean":"2024-09-21T09:13:34.482021+0000","last_became_active":"2024-09-21T09:13:19.152722+0000","last_became_peered":"2024-09-21T09:13:19.152722+0000","last_unstale":"2024-09-21T09:13:34.482021+0000","last_undegraded":"2024-09-21T09:13:34.482021+0000","last_fullsized":"2024-09-21T09:13:34.482021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:26.550403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"71'16","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295783+0000","last_change":"2024-09-21T09:11:02.872950+0000","last_active":"2024-09-21T09:13:34.295783+0000","last_peered":"2024-09-21T09:13:34.295783+0000","last_clean":"2024-09-21T09:13:34.295783+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:13:34.295783+0000","last_undegraded":"2024-09-21T09:13:34.295783+0000","last_fullsized":"2024-09-21T09:13:34.295783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526197+0000","last_change":"2024-09-21T09:13:19.144593+0000","last_active":"2024-09-21T09:13:34.526197+0000","last_peered":"2024-09-21T09:13:34.526197+0000","last_clean":"2024-09-21T09:13:34.526197+0000","last_became_active":"2024-09-21T09:13:19.143577+0000","last_became_peered":"2024-09-21T09:13:19.143577+0000","last_unstale":"2024-09-21T09:13:34.526197+0000","last_undegraded":"2024-09-21T09:13:34.526197+0000","last_fullsized":"2024-09-21T09:13:34.526197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:02.985464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483155+0000","last_change":"2024-09-21T09:10:58.839092+0000","last_active":"2024-09-21T09:13:34.483155+0000","last_peered":"2024-09-21T09:13:34.483155+0000","last_clean":"2024-09-21T09:13:34.483155+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:13:34.483155+0000","last_undegraded":"2024-09-21T09:13:34.483155+0000","last_fullsized":"2024-09-21T09:13:34.483155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:02.458655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"66'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956457+0000","last_change":"2024-09-21T09:10:56.865435+0000","last_active":"2024-09-21T09:13:34.956457+0000","last_peered":"2024-09-21T09:13:34.956457+0000","last_clean":"2024-09-21T09:13:34.956457+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:13:34.956457+0000","last_undegraded":"2024-09-21T09:13:34.956457+0000","last_fullsized":"2024-09-21T09:13:34.956457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295267+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.295267+0000","last_peered":"2024-09-21T09:13:34.295267+0000","last_clean":"2024-09-21T09:13:34.295267+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:13:34.295267+0000","last_undegraded":"2024-09-21T09:13:34.295267+0000","last_fullsized":"2024-09-21T09:13:34.295267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:10.134818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"71'24","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294966+0000","last_change":"2024-09-21T09:11:02.879895+0000","last_active":"2024-09-21T09:13:34.294966+0000","last_peered":"2024-09-21T09:13:34.294966+0000","last_clean":"2024-09-21T09:13:34.294966+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:13:34.294966+0000","last_undegraded":"2024-09-21T09:13:34.294966+0000","last_fullsized":"2024-09-21T09:13:34.294966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298886+0000","last_change":"2024-09-21T09:13:19.166381+0000","last_active":"2024-09-21T09:13:34.298886+0000","last_peered":"2024-09-21T09:13:34.298886+0000","last_clean":"2024-09-21T09:13:34.298886+0000","last_became_active":"2024-09-21T09:13:19.165859+0000","last_became_peered":"2024-09-21T09:13:19.165859+0000","last_unstale":"2024-09-21T09:13:34.298886+0000","last_undegraded":"2024-09-21T09:13:34.298886+0000","last_fullsized":"2024-09-21T09:13:34.298886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:20.747731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957270+0000","last_change":"2024-09-21T09:11:06.896002+0000","last_active":"2024-09-21T09:13:34.957270+0000","last_peered":"2024-09-21T09:13:34.957270+0000","last_clean":"2024-09-21T09:13:34.957270+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:13:34.957270+0000","last_undegraded":"2024-09-21T09:13:34.957270+0000","last_fullsized":"2024-09-21T09:13:34.957270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:01.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"71'10","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378657+0000","last_change":"2024-09-21T09:10:58.868892+0000","last_active":"2024-09-21T09:13:35.378657+0000","last_peered":"2024-09-21T09:13:35.378657+0000","last_clean":"2024-09-21T09:13:35.378657+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:13:35.378657+0000","last_undegraded":"2024-09-21T09:13:35.378657+0000","last_fullsized":"2024-09-21T09:13:35.378657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"66'5","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377535+0000","last_change":"2024-09-21T09:10:56.827351+0000","last_active":"2024-09-21T09:13:35.377535+0000","last_peered":"2024-09-21T09:13:35.377535+0000","last_clean":"2024-09-21T09:13:35.377535+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:13:35.377535+0000","last_undegraded":"2024-09-21T09:13:35.377535+0000","last_fullsized":"2024-09-21T09:13:35.377535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:49.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298002+0000","last_change":"2024-09-21T09:13:19.159092+0000","last_active":"2024-09-21T09:13:34.298002+0000","last_peered":"2024-09-21T09:13:34.298002+0000","last_clean":"2024-09-21T09:13:34.298002+0000","last_became_active":"2024-09-21T09:13:19.158652+0000","last_became_peered":"2024-09-21T09:13:19.158652+0000","last_unstale":"2024-09-21T09:13:34.298002+0000","last_undegraded":"2024-09-21T09:13:34.298002+0000","last_fullsized":"2024-09-21T09:13:34.298002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:32.340994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"71'22","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482767+0000","last_change":"2024-09-21T09:13:21.165572+0000","last_active":"2024-09-21T09:13:34.482767+0000","last_peered":"2024-09-21T09:13:34.482767+0000","last_clean":"2024-09-21T09:13:34.482767+0000","last_became_active":"2024-09-21T09:13:19.167344+0000","last_became_peered":"2024-09-21T09:13:19.167344+0000","last_unstale":"2024-09-21T09:13:34.482767+0000","last_undegraded":"2024-09-21T09:13:34.482767+0000","last_fullsized":"2024-09-21T09:13:34.482767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:05.930094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956457+0000","last_change":"2024-09-21T09:11:04.890782+0000","last_active":"2024-09-21T09:13:34.956457+0000","last_peered":"2024-09-21T09:13:34.956457+0000","last_clean":"2024-09-21T09:13:34.956457+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:13:34.956457+0000","last_undegraded":"2024-09-21T09:13:34.956457+0000","last_fullsized":"2024-09-21T09:13:34.956457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:42.740558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"71'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482532+0000","last_change":"2024-09-21T09:11:06.889510+0000","last_active":"2024-09-21T09:13:34.482532+0000","last_peered":"2024-09-21T09:13:34.482532+0000","last_clean":"2024-09-21T09:13:34.482532+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:13:34.482532+0000","last_undegraded":"2024-09-21T09:13:34.482532+0000","last_fullsized":"2024-09-21T09:13:34.482532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:38.377418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527248+0000","last_change":"2024-09-21T09:10:58.854750+0000","last_active":"2024-09-21T09:13:34.527248+0000","last_peered":"2024-09-21T09:13:34.527248+0000","last_clean":"2024-09-21T09:13:34.527248+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:13:34.527248+0000","last_undegraded":"2024-09-21T09:13:34.527248+0000","last_fullsized":"2024-09-21T09:13:34.527248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.559151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"67'10","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528620+0000","last_change":"2024-09-21T09:10:56.863198+0000","last_active":"2024-09-21T09:13:35.528620+0000","last_peered":"2024-09-21T09:13:35.528620+0000","last_clean":"2024-09-21T09:13:35.528620+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:13:35.528620+0000","last_undegraded":"2024-09-21T09:13:35.528620+0000","last_fullsized":"2024-09-21T09:13:35.528620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298158+0000","last_change":"2024-09-21T09:13:20.592162+0000","last_active":"2024-09-21T09:13:34.298158+0000","last_peered":"2024-09-21T09:13:34.298158+0000","last_clean":"2024-09-21T09:13:34.298158+0000","last_became_active":"2024-09-21T09:13:19.165929+0000","last_became_peered":"2024-09-21T09:13:19.165929+0000","last_unstale":"2024-09-21T09:13:34.298158+0000","last_undegraded":"2024-09-21T09:13:34.298158+0000","last_fullsized":"2024-09-21T09:13:34.298158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:41.372526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"71'17","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295570+0000","last_change":"2024-09-21T09:11:02.879188+0000","last_active":"2024-09-21T09:13:34.295570+0000","last_peered":"2024-09-21T09:13:34.295570+0000","last_clean":"2024-09-21T09:13:34.295570+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:13:34.295570+0000","last_undegraded":"2024-09-21T09:13:34.295570+0000","last_fullsized":"2024-09-21T09:13:34.295570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:37.208901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527107+0000","last_change":"2024-09-21T09:11:04.880786+0000","last_active":"2024-09-21T09:13:34.527107+0000","last_peered":"2024-09-21T09:13:34.527107+0000","last_clean":"2024-09-21T09:13:34.527107+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:13:34.527107+0000","last_undegraded":"2024-09-21T09:13:34.527107+0000","last_fullsized":"2024-09-21T09:13:34.527107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:54.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"62'10","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481914+0000","last_change":"2024-09-21T09:11:06.898517+0000","last_active":"2024-09-21T09:13:34.481914+0000","last_peered":"2024-09-21T09:13:34.481914+0000","last_clean":"2024-09-21T09:13:34.481914+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:13:34.481914+0000","last_undegraded":"2024-09-21T09:13:34.481914+0000","last_fullsized":"2024-09-21T09:13:34.481914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:46.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":39,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377669+0000","last_change":"2024-09-21T09:10:58.868807+0000","last_active":"2024-09-21T09:13:35.377669+0000","last_peered":"2024-09-21T09:13:35.377669+0000","last_clean":"2024-09-21T09:13:35.377669+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:13:35.377669+0000","last_undegraded":"2024-09-21T09:13:35.377669+0000","last_fullsized":"2024-09-21T09:13:35.377669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.574650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"67'12","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378764+0000","last_change":"2024-09-21T09:10:56.851205+0000","last_active":"2024-09-21T09:13:35.378764+0000","last_peered":"2024-09-21T09:13:35.378764+0000","last_clean":"2024-09-21T09:13:35.378764+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:13:35.378764+0000","last_undegraded":"2024-09-21T09:13:35.378764+0000","last_fullsized":"2024-09-21T09:13:35.378764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:52.423650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377224+0000","last_change":"2024-09-21T09:11:00.856830+0000","last_active":"2024-09-21T09:13:35.377224+0000","last_peered":"2024-09-21T09:13:35.377224+0000","last_clean":"2024-09-21T09:13:35.377224+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:13:35.377224+0000","last_undegraded":"2024-09-21T09:13:35.377224+0000","last_fullsized":"2024-09-21T09:13:35.377224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:45.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"74'14","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483000+0000","last_change":"2024-09-21T09:13:21.153990+0000","last_active":"2024-09-21T09:13:34.483000+0000","last_peered":"2024-09-21T09:13:34.483000+0000","last_clean":"2024-09-21T09:13:34.483000+0000","last_became_active":"2024-09-21T09:13:19.167321+0000","last_became_peered":"2024-09-21T09:13:19.167321+0000","last_unstale":"2024-09-21T09:13:34.483000+0000","last_undegraded":"2024-09-21T09:13:34.483000+0000","last_fullsized":"2024-09-21T09:13:34.483000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:34.649177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"91'102","reported_seq":271,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042397+0000","last_change":"2024-09-21T09:11:04.870463+0000","last_active":"2024-09-21T09:13:36.042397+0000","last_peered":"2024-09-21T09:13:36.042397+0000","last_clean":"2024-09-21T09:13:36.042397+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:13:36.042397+0000","last_undegraded":"2024-09-21T09:13:36.042397+0000","last_fullsized":"2024-09-21T09:13:36.042397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:30.495090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"58'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481854+0000","last_change":"2024-09-21T09:11:06.883550+0000","last_active":"2024-09-21T09:13:34.481854+0000","last_peered":"2024-09-21T09:13:34.481854+0000","last_clean":"2024-09-21T09:13:34.481854+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:13:34.481854+0000","last_undegraded":"2024-09-21T09:13:34.481854+0000","last_fullsized":"2024-09-21T09:13:34.481854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:56.825424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"71'10","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296041+0000","last_change":"2024-09-21T09:13:19.537524+0000","last_active":"2024-09-21T09:13:34.296041+0000","last_peered":"2024-09-21T09:13:34.296041+0000","last_clean":"2024-09-21T09:13:34.296041+0000","last_became_active":"2024-09-21T09:13:19.159904+0000","last_became_peered":"2024-09-21T09:13:19.159904+0000","last_unstale":"2024-09-21T09:13:34.296041+0000","last_undegraded":"2024-09-21T09:13:34.296041+0000","last_fullsized":"2024-09-21T09:13:34.296041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:12.531734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"67'12","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529250+0000","last_change":"2024-09-21T09:10:56.852586+0000","last_active":"2024-09-21T09:13:35.529250+0000","last_peered":"2024-09-21T09:13:35.529250+0000","last_clean":"2024-09-21T09:13:35.529250+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:13:35.529250+0000","last_undegraded":"2024-09-21T09:13:35.529250+0000","last_fullsized":"2024-09-21T09:13:35.529250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528271+0000","last_change":"2024-09-21T09:11:00.839800+0000","last_active":"2024-09-21T09:13:35.528271+0000","last_peered":"2024-09-21T09:13:35.528271+0000","last_clean":"2024-09-21T09:13:35.528271+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:13:35.528271+0000","last_undegraded":"2024-09-21T09:13:35.528271+0000","last_fullsized":"2024-09-21T09:13:35.528271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:21.140377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"71'22","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293383+0000","last_change":"2024-09-21T09:11:02.857087+0000","last_active":"2024-09-21T09:13:34.293383+0000","last_peered":"2024-09-21T09:13:34.293383+0000","last_clean":"2024-09-21T09:13:34.293383+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:13:34.293383+0000","last_undegraded":"2024-09-21T09:13:34.293383+0000","last_fullsized":"2024-09-21T09:13:34.293383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376271+0000","last_change":"2024-09-21T09:11:04.872303+0000","last_active":"2024-09-21T09:13:35.376271+0000","last_peered":"2024-09-21T09:13:35.376271+0000","last_clean":"2024-09-21T09:13:35.376271+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:13:35.376271+0000","last_undegraded":"2024-09-21T09:13:35.376271+0000","last_fullsized":"2024-09-21T09:13:35.376271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.517451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"71'10","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527841+0000","last_change":"2024-09-21T09:11:06.873636+0000","last_active":"2024-09-21T09:13:35.527841+0000","last_peered":"2024-09-21T09:13:35.527841+0000","last_clean":"2024-09-21T09:13:35.527841+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:13:35.527841+0000","last_undegraded":"2024-09-21T09:13:35.527841+0000","last_fullsized":"2024-09-21T09:13:35.527841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:52.693664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293210+0000","last_change":"2024-09-21T09:13:19.144377+0000","last_active":"2024-09-21T09:13:34.293210+0000","last_peered":"2024-09-21T09:13:34.293210+0000","last_clean":"2024-09-21T09:13:34.293210+0000","last_became_active":"2024-09-21T09:13:19.143746+0000","last_became_peered":"2024-09-21T09:13:19.143746+0000","last_unstale":"2024-09-21T09:13:34.293210+0000","last_undegraded":"2024-09-21T09:13:34.293210+0000","last_fullsized":"2024-09-21T09:13:34.293210+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:48.781954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"67'15","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482960+0000","last_change":"2024-09-21T09:11:34.170912+0000","last_active":"2024-09-21T09:13:34.482960+0000","last_peered":"2024-09-21T09:13:34.482960+0000","last_clean":"2024-09-21T09:13:34.482960+0000","last_became_active":"2024-09-21T09:11:34.170599+0000","last_became_peered":"2024-09-21T09:11:34.170599+0000","last_unstale":"2024-09-21T09:13:34.482960+0000","last_undegraded":"2024-09-21T09:13:34.482960+0000","last_fullsized":"2024-09-21T09:13:34.482960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296362+0000","last_change":"2024-09-21T09:13:19.144365+0000","last_active":"2024-09-21T09:13:34.296362+0000","last_peered":"2024-09-21T09:13:34.296362+0000","last_clean":"2024-09-21T09:13:34.296362+0000","last_became_active":"2024-09-21T09:13:19.141404+0000","last_became_peered":"2024-09-21T09:13:19.141404+0000","last_unstale":"2024-09-21T09:13:34.296362+0000","last_undegraded":"2024-09-21T09:13:34.296362+0000","last_fullsized":"2024-09-21T09:13:34.296362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:05.438476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"71'16","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376621+0000","last_change":"2024-09-21T09:11:02.847926+0000","last_active":"2024-09-21T09:13:35.376621+0000","last_peered":"2024-09-21T09:13:35.376621+0000","last_clean":"2024-09-21T09:13:35.376621+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:13:35.376621+0000","last_undegraded":"2024-09-21T09:13:35.376621+0000","last_fullsized":"2024-09-21T09:13:35.376621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:15.592269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482045+0000","last_change":"2024-09-21T09:11:04.880866+0000","last_active":"2024-09-21T09:13:34.482045+0000","last_peered":"2024-09-21T09:13:34.482045+0000","last_clean":"2024-09-21T09:13:34.482045+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:13:34.482045+0000","last_undegraded":"2024-09-21T09:13:34.482045+0000","last_fullsized":"2024-09-21T09:13:34.482045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:02.568576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957411+0000","last_change":"2024-09-21T09:11:06.899493+0000","last_active":"2024-09-21T09:13:34.957411+0000","last_peered":"2024-09-21T09:13:34.957411+0000","last_clean":"2024-09-21T09:13:34.957411+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:13:34.957411+0000","last_undegraded":"2024-09-21T09:13:34.957411+0000","last_fullsized":"2024-09-21T09:13:34.957411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:50.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525954+0000","last_change":"2024-09-21T09:10:58.856310+0000","last_active":"2024-09-21T09:13:34.525954+0000","last_peered":"2024-09-21T09:13:34.525954+0000","last_clean":"2024-09-21T09:13:34.525954+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:13:34.525954+0000","last_undegraded":"2024-09-21T09:13:34.525954+0000","last_fullsized":"2024-09-21T09:13:34.525954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:12.549438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"66'11","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958076+0000","last_change":"2024-09-21T09:13:20.628384+0000","last_active":"2024-09-21T09:13:34.958076+0000","last_peered":"2024-09-21T09:13:34.958076+0000","last_clean":"2024-09-21T09:13:34.958076+0000","last_became_active":"2024-09-21T09:13:19.169569+0000","last_became_peered":"2024-09-21T09:13:19.169569+0000","last_unstale":"2024-09-21T09:13:34.958076+0000","last_undegraded":"2024-09-21T09:13:34.958076+0000","last_fullsized":"2024-09-21T09:13:34.958076+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:00.389819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526949+0000","last_change":"2024-09-21T09:11:00.837141+0000","last_active":"2024-09-21T09:13:35.526949+0000","last_peered":"2024-09-21T09:13:35.526949+0000","last_clean":"2024-09-21T09:13:35.526949+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:13:35.526949+0000","last_undegraded":"2024-09-21T09:13:35.526949+0000","last_fullsized":"2024-09-21T09:13:35.526949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"71'11","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294478+0000","last_change":"2024-09-21T09:13:20.076515+0000","last_active":"2024-09-21T09:13:34.294478+0000","last_peered":"2024-09-21T09:13:34.294478+0000","last_clean":"2024-09-21T09:13:34.294478+0000","last_became_active":"2024-09-21T09:13:19.150207+0000","last_became_peered":"2024-09-21T09:13:19.150207+0000","last_unstale":"2024-09-21T09:13:34.294478+0000","last_undegraded":"2024-09-21T09:13:34.294478+0000","last_fullsized":"2024-09-21T09:13:34.294478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482052+0000","last_change":"2024-09-21T09:11:04.887172+0000","last_active":"2024-09-21T09:13:34.482052+0000","last_peered":"2024-09-21T09:13:34.482052+0000","last_clean":"2024-09-21T09:13:34.482052+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:13:34.482052+0000","last_undegraded":"2024-09-21T09:13:34.482052+0000","last_fullsized":"2024-09-21T09:13:34.482052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:01.250555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482536+0000","last_change":"2024-09-21T09:13:19.157682+0000","last_active":"2024-09-21T09:13:34.482536+0000","last_peered":"2024-09-21T09:13:34.482536+0000","last_clean":"2024-09-21T09:13:34.482536+0000","last_became_active":"2024-09-21T09:13:19.157306+0000","last_became_peered":"2024-09-21T09:13:19.157306+0000","last_unstale":"2024-09-21T09:13:34.482536+0000","last_undegraded":"2024-09-21T09:13:34.482536+0000","last_fullsized":"2024-09-21T09:13:34.482536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.786122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292810+0000","last_change":"2024-09-21T09:13:19.713138+0000","last_active":"2024-09-21T09:13:34.292810+0000","last_peered":"2024-09-21T09:13:34.292810+0000","last_clean":"2024-09-21T09:13:34.292810+0000","last_became_active":"2024-09-21T09:13:19.161496+0000","last_became_peered":"2024-09-21T09:13:19.161496+0000","last_unstale":"2024-09-21T09:13:34.292810+0000","last_undegraded":"2024-09-21T09:13:34.292810+0000","last_fullsized":"2024-09-21T09:13:34.292810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:42.440821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958517+0000","last_change":"2024-09-21T09:10:56.861373+0000","last_active":"2024-09-21T09:13:34.958517+0000","last_peered":"2024-09-21T09:13:34.958517+0000","last_clean":"2024-09-21T09:13:34.958517+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:13:34.958517+0000","last_undegraded":"2024-09-21T09:13:34.958517+0000","last_fullsized":"2024-09-21T09:13:34.958517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:45.846021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376270+0000","last_change":"2024-09-21T09:11:00.838647+0000","last_active":"2024-09-21T09:13:35.376270+0000","last_peered":"2024-09-21T09:13:35.376270+0000","last_clean":"2024-09-21T09:13:35.376270+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:13:35.376270+0000","last_undegraded":"2024-09-21T09:13:35.376270+0000","last_fullsized":"2024-09-21T09:13:35.376270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:16.279789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"71'17","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482115+0000","last_change":"2024-09-21T09:11:02.877357+0000","last_active":"2024-09-21T09:13:34.482115+0000","last_peered":"2024-09-21T09:13:34.482115+0000","last_clean":"2024-09-21T09:13:34.482115+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:13:34.482115+0000","last_undegraded":"2024-09-21T09:13:34.482115+0000","last_fullsized":"2024-09-21T09:13:34.482115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:46.845302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67351,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378889+0000","last_change":"2024-09-21T09:11:04.896698+0000","last_active":"2024-09-21T09:13:35.378889+0000","last_peered":"2024-09-21T09:13:35.378889+0000","last_clean":"2024-09-21T09:13:35.378889+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:13:35.378889+0000","last_undegraded":"2024-09-21T09:13:35.378889+0000","last_fullsized":"2024-09-21T09:13:35.378889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:59.924890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297318+0000","last_change":"2024-09-21T09:13:20.646926+0000","last_active":"2024-09-21T09:13:34.297318+0000","last_peered":"2024-09-21T09:13:34.297318+0000","last_clean":"2024-09-21T09:13:34.297318+0000","last_became_active":"2024-09-21T09:13:19.153765+0000","last_became_peered":"2024-09-21T09:13:19.153765+0000","last_unstale":"2024-09-21T09:13:34.297318+0000","last_undegraded":"2024-09-21T09:13:34.297318+0000","last_fullsized":"2024-09-21T09:13:34.297318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'6","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378620+0000","last_change":"2024-09-21T09:10:58.865842+0000","last_active":"2024-09-21T09:13:35.378620+0000","last_peered":"2024-09-21T09:13:35.378620+0000","last_clean":"2024-09-21T09:13:35.378620+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:13:35.378620+0000","last_undegraded":"2024-09-21T09:13:35.378620+0000","last_fullsized":"2024-09-21T09:13:35.378620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:10.069785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"66'7","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293255+0000","last_change":"2024-09-21T09:13:19.522324+0000","last_active":"2024-09-21T09:13:34.293255+0000","last_peered":"2024-09-21T09:13:34.293255+0000","last_clean":"2024-09-21T09:13:34.293255+0000","last_became_active":"2024-09-21T09:13:19.143052+0000","last_became_peered":"2024-09-21T09:13:19.143052+0000","last_unstale":"2024-09-21T09:13:34.293255+0000","last_undegraded":"2024-09-21T09:13:34.293255+0000","last_fullsized":"2024-09-21T09:13:34.293255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:36.362618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"71'8","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527890+0000","last_change":"2024-09-21T09:10:58.871267+0000","last_active":"2024-09-21T09:13:34.527890+0000","last_peered":"2024-09-21T09:13:34.527890+0000","last_clean":"2024-09-21T09:13:34.527890+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:13:34.527890+0000","last_undegraded":"2024-09-21T09:13:34.527890+0000","last_fullsized":"2024-09-21T09:13:34.527890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"66'8","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525789+0000","last_change":"2024-09-21T09:10:56.847914+0000","last_active":"2024-09-21T09:13:34.525789+0000","last_peered":"2024-09-21T09:13:34.525789+0000","last_clean":"2024-09-21T09:13:34.525789+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:13:34.525789+0000","last_undegraded":"2024-09-21T09:13:34.525789+0000","last_fullsized":"2024-09-21T09:13:34.525789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482765+0000","last_change":"2024-09-21T09:10:58.837841+0000","last_active":"2024-09-21T09:13:34.482765+0000","last_peered":"2024-09-21T09:13:34.482765+0000","last_clean":"2024-09-21T09:13:34.482765+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:13:34.482765+0000","last_undegraded":"2024-09-21T09:13:34.482765+0000","last_fullsized":"2024-09-21T09:13:34.482765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:54.101397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"67'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482421+0000","last_change":"2024-09-21T09:10:56.861995+0000","last_active":"2024-09-21T09:13:34.482421+0000","last_peered":"2024-09-21T09:13:34.482421+0000","last_clean":"2024-09-21T09:13:34.482421+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:13:34.482421+0000","last_undegraded":"2024-09-21T09:13:34.482421+0000","last_fullsized":"2024-09-21T09:13:34.482421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:44.655482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"58'4","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957038+0000","last_change":"2024-09-21T09:13:20.835461+0000","last_active":"2024-09-21T09:13:34.957038+0000","last_peered":"2024-09-21T09:13:34.957038+0000","last_clean":"2024-09-21T09:13:34.957038+0000","last_became_active":"2024-09-21T09:13:19.169698+0000","last_became_peered":"2024-09-21T09:13:19.169698+0000","last_unstale":"2024-09-21T09:13:34.957038+0000","last_undegraded":"2024-09-21T09:13:34.957038+0000","last_fullsized":"2024-09-21T09:13:34.957038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:00.406380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"62'6","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955827+0000","last_change":"2024-09-21T09:10:56.866139+0000","last_active":"2024-09-21T09:13:34.955827+0000","last_peered":"2024-09-21T09:13:34.955827+0000","last_clean":"2024-09-21T09:13:34.955827+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:13:34.955827+0000","last_undegraded":"2024-09-21T09:13:34.955827+0000","last_fullsized":"2024-09-21T09:13:34.955827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:33.551996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"58'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956535+0000","last_change":"2024-09-21T09:10:58.840408+0000","last_active":"2024-09-21T09:13:34.956535+0000","last_peered":"2024-09-21T09:13:34.956535+0000","last_clean":"2024-09-21T09:13:34.956535+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:13:34.956535+0000","last_undegraded":"2024-09-21T09:13:34.956535+0000","last_fullsized":"2024-09-21T09:13:34.956535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:42.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"66'8","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295479+0000","last_change":"2024-09-21T09:10:56.860054+0000","last_active":"2024-09-21T09:13:34.295479+0000","last_peered":"2024-09-21T09:13:34.295479+0000","last_clean":"2024-09-21T09:13:34.295479+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:13:34.295479+0000","last_undegraded":"2024-09-21T09:13:34.295479+0000","last_fullsized":"2024-09-21T09:13:34.295479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296113+0000","last_change":"2024-09-21T09:10:58.836500+0000","last_active":"2024-09-21T09:13:34.296113+0000","last_peered":"2024-09-21T09:13:34.296113+0000","last_clean":"2024-09-21T09:13:34.296113+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:13:34.296113+0000","last_undegraded":"2024-09-21T09:13:34.296113+0000","last_fullsized":"2024-09-21T09:13:34.296113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"66'8","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295940+0000","last_change":"2024-09-21T09:10:56.862765+0000","last_active":"2024-09-21T09:13:34.295940+0000","last_peered":"2024-09-21T09:13:34.295940+0000","last_clean":"2024-09-21T09:13:34.295940+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:13:34.295940+0000","last_undegraded":"2024-09-21T09:13:34.295940+0000","last_fullsized":"2024-09-21T09:13:34.295940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"62'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294186+0000","last_change":"2024-09-21T09:10:58.826466+0000","last_active":"2024-09-21T09:13:34.294186+0000","last_peered":"2024-09-21T09:13:34.294186+0000","last_clean":"2024-09-21T09:13:34.294186+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:13:34.294186+0000","last_undegraded":"2024-09-21T09:13:34.294186+0000","last_fullsized":"2024-09-21T09:13:34.294186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"66'9","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299107+0000","last_change":"2024-09-21T09:13:20.211974+0000","last_active":"2024-09-21T09:13:34.299107+0000","last_peered":"2024-09-21T09:13:34.299107+0000","last_clean":"2024-09-21T09:13:34.299107+0000","last_became_active":"2024-09-21T09:13:19.161214+0000","last_became_peered":"2024-09-21T09:13:19.161214+0000","last_unstale":"2024-09-21T09:13:34.299107+0000","last_undegraded":"2024-09-21T09:13:34.299107+0000","last_fullsized":"2024-09-21T09:13:34.299107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:40:58.281738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"62'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527446+0000","last_change":"2024-09-21T09:10:58.872072+0000","last_active":"2024-09-21T09:13:35.527446+0000","last_peered":"2024-09-21T09:13:35.527446+0000","last_clean":"2024-09-21T09:13:35.527446+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:13:35.527446+0000","last_undegraded":"2024-09-21T09:13:35.527446+0000","last_fullsized":"2024-09-21T09:13:35.527446+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"67'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958252+0000","last_change":"2024-09-21T09:10:56.861072+0000","last_active":"2024-09-21T09:13:34.958252+0000","last_peered":"2024-09-21T09:13:34.958252+0000","last_clean":"2024-09-21T09:13:34.958252+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:13:34.958252+0000","last_undegraded":"2024-09-21T09:13:34.958252+0000","last_fullsized":"2024-09-21T09:13:34.958252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527799+0000","last_change":"2024-09-21T09:10:58.856982+0000","last_active":"2024-09-21T09:13:34.527799+0000","last_peered":"2024-09-21T09:13:34.527799+0000","last_clean":"2024-09-21T09:13:34.527799+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:13:34.527799+0000","last_undegraded":"2024-09-21T09:13:34.527799+0000","last_fullsized":"2024-09-21T09:13:34.527799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"66'7","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482177+0000","last_change":"2024-09-21T09:10:56.847793+0000","last_active":"2024-09-21T09:13:34.482177+0000","last_peered":"2024-09-21T09:13:34.482177+0000","last_clean":"2024-09-21T09:13:34.482177+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:13:34.482177+0000","last_undegraded":"2024-09-21T09:13:34.482177+0000","last_fullsized":"2024-09-21T09:13:34.482177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:22.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"62'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298133+0000","last_change":"2024-09-21T09:10:58.851481+0000","last_active":"2024-09-21T09:13:34.298133+0000","last_peered":"2024-09-21T09:13:34.298133+0000","last_clean":"2024-09-21T09:13:34.298133+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:13:34.298133+0000","last_undegraded":"2024-09-21T09:13:34.298133+0000","last_fullsized":"2024-09-21T09:13:34.298133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:42.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"67'12","reported_seq":215,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956033+0000","last_change":"2024-09-21T09:13:20.068227+0000","last_active":"2024-09-21T09:13:34.956033+0000","last_peered":"2024-09-21T09:13:34.956033+0000","last_clean":"2024-09-21T09:13:34.956033+0000","last_became_active":"2024-09-21T09:13:19.169480+0000","last_became_peered":"2024-09-21T09:13:19.169480+0000","last_unstale":"2024-09-21T09:13:34.956033+0000","last_undegraded":"2024-09-21T09:13:34.956033+0000","last_fullsized":"2024-09-21T09:13:34.956033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:08.928533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957005+0000","last_change":"2024-09-21T09:10:58.843673+0000","last_active":"2024-09-21T09:13:34.957005+0000","last_peered":"2024-09-21T09:13:34.957005+0000","last_clean":"2024-09-21T09:13:34.957005+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:13:34.957005+0000","last_undegraded":"2024-09-21T09:13:34.957005+0000","last_fullsized":"2024-09-21T09:13:34.957005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:19.133330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"67'6","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528514+0000","last_change":"2024-09-21T09:10:56.838835+0000","last_active":"2024-09-21T09:13:35.528514+0000","last_peered":"2024-09-21T09:13:35.528514+0000","last_clean":"2024-09-21T09:13:35.528514+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:13:35.528514+0000","last_undegraded":"2024-09-21T09:13:35.528514+0000","last_fullsized":"2024-09-21T09:13:35.528514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529034+0000","last_change":"2024-09-21T09:10:58.869168+0000","last_active":"2024-09-21T09:13:35.529034+0000","last_peered":"2024-09-21T09:13:35.529034+0000","last_clean":"2024-09-21T09:13:35.529034+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:13:35.529034+0000","last_undegraded":"2024-09-21T09:13:35.529034+0000","last_fullsized":"2024-09-21T09:13:35.529034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"66'13","reported_seq":222,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375170+0000","last_change":"2024-09-21T09:13:20.275872+0000","last_active":"2024-09-21T09:13:35.375170+0000","last_peered":"2024-09-21T09:13:35.375170+0000","last_clean":"2024-09-21T09:13:35.375170+0000","last_became_active":"2024-09-21T09:13:19.153073+0000","last_became_peered":"2024-09-21T09:13:19.153073+0000","last_unstale":"2024-09-21T09:13:35.375170+0000","last_undegraded":"2024-09-21T09:13:35.375170+0000","last_fullsized":"2024-09-21T09:13:35.375170+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:51.699749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526744+0000","last_change":"2024-09-21T09:10:58.840930+0000","last_active":"2024-09-21T09:13:35.526744+0000","last_peered":"2024-09-21T09:13:35.526744+0000","last_clean":"2024-09-21T09:13:35.526744+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:13:35.526744+0000","last_undegraded":"2024-09-21T09:13:35.526744+0000","last_fullsized":"2024-09-21T09:13:35.526744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"67'13","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297144+0000","last_change":"2024-09-21T09:10:56.841366+0000","last_active":"2024-09-21T09:13:34.297144+0000","last_peered":"2024-09-21T09:13:34.297144+0000","last_clean":"2024-09-21T09:13:34.297144+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:13:34.297144+0000","last_undegraded":"2024-09-21T09:13:34.297144+0000","last_fullsized":"2024-09-21T09:13:34.297144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:15.948479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526167+0000","last_change":"2024-09-21T09:10:58.873865+0000","last_active":"2024-09-21T09:13:34.526167+0000","last_peered":"2024-09-21T09:13:34.526167+0000","last_clean":"2024-09-21T09:13:34.526167+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:13:34.526167+0000","last_undegraded":"2024-09-21T09:13:34.526167+0000","last_fullsized":"2024-09-21T09:13:34.526167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"67'5","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482963+0000","last_change":"2024-09-21T09:10:56.843359+0000","last_active":"2024-09-21T09:13:34.482963+0000","last_peered":"2024-09-21T09:13:34.482963+0000","last_clean":"2024-09-21T09:13:34.482963+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:13:34.482963+0000","last_undegraded":"2024-09-21T09:13:34.482963+0000","last_fullsized":"2024-09-21T09:13:34.482963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:17.126175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"71'4","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377059+0000","last_change":"2024-09-21T09:10:58.864268+0000","last_active":"2024-09-21T09:13:35.377059+0000","last_peered":"2024-09-21T09:13:35.377059+0000","last_clean":"2024-09-21T09:13:35.377059+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:13:35.377059+0000","last_undegraded":"2024-09-21T09:13:35.377059+0000","last_fullsized":"2024-09-21T09:13:35.377059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:22.929821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"66'10","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.528171+0000","last_change":"2024-09-21T09:13:19.704634+0000","last_active":"2024-09-21T09:13:34.528171+0000","last_peered":"2024-09-21T09:13:34.528171+0000","last_clean":"2024-09-21T09:13:34.528171+0000","last_became_active":"2024-09-21T09:13:19.159408+0000","last_became_peered":"2024-09-21T09:13:19.159408+0000","last_unstale":"2024-09-21T09:13:34.528171+0000","last_undegraded":"2024-09-21T09:13:34.528171+0000","last_fullsized":"2024-09-21T09:13:34.528171+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:49.771475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527340+0000","last_change":"2024-09-21T09:10:58.840040+0000","last_active":"2024-09-21T09:13:35.527340+0000","last_peered":"2024-09-21T09:13:35.527340+0000","last_clean":"2024-09-21T09:13:35.527340+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:13:35.527340+0000","last_undegraded":"2024-09-21T09:13:35.527340+0000","last_fullsized":"2024-09-21T09:13:35.527340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"66'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483406+0000","last_change":"2024-09-21T09:10:56.845828+0000","last_active":"2024-09-21T09:13:34.483406+0000","last_peered":"2024-09-21T09:13:34.483406+0000","last_clean":"2024-09-21T09:13:34.483406+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:13:34.483406+0000","last_undegraded":"2024-09-21T09:13:34.483406+0000","last_fullsized":"2024-09-21T09:13:34.483406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:37.489093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"67'8","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:13:20.828458+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:13:19.155182+0000","last_became_peered":"2024-09-21T09:13:19.155182+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:34.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378422+0000","last_change":"2024-09-21T09:10:58.871879+0000","last_active":"2024-09-21T09:13:35.378422+0000","last_peered":"2024-09-21T09:13:35.378422+0000","last_clean":"2024-09-21T09:13:35.378422+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:13:35.378422+0000","last_undegraded":"2024-09-21T09:13:35.378422+0000","last_fullsized":"2024-09-21T09:13:35.378422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:28.117298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"66'10","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955726+0000","last_change":"2024-09-21T09:10:56.862439+0000","last_active":"2024-09-21T09:13:34.955726+0000","last_peered":"2024-09-21T09:13:34.955726+0000","last_clean":"2024-09-21T09:13:34.955726+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:13:34.955726+0000","last_undegraded":"2024-09-21T09:13:34.955726+0000","last_fullsized":"2024-09-21T09:13:34.955726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527158+0000","last_change":"2024-09-21T09:10:58.828974+0000","last_active":"2024-09-21T09:13:35.527158+0000","last_peered":"2024-09-21T09:13:35.527158+0000","last_clean":"2024-09-21T09:13:35.527158+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:13:35.527158+0000","last_undegraded":"2024-09-21T09:13:35.527158+0000","last_fullsized":"2024-09-21T09:13:35.527158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":233,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":848,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":820,"ondisk_log_size":820,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":156302,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":813,"num_read_kb":575,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":660,"num_keys_recovered":24,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":272744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":668,"ondisk_log_size":668,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":545,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":23,"num_write":644,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":1149239296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384648,"kb_used_data":349304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93987192,"statfs":{"total":96636764160,"available":96242884608,"internally_reserved":0,"allocated":357687296,"data_stored":357174157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":511572,"kb_used_data":476224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93860268,"statfs":{"total":96636764160,"available":96112914432,"internally_reserved":0,"allocated":487653376,"data_stored":487144593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":790672,"kb_used_data":755328,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93581168,"statfs":{"total":96636764160,"available":95827116032,"internally_reserved":0,"allocated":773455872,"data_stored":772942678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763532,"kb_used_data":728184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93608308,"statfs":{"total":96636764160,"available":95854907392,"internally_reserved":0,"allocated":745660416,"data_stored":745152324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":677440,"kb_used_data":642084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93694400,"statfs":{"total":96636764160,"available":95943065600,"internally_reserved":0,"allocated":657494016,"data_stored":657008169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":594160,"kb_used_data":558816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93777680,"statfs":{"total":96636764160,"available":96028344320,"internally_reserved":0,"allocated":572227584,"data_stored":571684881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":794284,"kb_used_data":758940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93577556,"statfs":{"total":96636764160,"available":95823417344,"internally_reserved":0,"allocated":777154560,"data_stored":776616419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462480,"kb_used_data":422976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93909360,"statfs":{"total":96636764160,"available":96163184640,"internally_reserved":0,"allocated":433127424,"data_stored":432613611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":775946240,"data_stored":775946240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":570425344,"data_stored":570425344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":656408576,"data_stored":656408576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":744488960,"data_stored":744488960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":432013312,"data_stored":432013312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":771751936,"data_stored":771751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":486539264,"data_stored":486539264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":356515840,"data_stored":356515840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":70250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":6483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":58451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:13:46.023 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:13:46.414 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:13:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:13:46.432 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-21T09:13:45.024801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397793038,"num_objects":773,"num_object_clones":0,"num_object_copies":1546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":773,"num_whiteouts":0,"num_read":2000,"num_read_kb":1716,"num_write":1739,"num_write_kb":2368151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":1149241676,"num_keys_recovered":26,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2531,"ondisk_log_size":2531,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4978788,"kb_used_data":4691856,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":749995932,"statfs":{"total":773094113280,"available":767995834368,"internally_reserved":0,"allocated":4804460544,"data_stored":4800336832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.735051"},"pg_stats":[{"pgid":"3.3f","version":"66'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299072+0000","last_change":"2024-09-21T09:10:56.846463+0000","last_active":"2024-09-21T09:13:34.299072+0000","last_peered":"2024-09-21T09:13:34.299072+0000","last_clean":"2024-09-21T09:13:34.299072+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:13:34.299072+0000","last_undegraded":"2024-09-21T09:13:34.299072+0000","last_fullsized":"2024-09-21T09:13:34.299072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527158+0000","last_change":"2024-09-21T09:10:58.836923+0000","last_active":"2024-09-21T09:13:35.527158+0000","last_peered":"2024-09-21T09:13:35.527158+0000","last_clean":"2024-09-21T09:13:35.527158+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:13:35.527158+0000","last_undegraded":"2024-09-21T09:13:35.527158+0000","last_fullsized":"2024-09-21T09:13:35.527158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:30.880333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"67'13","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957928+0000","last_change":"2024-09-21T09:10:56.865056+0000","last_active":"2024-09-21T09:13:34.957928+0000","last_peered":"2024-09-21T09:13:34.957928+0000","last_clean":"2024-09-21T09:13:34.957928+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:13:34.957928+0000","last_undegraded":"2024-09-21T09:13:34.957928+0000","last_fullsized":"2024-09-21T09:13:34.957928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482290+0000","last_change":"2024-09-21T09:10:58.835355+0000","last_active":"2024-09-21T09:13:34.482290+0000","last_peered":"2024-09-21T09:13:34.482290+0000","last_clean":"2024-09-21T09:13:34.482290+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:13:34.482290+0000","last_undegraded":"2024-09-21T09:13:34.482290+0000","last_fullsized":"2024-09-21T09:13:34.482290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:24.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"67'13","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957115+0000","last_change":"2024-09-21T09:10:56.861504+0000","last_active":"2024-09-21T09:13:34.957115+0000","last_peered":"2024-09-21T09:13:34.957115+0000","last_clean":"2024-09-21T09:13:34.957115+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:13:34.957115+0000","last_undegraded":"2024-09-21T09:13:34.957115+0000","last_fullsized":"2024-09-21T09:13:34.957115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:00.409267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482198+0000","last_change":"2024-09-21T09:13:19.490368+0000","last_active":"2024-09-21T09:13:34.482198+0000","last_peered":"2024-09-21T09:13:34.482198+0000","last_clean":"2024-09-21T09:13:34.482198+0000","last_became_active":"2024-09-21T09:13:19.153424+0000","last_became_peered":"2024-09-21T09:13:19.153424+0000","last_unstale":"2024-09-21T09:13:34.482198+0000","last_undegraded":"2024-09-21T09:13:34.482198+0000","last_fullsized":"2024-09-21T09:13:34.482198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:25.154789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"66'13","reported_seq":68,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298556+0000","last_change":"2024-09-21T09:13:20.586732+0000","last_active":"2024-09-21T09:13:34.298556+0000","last_peered":"2024-09-21T09:13:34.298556+0000","last_clean":"2024-09-21T09:13:34.298556+0000","last_became_active":"2024-09-21T09:13:19.165441+0000","last_became_peered":"2024-09-21T09:13:19.165441+0000","last_unstale":"2024-09-21T09:13:34.298556+0000","last_undegraded":"2024-09-21T09:13:34.298556+0000","last_fullsized":"2024-09-21T09:13:34.298556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:51.794446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"58'4","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375167+0000","last_change":"2024-09-21T09:13:20.643217+0000","last_active":"2024-09-21T09:13:35.375167+0000","last_peered":"2024-09-21T09:13:35.375167+0000","last_clean":"2024-09-21T09:13:35.375167+0000","last_became_active":"2024-09-21T09:13:19.153875+0000","last_became_peered":"2024-09-21T09:13:19.153875+0000","last_unstale":"2024-09-21T09:13:35.375167+0000","last_undegraded":"2024-09-21T09:13:35.375167+0000","last_fullsized":"2024-09-21T09:13:35.375167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:03.004434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"67'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296553+0000","last_change":"2024-09-21T09:10:56.863607+0000","last_active":"2024-09-21T09:13:34.296553+0000","last_peered":"2024-09-21T09:13:34.296553+0000","last_clean":"2024-09-21T09:13:34.296553+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:13:34.296553+0000","last_undegraded":"2024-09-21T09:13:34.296553+0000","last_fullsized":"2024-09-21T09:13:34.296553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296333+0000","last_change":"2024-09-21T09:10:58.851357+0000","last_active":"2024-09-21T09:13:34.296333+0000","last_peered":"2024-09-21T09:13:34.296333+0000","last_clean":"2024-09-21T09:13:34.296333+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:13:34.296333+0000","last_undegraded":"2024-09-21T09:13:34.296333+0000","last_fullsized":"2024-09-21T09:13:34.296333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"66'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293642+0000","last_change":"2024-09-21T09:13:19.704935+0000","last_active":"2024-09-21T09:13:34.293642+0000","last_peered":"2024-09-21T09:13:34.293642+0000","last_clean":"2024-09-21T09:13:34.293642+0000","last_became_active":"2024-09-21T09:13:19.160915+0000","last_became_peered":"2024-09-21T09:13:19.160915+0000","last_unstale":"2024-09-21T09:13:34.293642+0000","last_undegraded":"2024-09-21T09:13:34.293642+0000","last_fullsized":"2024-09-21T09:13:34.293642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:00.863610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297928+0000","last_change":"2024-09-21T09:10:58.825880+0000","last_active":"2024-09-21T09:13:34.297928+0000","last_peered":"2024-09-21T09:13:34.297928+0000","last_clean":"2024-09-21T09:13:34.297928+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:13:34.297928+0000","last_undegraded":"2024-09-21T09:13:34.297928+0000","last_fullsized":"2024-09-21T09:13:34.297928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:46.662637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"66'5","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294804+0000","last_change":"2024-09-21T09:10:56.851331+0000","last_active":"2024-09-21T09:13:34.294804+0000","last_peered":"2024-09-21T09:13:34.294804+0000","last_clean":"2024-09-21T09:13:34.294804+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:13:34.294804+0000","last_undegraded":"2024-09-21T09:13:34.294804+0000","last_fullsized":"2024-09-21T09:13:34.294804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"62'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298620+0000","last_change":"2024-09-21T09:13:20.336460+0000","last_active":"2024-09-21T09:13:34.298620+0000","last_peered":"2024-09-21T09:13:34.298620+0000","last_clean":"2024-09-21T09:13:34.298620+0000","last_became_active":"2024-09-21T09:13:19.164775+0000","last_became_peered":"2024-09-21T09:13:19.164775+0000","last_unstale":"2024-09-21T09:13:34.298620+0000","last_undegraded":"2024-09-21T09:13:34.298620+0000","last_fullsized":"2024-09-21T09:13:34.298620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:16.166364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"67'11","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955584+0000","last_change":"2024-09-21T09:10:56.864409+0000","last_active":"2024-09-21T09:13:34.955584+0000","last_peered":"2024-09-21T09:13:34.955584+0000","last_clean":"2024-09-21T09:13:34.955584+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:13:34.955584+0000","last_undegraded":"2024-09-21T09:13:34.955584+0000","last_fullsized":"2024-09-21T09:13:34.955584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"62'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958533+0000","last_change":"2024-09-21T09:10:58.837006+0000","last_active":"2024-09-21T09:13:34.958533+0000","last_peered":"2024-09-21T09:13:34.958533+0000","last_clean":"2024-09-21T09:13:34.958533+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:13:34.958533+0000","last_undegraded":"2024-09-21T09:13:34.958533+0000","last_fullsized":"2024-09-21T09:13:34.958533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:52.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482026+0000","last_change":"2024-09-21T09:10:58.853249+0000","last_active":"2024-09-21T09:13:34.482026+0000","last_peered":"2024-09-21T09:13:34.482026+0000","last_clean":"2024-09-21T09:13:34.482026+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:13:34.482026+0000","last_undegraded":"2024-09-21T09:13:34.482026+0000","last_fullsized":"2024-09-21T09:13:34.482026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:03.692219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"66'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528471+0000","last_change":"2024-09-21T09:10:56.838955+0000","last_active":"2024-09-21T09:13:35.528471+0000","last_peered":"2024-09-21T09:13:35.528471+0000","last_clean":"2024-09-21T09:13:35.528471+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:13:35.528471+0000","last_undegraded":"2024-09-21T09:13:35.528471+0000","last_fullsized":"2024-09-21T09:13:35.528471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294467+0000","last_change":"2024-09-21T09:10:58.869303+0000","last_active":"2024-09-21T09:13:34.294467+0000","last_peered":"2024-09-21T09:13:34.294467+0000","last_clean":"2024-09-21T09:13:34.294467+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:13:34.294467+0000","last_undegraded":"2024-09-21T09:13:34.294467+0000","last_fullsized":"2024-09-21T09:13:34.294467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"67'7","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298558+0000","last_change":"2024-09-21T09:13:21.021044+0000","last_active":"2024-09-21T09:13:34.298558+0000","last_peered":"2024-09-21T09:13:34.298558+0000","last_clean":"2024-09-21T09:13:34.298558+0000","last_became_active":"2024-09-21T09:13:19.154413+0000","last_became_peered":"2024-09-21T09:13:19.154413+0000","last_unstale":"2024-09-21T09:13:34.298558+0000","last_undegraded":"2024-09-21T09:13:34.298558+0000","last_fullsized":"2024-09-21T09:13:34.298558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'8","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528416+0000","last_change":"2024-09-21T09:10:58.840976+0000","last_active":"2024-09-21T09:13:35.528416+0000","last_peered":"2024-09-21T09:13:35.528416+0000","last_clean":"2024-09-21T09:13:35.528416+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:13:35.528416+0000","last_undegraded":"2024-09-21T09:13:35.528416+0000","last_fullsized":"2024-09-21T09:13:35.528416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"66'9","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298092+0000","last_change":"2024-09-21T09:10:56.853888+0000","last_active":"2024-09-21T09:13:34.298092+0000","last_peered":"2024-09-21T09:13:34.298092+0000","last_clean":"2024-09-21T09:13:34.298092+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:13:34.298092+0000","last_undegraded":"2024-09-21T09:13:34.298092+0000","last_fullsized":"2024-09-21T09:13:34.298092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294562+0000","last_change":"2024-09-21T09:10:58.838132+0000","last_active":"2024-09-21T09:13:34.294562+0000","last_peered":"2024-09-21T09:13:34.294562+0000","last_clean":"2024-09-21T09:13:34.294562+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:13:34.294562+0000","last_undegraded":"2024-09-21T09:13:34.294562+0000","last_fullsized":"2024-09-21T09:13:34.294562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"66'10","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296777+0000","last_change":"2024-09-21T09:10:56.845923+0000","last_active":"2024-09-21T09:13:34.296777+0000","last_peered":"2024-09-21T09:13:34.296777+0000","last_clean":"2024-09-21T09:13:34.296777+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:13:34.296777+0000","last_undegraded":"2024-09-21T09:13:34.296777+0000","last_fullsized":"2024-09-21T09:13:34.296777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'8","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956761+0000","last_change":"2024-09-21T09:10:58.848326+0000","last_active":"2024-09-21T09:13:34.956761+0000","last_peered":"2024-09-21T09:13:34.956761+0000","last_clean":"2024-09-21T09:13:34.956761+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:13:34.956761+0000","last_undegraded":"2024-09-21T09:13:34.956761+0000","last_fullsized":"2024-09-21T09:13:34.956761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:44.318321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"71'12","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295345+0000","last_change":"2024-09-21T09:10:56.859019+0000","last_active":"2024-09-21T09:13:34.295345+0000","last_peered":"2024-09-21T09:13:34.295345+0000","last_clean":"2024-09-21T09:13:34.295345+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:13:34.295345+0000","last_undegraded":"2024-09-21T09:13:34.295345+0000","last_fullsized":"2024-09-21T09:13:34.295345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529197+0000","last_change":"2024-09-21T09:10:58.830335+0000","last_active":"2024-09-21T09:13:35.529197+0000","last_peered":"2024-09-21T09:13:35.529197+0000","last_clean":"2024-09-21T09:13:35.529197+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:13:35.529197+0000","last_undegraded":"2024-09-21T09:13:35.529197+0000","last_fullsized":"2024-09-21T09:13:35.529197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"67'7","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294674+0000","last_change":"2024-09-21T09:10:56.862662+0000","last_active":"2024-09-21T09:13:34.294674+0000","last_peered":"2024-09-21T09:13:34.294674+0000","last_clean":"2024-09-21T09:13:34.294674+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:13:34.294674+0000","last_undegraded":"2024-09-21T09:13:34.294674+0000","last_fullsized":"2024-09-21T09:13:34.294674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295061+0000","last_change":"2024-09-21T09:11:06.898983+0000","last_active":"2024-09-21T09:13:34.295061+0000","last_peered":"2024-09-21T09:13:34.295061+0000","last_clean":"2024-09-21T09:13:34.295061+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:13:34.295061+0000","last_undegraded":"2024-09-21T09:13:34.295061+0000","last_fullsized":"2024-09-21T09:13:34.295061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294904+0000","last_change":"2024-09-21T09:10:58.876069+0000","last_active":"2024-09-21T09:13:34.294904+0000","last_peered":"2024-09-21T09:13:34.294904+0000","last_clean":"2024-09-21T09:13:34.294904+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:13:34.294904+0000","last_undegraded":"2024-09-21T09:13:34.294904+0000","last_fullsized":"2024-09-21T09:13:34.294904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"66'4","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482459+0000","last_change":"2024-09-21T09:10:56.848523+0000","last_active":"2024-09-21T09:13:34.482459+0000","last_peered":"2024-09-21T09:13:34.482459+0000","last_clean":"2024-09-21T09:13:34.482459+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:13:34.482459+0000","last_undegraded":"2024-09-21T09:13:34.482459+0000","last_fullsized":"2024-09-21T09:13:34.482459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:19.819608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483302+0000","last_change":"2024-09-21T09:11:00.842168+0000","last_active":"2024-09-21T09:13:34.483302+0000","last_peered":"2024-09-21T09:13:34.483302+0000","last_clean":"2024-09-21T09:13:34.483302+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:13:34.483302+0000","last_undegraded":"2024-09-21T09:13:34.483302+0000","last_fullsized":"2024-09-21T09:13:34.483302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:33.920548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"71'15","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377878+0000","last_change":"2024-09-21T09:11:02.866403+0000","last_active":"2024-09-21T09:13:35.377878+0000","last_peered":"2024-09-21T09:13:35.377878+0000","last_clean":"2024-09-21T09:13:35.377878+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:13:35.377878+0000","last_undegraded":"2024-09-21T09:13:35.377878+0000","last_fullsized":"2024-09-21T09:13:35.377878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:12.124539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527948+0000","last_change":"2024-09-21T09:11:04.894715+0000","last_active":"2024-09-21T09:13:35.527948+0000","last_peered":"2024-09-21T09:13:35.527948+0000","last_clean":"2024-09-21T09:13:35.527948+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:13:35.527948+0000","last_undegraded":"2024-09-21T09:13:35.527948+0000","last_fullsized":"2024-09-21T09:13:35.527948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:59.579572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"58'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527415+0000","last_change":"2024-09-21T09:11:06.885484+0000","last_active":"2024-09-21T09:13:35.527415+0000","last_peered":"2024-09-21T09:13:35.527415+0000","last_clean":"2024-09-21T09:13:35.527415+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:13:35.527415+0000","last_undegraded":"2024-09-21T09:13:35.527415+0000","last_fullsized":"2024-09-21T09:13:35.527415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:13.165470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"61'6","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483104+0000","last_change":"2024-09-21T09:10:58.842832+0000","last_active":"2024-09-21T09:13:34.483104+0000","last_peered":"2024-09-21T09:13:34.483104+0000","last_clean":"2024-09-21T09:13:34.483104+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:13:34.483104+0000","last_undegraded":"2024-09-21T09:13:34.483104+0000","last_fullsized":"2024-09-21T09:13:34.483104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:12.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:56.849428+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375922+0000","last_change":"2024-09-21T09:13:19.156069+0000","last_active":"2024-09-21T09:13:35.375922+0000","last_peered":"2024-09-21T09:13:35.375922+0000","last_clean":"2024-09-21T09:13:35.375922+0000","last_became_active":"2024-09-21T09:13:19.153940+0000","last_became_peered":"2024-09-21T09:13:19.153940+0000","last_unstale":"2024-09-21T09:13:35.375922+0000","last_undegraded":"2024-09-21T09:13:35.375922+0000","last_fullsized":"2024-09-21T09:13:35.375922+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:57.795849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526564+0000","last_change":"2024-09-21T09:11:02.866594+0000","last_active":"2024-09-21T09:13:35.526564+0000","last_peered":"2024-09-21T09:13:35.526564+0000","last_clean":"2024-09-21T09:13:35.526564+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:13:35.526564+0000","last_undegraded":"2024-09-21T09:13:35.526564+0000","last_fullsized":"2024-09-21T09:13:35.526564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526934+0000","last_change":"2024-09-21T09:11:04.887299+0000","last_active":"2024-09-21T09:13:35.526934+0000","last_peered":"2024-09-21T09:13:35.526934+0000","last_clean":"2024-09-21T09:13:35.526934+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:13:35.526934+0000","last_undegraded":"2024-09-21T09:13:35.526934+0000","last_fullsized":"2024-09-21T09:13:35.526934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:08.490686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":129,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294124+0000","last_change":"2024-09-21T09:13:19.145016+0000","last_active":"2024-09-21T09:13:34.294124+0000","last_peered":"2024-09-21T09:13:34.294124+0000","last_clean":"2024-09-21T09:13:34.294124+0000","last_became_active":"2024-09-21T09:13:19.144143+0000","last_became_peered":"2024-09-21T09:13:19.144143+0000","last_unstale":"2024-09-21T09:13:34.294124+0000","last_undegraded":"2024-09-21T09:13:34.294124+0000","last_fullsized":"2024-09-21T09:13:34.294124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957751+0000","last_change":"2024-09-21T09:10:58.851370+0000","last_active":"2024-09-21T09:13:34.957751+0000","last_peered":"2024-09-21T09:13:34.957751+0000","last_clean":"2024-09-21T09:13:34.957751+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:13:34.957751+0000","last_undegraded":"2024-09-21T09:13:34.957751+0000","last_fullsized":"2024-09-21T09:13:34.957751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:05.984687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"66'4","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482409+0000","last_change":"2024-09-21T09:13:21.119832+0000","last_active":"2024-09-21T09:13:34.482409+0000","last_peered":"2024-09-21T09:13:34.482409+0000","last_clean":"2024-09-21T09:13:34.482409+0000","last_became_active":"2024-09-21T09:13:19.159398+0000","last_became_peered":"2024-09-21T09:13:19.159398+0000","last_unstale":"2024-09-21T09:13:34.482409+0000","last_undegraded":"2024-09-21T09:13:34.482409+0000","last_fullsized":"2024-09-21T09:13:34.482409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:40.942331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377709+0000","last_change":"2024-09-21T09:11:00.845836+0000","last_active":"2024-09-21T09:13:35.377709+0000","last_peered":"2024-09-21T09:13:35.377709+0000","last_clean":"2024-09-21T09:13:35.377709+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:13:35.377709+0000","last_undegraded":"2024-09-21T09:13:35.377709+0000","last_fullsized":"2024-09-21T09:13:35.377709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:06.353993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376373+0000","last_change":"2024-09-21T09:11:02.852500+0000","last_active":"2024-09-21T09:13:35.376373+0000","last_peered":"2024-09-21T09:13:35.376373+0000","last_clean":"2024-09-21T09:13:35.376373+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:13:35.376373+0000","last_undegraded":"2024-09-21T09:13:35.376373+0000","last_fullsized":"2024-09-21T09:13:35.376373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:19.073540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"91'102","reported_seq":329,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042597+0000","last_change":"2024-09-21T09:11:04.895087+0000","last_active":"2024-09-21T09:13:36.042597+0000","last_peered":"2024-09-21T09:13:36.042597+0000","last_clean":"2024-09-21T09:13:36.042597+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:13:36.042597+0000","last_undegraded":"2024-09-21T09:13:36.042597+0000","last_fullsized":"2024-09-21T09:13:36.042597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:11.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295621+0000","last_change":"2024-09-21T09:13:19.162437+0000","last_active":"2024-09-21T09:13:34.295621+0000","last_peered":"2024-09-21T09:13:34.295621+0000","last_clean":"2024-09-21T09:13:34.295621+0000","last_became_active":"2024-09-21T09:13:19.161659+0000","last_became_peered":"2024-09-21T09:13:19.161659+0000","last_unstale":"2024-09-21T09:13:34.295621+0000","last_undegraded":"2024-09-21T09:13:34.295621+0000","last_fullsized":"2024-09-21T09:13:34.295621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:59.822101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958090+0000","last_change":"2024-09-21T09:10:58.837602+0000","last_active":"2024-09-21T09:13:34.958090+0000","last_peered":"2024-09-21T09:13:34.958090+0000","last_clean":"2024-09-21T09:13:34.958090+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:13:34.958090+0000","last_undegraded":"2024-09-21T09:13:34.958090+0000","last_fullsized":"2024-09-21T09:13:34.958090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:36.269116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"67'17","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527550+0000","last_change":"2024-09-21T09:10:56.844292+0000","last_active":"2024-09-21T09:13:35.527550+0000","last_peered":"2024-09-21T09:13:35.527550+0000","last_clean":"2024-09-21T09:13:35.527550+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:13:35.527550+0000","last_undegraded":"2024-09-21T09:13:35.527550+0000","last_fullsized":"2024-09-21T09:13:35.527550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482929+0000","last_change":"2024-09-21T09:11:00.852984+0000","last_active":"2024-09-21T09:13:34.482929+0000","last_peered":"2024-09-21T09:13:34.482929+0000","last_clean":"2024-09-21T09:13:34.482929+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:13:34.482929+0000","last_undegraded":"2024-09-21T09:13:34.482929+0000","last_fullsized":"2024-09-21T09:13:34.482929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:33.175145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"71'15","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299712+0000","last_change":"2024-09-21T09:13:19.543924+0000","last_active":"2024-09-21T09:13:34.299712+0000","last_peered":"2024-09-21T09:13:34.299712+0000","last_clean":"2024-09-21T09:13:34.299712+0000","last_became_active":"2024-09-21T09:13:19.160798+0000","last_became_peered":"2024-09-21T09:13:19.160798+0000","last_unstale":"2024-09-21T09:13:34.299712+0000","last_undegraded":"2024-09-21T09:13:34.299712+0000","last_fullsized":"2024-09-21T09:13:34.299712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"91'102","reported_seq":303,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042349+0000","last_change":"2024-09-21T09:11:04.894947+0000","last_active":"2024-09-21T09:13:36.042349+0000","last_peered":"2024-09-21T09:13:36.042349+0000","last_clean":"2024-09-21T09:13:36.042349+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:13:36.042349+0000","last_undegraded":"2024-09-21T09:13:36.042349+0000","last_fullsized":"2024-09-21T09:13:36.042349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:21.481386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482063+0000","last_change":"2024-09-21T09:10:58.841384+0000","last_active":"2024-09-21T09:13:34.482063+0000","last_peered":"2024-09-21T09:13:34.482063+0000","last_clean":"2024-09-21T09:13:34.482063+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:13:34.482063+0000","last_undegraded":"2024-09-21T09:13:34.482063+0000","last_fullsized":"2024-09-21T09:13:34.482063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:08.308265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"67'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299480+0000","last_change":"2024-09-21T09:10:56.846710+0000","last_active":"2024-09-21T09:13:34.299480+0000","last_peered":"2024-09-21T09:13:34.299480+0000","last_clean":"2024-09-21T09:13:34.299480+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:13:34.299480+0000","last_undegraded":"2024-09-21T09:13:34.299480+0000","last_fullsized":"2024-09-21T09:13:34.299480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527660+0000","last_change":"2024-09-21T09:11:00.839560+0000","last_active":"2024-09-21T09:13:35.527660+0000","last_peered":"2024-09-21T09:13:35.527660+0000","last_clean":"2024-09-21T09:13:35.527660+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:13:35.527660+0000","last_undegraded":"2024-09-21T09:13:35.527660+0000","last_fullsized":"2024-09-21T09:13:35.527660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:41.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"71'26","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295964+0000","last_change":"2024-09-21T09:11:02.872323+0000","last_active":"2024-09-21T09:13:34.295964+0000","last_peered":"2024-09-21T09:13:34.295964+0000","last_clean":"2024-09-21T09:13:34.295964+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:13:34.295964+0000","last_undegraded":"2024-09-21T09:13:34.295964+0000","last_fullsized":"2024-09-21T09:13:34.295964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294211+0000","last_change":"2024-09-21T09:13:19.150862+0000","last_active":"2024-09-21T09:13:34.294211+0000","last_peered":"2024-09-21T09:13:34.294211+0000","last_clean":"2024-09-21T09:13:34.294211+0000","last_became_active":"2024-09-21T09:13:19.149936+0000","last_became_peered":"2024-09-21T09:13:19.149936+0000","last_unstale":"2024-09-21T09:13:34.294211+0000","last_undegraded":"2024-09-21T09:13:34.294211+0000","last_fullsized":"2024-09-21T09:13:34.294211+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.535171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"62'12","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298350+0000","last_change":"2024-09-21T09:13:20.340381+0000","last_active":"2024-09-21T09:13:34.298350+0000","last_peered":"2024-09-21T09:13:34.298350+0000","last_clean":"2024-09-21T09:13:34.298350+0000","last_became_active":"2024-09-21T09:13:19.165108+0000","last_became_peered":"2024-09-21T09:13:19.165108+0000","last_unstale":"2024-09-21T09:13:34.298350+0000","last_undegraded":"2024-09-21T09:13:34.298350+0000","last_fullsized":"2024-09-21T09:13:34.298350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:41.830217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527807+0000","last_change":"2024-09-21T09:10:58.839960+0000","last_active":"2024-09-21T09:13:35.527807+0000","last_peered":"2024-09-21T09:13:35.527807+0000","last_clean":"2024-09-21T09:13:35.527807+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:13:35.527807+0000","last_undegraded":"2024-09-21T09:13:35.527807+0000","last_fullsized":"2024-09-21T09:13:35.527807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"67'7","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298110+0000","last_change":"2024-09-21T09:13:20.333955+0000","last_active":"2024-09-21T09:13:34.298110+0000","last_peered":"2024-09-21T09:13:34.298110+0000","last_clean":"2024-09-21T09:13:34.298110+0000","last_became_active":"2024-09-21T09:13:19.162605+0000","last_became_peered":"2024-09-21T09:13:19.162605+0000","last_unstale":"2024-09-21T09:13:34.298110+0000","last_undegraded":"2024-09-21T09:13:34.298110+0000","last_fullsized":"2024-09-21T09:13:34.298110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:21.030407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293432+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.293432+0000","last_peered":"2024-09-21T09:13:34.293432+0000","last_clean":"2024-09-21T09:13:34.293432+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:13:34.293432+0000","last_undegraded":"2024-09-21T09:13:34.293432+0000","last_fullsized":"2024-09-21T09:13:34.293432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:48.669684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"71'16","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376624+0000","last_change":"2024-09-21T09:11:02.866165+0000","last_active":"2024-09-21T09:13:35.376624+0000","last_peered":"2024-09-21T09:13:35.376624+0000","last_clean":"2024-09-21T09:13:35.376624+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:13:35.376624+0000","last_undegraded":"2024-09-21T09:13:35.376624+0000","last_fullsized":"2024-09-21T09:13:35.376624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:54:48.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376278+0000","last_change":"2024-09-21T09:11:04.871999+0000","last_active":"2024-09-21T09:13:35.376278+0000","last_peered":"2024-09-21T09:13:35.376278+0000","last_clean":"2024-09-21T09:13:35.376278+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:13:35.376278+0000","last_undegraded":"2024-09-21T09:13:35.376278+0000","last_fullsized":"2024-09-21T09:13:35.376278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:03.218684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"58'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528795+0000","last_change":"2024-09-21T09:13:19.709890+0000","last_active":"2024-09-21T09:13:35.528795+0000","last_peered":"2024-09-21T09:13:35.528795+0000","last_clean":"2024-09-21T09:13:35.528795+0000","last_became_active":"2024-09-21T09:13:19.167145+0000","last_became_peered":"2024-09-21T09:13:19.167145+0000","last_unstale":"2024-09-21T09:13:35.528795+0000","last_undegraded":"2024-09-21T09:13:35.528795+0000","last_fullsized":"2024-09-21T09:13:35.528795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294491+0000","last_change":"2024-09-21T09:13:19.528866+0000","last_active":"2024-09-21T09:13:34.294491+0000","last_peered":"2024-09-21T09:13:34.294491+0000","last_clean":"2024-09-21T09:13:34.294491+0000","last_became_active":"2024-09-21T09:13:19.158113+0000","last_became_peered":"2024-09-21T09:13:19.158113+0000","last_unstale":"2024-09-21T09:13:34.294491+0000","last_undegraded":"2024-09-21T09:13:34.294491+0000","last_fullsized":"2024-09-21T09:13:34.294491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:48.503141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"66'18","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482839+0000","last_change":"2024-09-21T09:10:56.842697+0000","last_active":"2024-09-21T09:13:34.482839+0000","last_peered":"2024-09-21T09:13:34.482839+0000","last_clean":"2024-09-21T09:13:34.482839+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:13:34.482839+0000","last_undegraded":"2024-09-21T09:13:34.482839+0000","last_fullsized":"2024-09-21T09:13:34.482839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:42.311166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957018+0000","last_change":"2024-09-21T09:11:00.852970+0000","last_active":"2024-09-21T09:13:34.957018+0000","last_peered":"2024-09-21T09:13:34.957018+0000","last_clean":"2024-09-21T09:13:34.957018+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:13:34.957018+0000","last_undegraded":"2024-09-21T09:13:34.957018+0000","last_fullsized":"2024-09-21T09:13:34.957018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:35.201984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"71'21","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481917+0000","last_change":"2024-09-21T09:11:02.859081+0000","last_active":"2024-09-21T09:13:34.481917+0000","last_peered":"2024-09-21T09:13:34.481917+0000","last_clean":"2024-09-21T09:13:34.481917+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:13:34.481917+0000","last_undegraded":"2024-09-21T09:13:34.481917+0000","last_fullsized":"2024-09-21T09:13:34.481917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:19.576627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"91'102","reported_seq":258,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042372+0000","last_change":"2024-09-21T09:11:04.895980+0000","last_active":"2024-09-21T09:13:36.042372+0000","last_peered":"2024-09-21T09:13:36.042372+0000","last_clean":"2024-09-21T09:13:36.042372+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:13:36.042372+0000","last_undegraded":"2024-09-21T09:13:36.042372+0000","last_fullsized":"2024-09-21T09:13:36.042372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:57.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295156+0000","last_change":"2024-09-21T09:13:20.635132+0000","last_active":"2024-09-21T09:13:34.295156+0000","last_peered":"2024-09-21T09:13:34.295156+0000","last_clean":"2024-09-21T09:13:34.295156+0000","last_became_active":"2024-09-21T09:13:19.159646+0000","last_became_peered":"2024-09-21T09:13:19.159646+0000","last_unstale":"2024-09-21T09:13:34.295156+0000","last_undegraded":"2024-09-21T09:13:34.295156+0000","last_fullsized":"2024-09-21T09:13:34.295156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:10.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956296+0000","last_change":"2024-09-21T09:10:58.871951+0000","last_active":"2024-09-21T09:13:34.956296+0000","last_peered":"2024-09-21T09:13:34.956296+0000","last_clean":"2024-09-21T09:13:34.956296+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:13:34.956296+0000","last_undegraded":"2024-09-21T09:13:34.956296+0000","last_fullsized":"2024-09-21T09:13:34.956296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:16.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"66'7","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297543+0000","last_change":"2024-09-21T09:10:56.855073+0000","last_active":"2024-09-21T09:13:34.297543+0000","last_peered":"2024-09-21T09:13:34.297543+0000","last_clean":"2024-09-21T09:13:34.297543+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:13:34.297543+0000","last_undegraded":"2024-09-21T09:13:34.297543+0000","last_fullsized":"2024-09-21T09:13:34.297543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:43.818365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294089+0000","last_change":"2024-09-21T09:11:00.845552+0000","last_active":"2024-09-21T09:13:34.294089+0000","last_peered":"2024-09-21T09:13:34.294089+0000","last_clean":"2024-09-21T09:13:34.294089+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:13:34.294089+0000","last_undegraded":"2024-09-21T09:13:34.294089+0000","last_fullsized":"2024-09-21T09:13:34.294089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:44.841947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"71'24","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376051+0000","last_change":"2024-09-21T09:11:02.868260+0000","last_active":"2024-09-21T09:13:35.376051+0000","last_peered":"2024-09-21T09:13:35.376051+0000","last_clean":"2024-09-21T09:13:35.376051+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:13:35.376051+0000","last_undegraded":"2024-09-21T09:13:35.376051+0000","last_fullsized":"2024-09-21T09:13:35.376051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:38.299285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955882+0000","last_change":"2024-09-21T09:11:04.890815+0000","last_active":"2024-09-21T09:13:34.955882+0000","last_peered":"2024-09-21T09:13:34.955882+0000","last_clean":"2024-09-21T09:13:34.955882+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:13:34.955882+0000","last_undegraded":"2024-09-21T09:13:34.955882+0000","last_fullsized":"2024-09-21T09:13:34.955882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:26.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527522+0000","last_change":"2024-09-21T09:11:06.888148+0000","last_active":"2024-09-21T09:13:34.527522+0000","last_peered":"2024-09-21T09:13:34.527522+0000","last_clean":"2024-09-21T09:13:34.527522+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:13:34.527522+0000","last_undegraded":"2024-09-21T09:13:34.527522+0000","last_fullsized":"2024-09-21T09:13:34.527522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296971+0000","last_change":"2024-09-21T09:10:58.871840+0000","last_active":"2024-09-21T09:13:34.296971+0000","last_peered":"2024-09-21T09:13:34.296971+0000","last_clean":"2024-09-21T09:13:34.296971+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:13:34.296971+0000","last_undegraded":"2024-09-21T09:13:34.296971+0000","last_fullsized":"2024-09-21T09:13:34.296971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"67'7","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526772+0000","last_change":"2024-09-21T09:10:56.855886+0000","last_active":"2024-09-21T09:13:34.526772+0000","last_peered":"2024-09-21T09:13:34.526772+0000","last_clean":"2024-09-21T09:13:34.526772+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:13:34.526772+0000","last_undegraded":"2024-09-21T09:13:34.526772+0000","last_fullsized":"2024-09-21T09:13:34.526772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526968+0000","last_change":"2024-09-21T09:11:00.850308+0000","last_active":"2024-09-21T09:13:34.526968+0000","last_peered":"2024-09-21T09:13:34.526968+0000","last_clean":"2024-09-21T09:13:34.526968+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:13:34.526968+0000","last_undegraded":"2024-09-21T09:13:34.526968+0000","last_fullsized":"2024-09-21T09:13:34.526968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:13.608546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"71'17","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526415+0000","last_change":"2024-09-21T09:11:02.866122+0000","last_active":"2024-09-21T09:13:35.526415+0000","last_peered":"2024-09-21T09:13:35.526415+0000","last_clean":"2024-09-21T09:13:35.526415+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:13:35.526415+0000","last_undegraded":"2024-09-21T09:13:35.526415+0000","last_fullsized":"2024-09-21T09:13:35.526415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527462+0000","last_change":"2024-09-21T09:11:04.880608+0000","last_active":"2024-09-21T09:13:34.527462+0000","last_peered":"2024-09-21T09:13:34.527462+0000","last_clean":"2024-09-21T09:13:34.527462+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:13:34.527462+0000","last_undegraded":"2024-09-21T09:13:34.527462+0000","last_fullsized":"2024-09-21T09:13:34.527462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:39.226968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955061+0000","last_change":"2024-09-21T09:11:06.892201+0000","last_active":"2024-09-21T09:13:34.955061+0000","last_peered":"2024-09-21T09:13:34.955061+0000","last_clean":"2024-09-21T09:13:34.955061+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:13:34.955061+0000","last_undegraded":"2024-09-21T09:13:34.955061+0000","last_fullsized":"2024-09-21T09:13:34.955061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:32.463353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483248+0000","last_change":"2024-09-21T09:10:58.838223+0000","last_active":"2024-09-21T09:13:34.483248+0000","last_peered":"2024-09-21T09:13:34.483248+0000","last_clean":"2024-09-21T09:13:34.483248+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:13:34.483248+0000","last_undegraded":"2024-09-21T09:13:34.483248+0000","last_fullsized":"2024-09-21T09:13:34.483248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:01.253234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"67'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482527+0000","last_change":"2024-09-21T09:10:56.841106+0000","last_active":"2024-09-21T09:13:34.482527+0000","last_peered":"2024-09-21T09:13:34.482527+0000","last_clean":"2024-09-21T09:13:34.482527+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:13:34.482527+0000","last_undegraded":"2024-09-21T09:13:34.482527+0000","last_fullsized":"2024-09-21T09:13:34.482527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:40.827746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956508+0000","last_change":"2024-09-21T09:11:00.841164+0000","last_active":"2024-09-21T09:13:34.956508+0000","last_peered":"2024-09-21T09:13:34.956508+0000","last_clean":"2024-09-21T09:13:34.956508+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:13:34.956508+0000","last_undegraded":"2024-09-21T09:13:34.956508+0000","last_fullsized":"2024-09-21T09:13:34.956508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:05.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"71'23","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957641+0000","last_change":"2024-09-21T09:11:02.852292+0000","last_active":"2024-09-21T09:13:34.957641+0000","last_peered":"2024-09-21T09:13:34.957641+0000","last_clean":"2024-09-21T09:13:34.957641+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:13:34.957641+0000","last_undegraded":"2024-09-21T09:13:34.957641+0000","last_fullsized":"2024-09-21T09:13:34.957641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:12.322229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"91'102","reported_seq":297,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042645+0000","last_change":"2024-09-21T09:11:04.892391+0000","last_active":"2024-09-21T09:13:36.042645+0000","last_peered":"2024-09-21T09:13:36.042645+0000","last_clean":"2024-09-21T09:13:36.042645+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:13:36.042645+0000","last_undegraded":"2024-09-21T09:13:36.042645+0000","last_fullsized":"2024-09-21T09:13:36.042645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:52.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293567+0000","last_change":"2024-09-21T09:11:06.883898+0000","last_active":"2024-09-21T09:13:34.293567+0000","last_peered":"2024-09-21T09:13:34.293567+0000","last_clean":"2024-09-21T09:13:34.293567+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:13:34.293567+0000","last_undegraded":"2024-09-21T09:13:34.293567+0000","last_fullsized":"2024-09-21T09:13:34.293567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298809+0000","last_change":"2024-09-21T09:13:20.217794+0000","last_active":"2024-09-21T09:13:34.298809+0000","last_peered":"2024-09-21T09:13:34.298809+0000","last_clean":"2024-09-21T09:13:34.298809+0000","last_became_active":"2024-09-21T09:13:19.161819+0000","last_became_peered":"2024-09-21T09:13:19.161819+0000","last_unstale":"2024-09-21T09:13:34.298809+0000","last_undegraded":"2024-09-21T09:13:34.298809+0000","last_fullsized":"2024-09-21T09:13:34.298809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:41.176970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"67'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482438+0000","last_change":"2024-09-21T09:10:56.844590+0000","last_active":"2024-09-21T09:13:34.482438+0000","last_peered":"2024-09-21T09:13:34.482438+0000","last_clean":"2024-09-21T09:13:34.482438+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:13:34.482438+0000","last_undegraded":"2024-09-21T09:13:34.482438+0000","last_fullsized":"2024-09-21T09:13:34.482438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:20.839825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":268,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528244+0000","last_change":"2024-09-21T09:11:00.839056+0000","last_active":"2024-09-21T09:13:35.528244+0000","last_peered":"2024-09-21T09:13:35.528244+0000","last_clean":"2024-09-21T09:13:35.528244+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:13:35.528244+0000","last_undegraded":"2024-09-21T09:13:35.528244+0000","last_fullsized":"2024-09-21T09:13:35.528244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:07.991734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"65'11","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294566+0000","last_change":"2024-09-21T09:11:02.876439+0000","last_active":"2024-09-21T09:13:34.294566+0000","last_peered":"2024-09-21T09:13:34.294566+0000","last_clean":"2024-09-21T09:13:34.294566+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:13:34.294566+0000","last_undegraded":"2024-09-21T09:13:34.294566+0000","last_fullsized":"2024-09-21T09:13:34.294566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"91'102","reported_seq":311,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042974+0000","last_change":"2024-09-21T09:11:04.884790+0000","last_active":"2024-09-21T09:13:36.042974+0000","last_peered":"2024-09-21T09:13:36.042974+0000","last_clean":"2024-09-21T09:13:36.042974+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:13:36.042974+0000","last_undegraded":"2024-09-21T09:13:36.042974+0000","last_fullsized":"2024-09-21T09:13:36.042974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:00.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294059+0000","last_change":"2024-09-21T09:13:19.158996+0000","last_active":"2024-09-21T09:13:34.294059+0000","last_peered":"2024-09-21T09:13:34.294059+0000","last_clean":"2024-09-21T09:13:34.294059+0000","last_became_active":"2024-09-21T09:13:19.139533+0000","last_became_peered":"2024-09-21T09:13:19.139533+0000","last_unstale":"2024-09-21T09:13:34.294059+0000","last_undegraded":"2024-09-21T09:13:34.294059+0000","last_fullsized":"2024-09-21T09:13:34.294059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:03.695046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527899+0000","last_change":"2024-09-21T09:10:58.873730+0000","last_active":"2024-09-21T09:13:34.527899+0000","last_peered":"2024-09-21T09:13:34.527899+0000","last_clean":"2024-09-21T09:13:34.527899+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:13:34.527899+0000","last_undegraded":"2024-09-21T09:13:34.527899+0000","last_fullsized":"2024-09-21T09:13:34.527899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"67'2","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377281+0000","last_change":"2024-09-21T09:10:56.849104+0000","last_active":"2024-09-21T09:13:35.377281+0000","last_peered":"2024-09-21T09:13:35.377281+0000","last_clean":"2024-09-21T09:13:35.377281+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:13:35.377281+0000","last_undegraded":"2024-09-21T09:13:35.377281+0000","last_fullsized":"2024-09-21T09:13:35.377281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:34.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483039+0000","last_change":"2024-09-21T09:11:00.841893+0000","last_active":"2024-09-21T09:13:34.483039+0000","last_peered":"2024-09-21T09:13:34.483039+0000","last_clean":"2024-09-21T09:13:34.483039+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:13:34.483039+0000","last_undegraded":"2024-09-21T09:13:34.483039+0000","last_fullsized":"2024-09-21T09:13:34.483039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:55.253483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"71'23","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528948+0000","last_change":"2024-09-21T09:11:02.867833+0000","last_active":"2024-09-21T09:13:35.528948+0000","last_peered":"2024-09-21T09:13:35.528948+0000","last_clean":"2024-09-21T09:13:35.528948+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:13:35.528948+0000","last_undegraded":"2024-09-21T09:13:35.528948+0000","last_fullsized":"2024-09-21T09:13:35.528948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298750+0000","last_change":"2024-09-21T09:13:19.166139+0000","last_active":"2024-09-21T09:13:34.298750+0000","last_peered":"2024-09-21T09:13:34.298750+0000","last_clean":"2024-09-21T09:13:34.298750+0000","last_became_active":"2024-09-21T09:13:19.164969+0000","last_became_peered":"2024-09-21T09:13:19.164969+0000","last_unstale":"2024-09-21T09:13:34.298750+0000","last_undegraded":"2024-09-21T09:13:34.298750+0000","last_fullsized":"2024-09-21T09:13:34.298750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:05.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"62'12","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526114+0000","last_change":"2024-09-21T09:11:06.883751+0000","last_active":"2024-09-21T09:13:34.526114+0000","last_peered":"2024-09-21T09:13:34.526114+0000","last_clean":"2024-09-21T09:13:34.526114+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:13:34.526114+0000","last_undegraded":"2024-09-21T09:13:34.526114+0000","last_fullsized":"2024-09-21T09:13:34.526114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:09.296705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482855+0000","last_change":"2024-09-21T09:10:58.838888+0000","last_active":"2024-09-21T09:13:34.482855+0000","last_peered":"2024-09-21T09:13:34.482855+0000","last_clean":"2024-09-21T09:13:34.482855+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:13:34.482855+0000","last_undegraded":"2024-09-21T09:13:34.482855+0000","last_fullsized":"2024-09-21T09:13:34.482855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:53.547541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":304,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527650+0000","last_change":"2024-09-21T09:10:44.726458+0000","last_active":"2024-09-21T09:13:35.527650+0000","last_peered":"2024-09-21T09:13:35.527650+0000","last_clean":"2024-09-21T09:13:35.527650+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:13:35.527650+0000","last_undegraded":"2024-09-21T09:13:35.527650+0000","last_fullsized":"2024-09-21T09:13:35.527650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_clean_scrub_stamp":"2024-09-21T09:10:43.702491+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:07.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482574+0000","last_change":"2024-09-21T09:13:20.381044+0000","last_active":"2024-09-21T09:13:34.482574+0000","last_peered":"2024-09-21T09:13:34.482574+0000","last_clean":"2024-09-21T09:13:34.482574+0000","last_became_active":"2024-09-21T09:13:19.155065+0000","last_became_peered":"2024-09-21T09:13:19.155065+0000","last_unstale":"2024-09-21T09:13:34.482574+0000","last_undegraded":"2024-09-21T09:13:34.482574+0000","last_fullsized":"2024-09-21T09:13:34.482574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:51.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":204,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375084+0000","last_change":"2024-09-21T09:13:19.483993+0000","last_active":"2024-09-21T09:13:35.375084+0000","last_peered":"2024-09-21T09:13:35.375084+0000","last_clean":"2024-09-21T09:13:35.375084+0000","last_became_active":"2024-09-21T09:13:19.152677+0000","last_became_peered":"2024-09-21T09:13:19.152677+0000","last_unstale":"2024-09-21T09:13:35.375084+0000","last_undegraded":"2024-09-21T09:13:35.375084+0000","last_fullsized":"2024-09-21T09:13:35.375084+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:26.411630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:11:00.845448+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"71'33","reported_seq":175,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483133+0000","last_change":"2024-09-21T09:11:02.863275+0000","last_active":"2024-09-21T09:13:34.483133+0000","last_peered":"2024-09-21T09:13:34.483133+0000","last_clean":"2024-09-21T09:13:34.483133+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:13:34.483133+0000","last_undegraded":"2024-09-21T09:13:34.483133+0000","last_fullsized":"2024-09-21T09:13:34.483133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:39.968749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4873,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957584+0000","last_change":"2024-09-21T09:11:04.894538+0000","last_active":"2024-09-21T09:13:34.957584+0000","last_peered":"2024-09-21T09:13:34.957584+0000","last_clean":"2024-09-21T09:13:34.957584+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:13:34.957584+0000","last_undegraded":"2024-09-21T09:13:34.957584+0000","last_fullsized":"2024-09-21T09:13:34.957584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.154030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"71'6","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294223+0000","last_change":"2024-09-21T09:13:19.487021+0000","last_active":"2024-09-21T09:13:34.294223+0000","last_peered":"2024-09-21T09:13:34.294223+0000","last_clean":"2024-09-21T09:13:34.294223+0000","last_became_active":"2024-09-21T09:13:19.153438+0000","last_became_peered":"2024-09-21T09:13:19.153438+0000","last_unstale":"2024-09-21T09:13:34.294223+0000","last_undegraded":"2024-09-21T09:13:34.294223+0000","last_fullsized":"2024-09-21T09:13:34.294223+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:22.759172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":422,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957786+0000","last_change":"2024-09-21T09:10:58.855489+0000","last_active":"2024-09-21T09:13:34.957786+0000","last_peered":"2024-09-21T09:13:34.957786+0000","last_clean":"2024-09-21T09:13:34.957786+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:13:34.957786+0000","last_undegraded":"2024-09-21T09:13:34.957786+0000","last_fullsized":"2024-09-21T09:13:34.957786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:04.859633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482280+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:13:34.482280+0000","last_peered":"2024-09-21T09:13:34.482280+0000","last_clean":"2024-09-21T09:13:34.482280+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:13:34.482280+0000","last_undegraded":"2024-09-21T09:13:34.482280+0000","last_fullsized":"2024-09-21T09:13:34.482280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:09.405380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"66'7","reported_seq":188,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294349+0000","last_change":"2024-09-21T09:13:19.304956+0000","last_active":"2024-09-21T09:13:34.294349+0000","last_peered":"2024-09-21T09:13:34.294349+0000","last_clean":"2024-09-21T09:13:34.294349+0000","last_became_active":"2024-09-21T09:13:19.142666+0000","last_became_peered":"2024-09-21T09:13:19.142666+0000","last_unstale":"2024-09-21T09:13:34.294349+0000","last_undegraded":"2024-09-21T09:13:34.294349+0000","last_fullsized":"2024-09-21T09:13:34.294349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:08.103741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483007+0000","last_change":"2024-09-21T09:11:00.845917+0000","last_active":"2024-09-21T09:13:34.483007+0000","last_peered":"2024-09-21T09:13:34.483007+0000","last_clean":"2024-09-21T09:13:34.483007+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:13:34.483007+0000","last_undegraded":"2024-09-21T09:13:34.483007+0000","last_fullsized":"2024-09-21T09:13:34.483007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:59.152254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"91'109","reported_seq":320,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042404+0000","last_change":"2024-09-21T09:11:02.871422+0000","last_active":"2024-09-21T09:13:36.042404+0000","last_peered":"2024-09-21T09:13:36.042404+0000","last_clean":"2024-09-21T09:13:36.042404+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:13:36.042404+0000","last_undegraded":"2024-09-21T09:13:36.042404+0000","last_fullsized":"2024-09-21T09:13:36.042404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:57.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61997,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":28,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483210+0000","last_change":"2024-09-21T09:11:04.893734+0000","last_active":"2024-09-21T09:13:34.483210+0000","last_peered":"2024-09-21T09:13:34.483210+0000","last_clean":"2024-09-21T09:13:34.483210+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:34.483210+0000","last_undegraded":"2024-09-21T09:13:34.483210+0000","last_fullsized":"2024-09-21T09:13:34.483210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.709917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"58'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955754+0000","last_change":"2024-09-21T09:11:06.895362+0000","last_active":"2024-09-21T09:13:34.955754+0000","last_peered":"2024-09-21T09:13:34.955754+0000","last_clean":"2024-09-21T09:13:34.955754+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:13:34.955754+0000","last_undegraded":"2024-09-21T09:13:34.955754+0000","last_fullsized":"2024-09-21T09:13:34.955754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:23.606134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:10:58.831552+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526089+0000","last_change":"2024-09-21T09:10:51.587265+0000","last_active":"2024-09-21T09:13:34.526089+0000","last_peered":"2024-09-21T09:13:34.526089+0000","last_clean":"2024-09-21T09:13:34.526089+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:13:34.526089+0000","last_undegraded":"2024-09-21T09:13:34.526089+0000","last_fullsized":"2024-09-21T09:13:34.526089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"66'11","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955635+0000","last_change":"2024-09-21T09:10:56.866005+0000","last_active":"2024-09-21T09:13:34.955635+0000","last_peered":"2024-09-21T09:13:34.955635+0000","last_clean":"2024-09-21T09:13:34.955635+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:13:34.955635+0000","last_undegraded":"2024-09-21T09:13:34.955635+0000","last_fullsized":"2024-09-21T09:13:34.955635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527710+0000","last_change":"2024-09-21T09:11:00.850206+0000","last_active":"2024-09-21T09:13:34.527710+0000","last_peered":"2024-09-21T09:13:34.527710+0000","last_clean":"2024-09-21T09:13:34.527710+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:13:34.527710+0000","last_undegraded":"2024-09-21T09:13:34.527710+0000","last_fullsized":"2024-09-21T09:13:34.527710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:26.137691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"91'16","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042418+0000","last_change":"2024-09-21T09:11:02.873117+0000","last_active":"2024-09-21T09:13:36.042418+0000","last_peered":"2024-09-21T09:13:36.042418+0000","last_clean":"2024-09-21T09:13:36.042418+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:13:36.042418+0000","last_undegraded":"2024-09-21T09:13:36.042418+0000","last_fullsized":"2024-09-21T09:13:36.042418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376851+0000","last_change":"2024-09-21T09:11:04.873369+0000","last_active":"2024-09-21T09:13:35.376851+0000","last_peered":"2024-09-21T09:13:35.376851+0000","last_clean":"2024-09-21T09:13:35.376851+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:13:35.376851+0000","last_undegraded":"2024-09-21T09:13:35.376851+0000","last_fullsized":"2024-09-21T09:13:35.376851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.868816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375992+0000","last_change":"2024-09-21T09:11:06.896298+0000","last_active":"2024-09-21T09:13:35.375992+0000","last_peered":"2024-09-21T09:13:35.375992+0000","last_clean":"2024-09-21T09:13:35.375992+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:13:35.375992+0000","last_undegraded":"2024-09-21T09:13:35.375992+0000","last_fullsized":"2024-09-21T09:13:35.375992+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:42.784843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"58'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:58.838558+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482642+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:13:34.482642+0000","last_peered":"2024-09-21T09:13:34.482642+0000","last_clean":"2024-09-21T09:13:34.482642+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:13:34.482642+0000","last_undegraded":"2024-09-21T09:13:34.482642+0000","last_fullsized":"2024-09-21T09:13:34.482642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:07.894252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"66'7","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296736+0000","last_change":"2024-09-21T09:13:20.378657+0000","last_active":"2024-09-21T09:13:34.296736+0000","last_peered":"2024-09-21T09:13:34.296736+0000","last_clean":"2024-09-21T09:13:34.296736+0000","last_became_active":"2024-09-21T09:13:19.153710+0000","last_became_peered":"2024-09-21T09:13:19.153710+0000","last_unstale":"2024-09-21T09:13:34.296736+0000","last_undegraded":"2024-09-21T09:13:34.296736+0000","last_fullsized":"2024-09-21T09:13:34.296736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526975+0000","last_change":"2024-09-21T09:11:00.852944+0000","last_active":"2024-09-21T09:13:34.526975+0000","last_peered":"2024-09-21T09:13:34.526975+0000","last_clean":"2024-09-21T09:13:34.526975+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:13:34.526975+0000","last_undegraded":"2024-09-21T09:13:34.526975+0000","last_fullsized":"2024-09-21T09:13:34.526975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:24.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.954874+0000","last_change":"2024-09-21T09:11:02.856485+0000","last_active":"2024-09-21T09:13:34.954874+0000","last_peered":"2024-09-21T09:13:34.954874+0000","last_clean":"2024-09-21T09:13:34.954874+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:13:34.954874+0000","last_undegraded":"2024-09-21T09:13:34.954874+0000","last_fullsized":"2024-09-21T09:13:34.954874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:05.267197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483296+0000","last_change":"2024-09-21T09:11:04.880602+0000","last_active":"2024-09-21T09:13:34.483296+0000","last_peered":"2024-09-21T09:13:34.483296+0000","last_clean":"2024-09-21T09:13:34.483296+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:13:34.483296+0000","last_undegraded":"2024-09-21T09:13:34.483296+0000","last_fullsized":"2024-09-21T09:13:34.483296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:56.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"62'4","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526697+0000","last_change":"2024-09-21T09:11:06.869065+0000","last_active":"2024-09-21T09:13:35.526697+0000","last_peered":"2024-09-21T09:13:35.526697+0000","last_clean":"2024-09-21T09:13:35.526697+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:13:35.526697+0000","last_undegraded":"2024-09-21T09:13:35.526697+0000","last_fullsized":"2024-09-21T09:13:35.526697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:28.667296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"71'12","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294295+0000","last_change":"2024-09-21T09:10:58.846835+0000","last_active":"2024-09-21T09:13:34.294295+0000","last_peered":"2024-09-21T09:13:34.294295+0000","last_clean":"2024-09-21T09:13:34.294295+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:13:34.294295+0000","last_undegraded":"2024-09-21T09:13:34.294295+0000","last_fullsized":"2024-09-21T09:13:34.294295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"66'10","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299651+0000","last_change":"2024-09-21T09:13:19.380704+0000","last_active":"2024-09-21T09:13:34.299651+0000","last_peered":"2024-09-21T09:13:34.299651+0000","last_clean":"2024-09-21T09:13:34.299651+0000","last_became_active":"2024-09-21T09:13:19.142534+0000","last_became_peered":"2024-09-21T09:13:19.142534+0000","last_unstale":"2024-09-21T09:13:34.299651+0000","last_undegraded":"2024-09-21T09:13:34.299651+0000","last_fullsized":"2024-09-21T09:13:34.299651+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957216+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:13:34.957216+0000","last_peered":"2024-09-21T09:13:34.957216+0000","last_clean":"2024-09-21T09:13:34.957216+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:13:34.957216+0000","last_undegraded":"2024-09-21T09:13:34.957216+0000","last_fullsized":"2024-09-21T09:13:34.957216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377768+0000","last_change":"2024-09-21T09:11:00.855241+0000","last_active":"2024-09-21T09:13:35.377768+0000","last_peered":"2024-09-21T09:13:35.377768+0000","last_clean":"2024-09-21T09:13:35.377768+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:13:35.377768+0000","last_undegraded":"2024-09-21T09:13:35.377768+0000","last_fullsized":"2024-09-21T09:13:35.377768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:56:14.401301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"71'30","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525679+0000","last_change":"2024-09-21T09:11:02.864623+0000","last_active":"2024-09-21T09:13:34.525679+0000","last_peered":"2024-09-21T09:13:34.525679+0000","last_clean":"2024-09-21T09:13:34.525679+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:13:34.525679+0000","last_undegraded":"2024-09-21T09:13:34.525679+0000","last_fullsized":"2024-09-21T09:13:34.525679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:12.141735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297500+0000","last_change":"2024-09-21T09:13:19.146039+0000","last_active":"2024-09-21T09:13:34.297500+0000","last_peered":"2024-09-21T09:13:34.297500+0000","last_clean":"2024-09-21T09:13:34.297500+0000","last_became_active":"2024-09-21T09:13:19.145677+0000","last_became_peered":"2024-09-21T09:13:19.145677+0000","last_unstale":"2024-09-21T09:13:34.297500+0000","last_undegraded":"2024-09-21T09:13:34.297500+0000","last_fullsized":"2024-09-21T09:13:34.297500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:04.909499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"62'4","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957412+0000","last_change":"2024-09-21T09:11:06.896833+0000","last_active":"2024-09-21T09:13:34.957412+0000","last_peered":"2024-09-21T09:13:34.957412+0000","last_clean":"2024-09-21T09:13:34.957412+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:13:34.957412+0000","last_undegraded":"2024-09-21T09:13:34.957412+0000","last_fullsized":"2024-09-21T09:13:34.957412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:38.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"61'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294846+0000","last_change":"2024-09-21T09:10:58.825808+0000","last_active":"2024-09-21T09:13:34.294846+0000","last_peered":"2024-09-21T09:13:34.294846+0000","last_clean":"2024-09-21T09:13:34.294846+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:13:34.294846+0000","last_undegraded":"2024-09-21T09:13:34.294846+0000","last_fullsized":"2024-09-21T09:13:34.294846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"67'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295613+0000","last_change":"2024-09-21T09:10:56.851643+0000","last_active":"2024-09-21T09:13:34.295613+0000","last_peered":"2024-09-21T09:13:34.295613+0000","last_clean":"2024-09-21T09:13:34.295613+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:13:34.295613+0000","last_undegraded":"2024-09-21T09:13:34.295613+0000","last_fullsized":"2024-09-21T09:13:34.295613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482740+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:13:34.482740+0000","last_peered":"2024-09-21T09:13:34.482740+0000","last_clean":"2024-09-21T09:13:34.482740+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:13:34.482740+0000","last_undegraded":"2024-09-21T09:13:34.482740+0000","last_fullsized":"2024-09-21T09:13:34.482740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:24.356684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295776+0000","last_change":"2024-09-21T09:11:00.847115+0000","last_active":"2024-09-21T09:13:34.295776+0000","last_peered":"2024-09-21T09:13:34.295776+0000","last_clean":"2024-09-21T09:13:34.295776+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:13:34.295776+0000","last_undegraded":"2024-09-21T09:13:34.295776+0000","last_fullsized":"2024-09-21T09:13:34.295776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:55.012417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293962+0000","last_change":"2024-09-21T09:11:02.862921+0000","last_active":"2024-09-21T09:13:34.293962+0000","last_peered":"2024-09-21T09:13:34.293962+0000","last_clean":"2024-09-21T09:13:34.293962+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:13:34.293962+0000","last_undegraded":"2024-09-21T09:13:34.293962+0000","last_fullsized":"2024-09-21T09:13:34.293962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"91'102","reported_seq":263,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042964+0000","last_change":"2024-09-21T09:11:04.894220+0000","last_active":"2024-09-21T09:13:36.042964+0000","last_peered":"2024-09-21T09:13:36.042964+0000","last_clean":"2024-09-21T09:13:36.042964+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:13:36.042964+0000","last_undegraded":"2024-09-21T09:13:36.042964+0000","last_fullsized":"2024-09-21T09:13:36.042964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:07.285264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527292+0000","last_change":"2024-09-21T09:11:06.881113+0000","last_active":"2024-09-21T09:13:34.527292+0000","last_peered":"2024-09-21T09:13:34.527292+0000","last_clean":"2024-09-21T09:13:34.527292+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:13:34.527292+0000","last_undegraded":"2024-09-21T09:13:34.527292+0000","last_fullsized":"2024-09-21T09:13:34.527292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376991+0000","last_change":"2024-09-21T09:10:58.868894+0000","last_active":"2024-09-21T09:13:35.376991+0000","last_peered":"2024-09-21T09:13:35.376991+0000","last_clean":"2024-09-21T09:13:35.376991+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:13:35.376991+0000","last_undegraded":"2024-09-21T09:13:35.376991+0000","last_fullsized":"2024-09-21T09:13:35.376991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:41.448227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"66'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378658+0000","last_change":"2024-09-21T09:10:56.853201+0000","last_active":"2024-09-21T09:13:35.378658+0000","last_peered":"2024-09-21T09:13:35.378658+0000","last_clean":"2024-09-21T09:13:35.378658+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:13:35.378658+0000","last_undegraded":"2024-09-21T09:13:35.378658+0000","last_fullsized":"2024-09-21T09:13:35.378658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:58.587669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378974+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:13:35.378974+0000","last_peered":"2024-09-21T09:13:35.378974+0000","last_clean":"2024-09-21T09:13:35.378974+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:13:35.378974+0000","last_undegraded":"2024-09-21T09:13:35.378974+0000","last_fullsized":"2024-09-21T09:13:35.378974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:03.383843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:11:00.850095+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:17.456402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"62'11","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482326+0000","last_change":"2024-09-21T09:11:02.853229+0000","last_active":"2024-09-21T09:13:34.482326+0000","last_peered":"2024-09-21T09:13:34.482326+0000","last_clean":"2024-09-21T09:13:34.482326+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:13:34.482326+0000","last_undegraded":"2024-09-21T09:13:34.482326+0000","last_fullsized":"2024-09-21T09:13:34.482326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:25.468451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"91'106","reported_seq":287,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042491+0000","last_change":"2024-09-21T09:13:22.165756+0000","last_active":"2024-09-21T09:13:36.042491+0000","last_peered":"2024-09-21T09:13:36.042491+0000","last_clean":"2024-09-21T09:13:36.042491+0000","last_became_active":"2024-09-21T09:13:22.164964+0000","last_became_peered":"2024-09-21T09:13:22.164964+0000","last_unstale":"2024-09-21T09:13:36.042491+0000","last_undegraded":"2024-09-21T09:13:36.042491+0000","last_fullsized":"2024-09-21T09:13:36.042491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:18.044791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"62'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956097+0000","last_change":"2024-09-21T09:11:06.887900+0000","last_active":"2024-09-21T09:13:34.956097+0000","last_peered":"2024-09-21T09:13:34.956097+0000","last_clean":"2024-09-21T09:13:34.956097+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:13:34.956097+0000","last_undegraded":"2024-09-21T09:13:34.956097+0000","last_fullsized":"2024-09-21T09:13:34.956097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:03.433485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297268+0000","last_change":"2024-09-21T09:13:19.160539+0000","last_active":"2024-09-21T09:13:34.297268+0000","last_peered":"2024-09-21T09:13:34.297268+0000","last_clean":"2024-09-21T09:13:34.297268+0000","last_became_active":"2024-09-21T09:13:19.158513+0000","last_became_peered":"2024-09-21T09:13:19.158513+0000","last_unstale":"2024-09-21T09:13:34.297268+0000","last_undegraded":"2024-09-21T09:13:34.297268+0000","last_fullsized":"2024-09-21T09:13:34.297268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:56.953433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"66'6","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378711+0000","last_change":"2024-09-21T09:10:56.849803+0000","last_active":"2024-09-21T09:13:35.378711+0000","last_peered":"2024-09-21T09:13:35.378711+0000","last_clean":"2024-09-21T09:13:35.378711+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:13:35.378711+0000","last_undegraded":"2024-09-21T09:13:35.378711+0000","last_fullsized":"2024-09-21T09:13:35.378711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:47.709157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483413+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:13:34.483413+0000","last_peered":"2024-09-21T09:13:34.483413+0000","last_clean":"2024-09-21T09:13:34.483413+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:13:34.483413+0000","last_undegraded":"2024-09-21T09:13:34.483413+0000","last_fullsized":"2024-09-21T09:13:34.483413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:33.465317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.374990+0000","last_change":"2024-09-21T09:13:19.154303+0000","last_active":"2024-09-21T09:13:35.374990+0000","last_peered":"2024-09-21T09:13:35.374990+0000","last_clean":"2024-09-21T09:13:35.374990+0000","last_became_active":"2024-09-21T09:13:19.152735+0000","last_became_peered":"2024-09-21T09:13:19.152735+0000","last_unstale":"2024-09-21T09:13:35.374990+0000","last_undegraded":"2024-09-21T09:13:35.374990+0000","last_fullsized":"2024-09-21T09:13:35.374990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:24.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"71'37","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295954+0000","last_change":"2024-09-21T09:11:02.856720+0000","last_active":"2024-09-21T09:13:34.295954+0000","last_peered":"2024-09-21T09:13:34.295954+0000","last_clean":"2024-09-21T09:13:34.295954+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:13:34.295954+0000","last_undegraded":"2024-09-21T09:13:34.295954+0000","last_fullsized":"2024-09-21T09:13:34.295954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376998+0000","last_change":"2024-09-21T09:11:04.872979+0000","last_active":"2024-09-21T09:13:35.376998+0000","last_peered":"2024-09-21T09:13:35.376998+0000","last_clean":"2024-09-21T09:13:35.376998+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:13:35.376998+0000","last_undegraded":"2024-09-21T09:13:35.376998+0000","last_fullsized":"2024-09-21T09:13:35.376998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:17.499450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"71'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299731+0000","last_change":"2024-09-21T09:13:19.169497+0000","last_active":"2024-09-21T09:13:34.299731+0000","last_peered":"2024-09-21T09:13:34.299731+0000","last_clean":"2024-09-21T09:13:34.299731+0000","last_became_active":"2024-09-21T09:13:19.140926+0000","last_became_peered":"2024-09-21T09:13:19.140926+0000","last_unstale":"2024-09-21T09:13:34.299731+0000","last_undegraded":"2024-09-21T09:13:34.299731+0000","last_fullsized":"2024-09-21T09:13:34.299731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:44.853024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":426,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377317+0000","last_change":"2024-09-21T09:11:06.900571+0000","last_active":"2024-09-21T09:13:35.377317+0000","last_peered":"2024-09-21T09:13:35.377317+0000","last_clean":"2024-09-21T09:13:35.377317+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:13:35.377317+0000","last_undegraded":"2024-09-21T09:13:35.377317+0000","last_fullsized":"2024-09-21T09:13:35.377317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:40.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295838+0000","last_change":"2024-09-21T09:13:19.531538+0000","last_active":"2024-09-21T09:13:34.295838+0000","last_peered":"2024-09-21T09:13:34.295838+0000","last_clean":"2024-09-21T09:13:34.295838+0000","last_became_active":"2024-09-21T09:13:19.158305+0000","last_became_peered":"2024-09-21T09:13:19.158305+0000","last_unstale":"2024-09-21T09:13:34.295838+0000","last_undegraded":"2024-09-21T09:13:34.295838+0000","last_fullsized":"2024-09-21T09:13:34.295838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:10.110896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"66'8","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482868+0000","last_change":"2024-09-21T09:13:21.278992+0000","last_active":"2024-09-21T09:13:34.482868+0000","last_peered":"2024-09-21T09:13:34.482868+0000","last_clean":"2024-09-21T09:13:34.482868+0000","last_became_active":"2024-09-21T09:13:19.168562+0000","last_became_peered":"2024-09-21T09:13:19.168562+0000","last_unstale":"2024-09-21T09:13:34.482868+0000","last_undegraded":"2024-09-21T09:13:34.482868+0000","last_fullsized":"2024-09-21T09:13:34.482868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:29.147931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294332+0000","last_change":"2024-09-21T09:11:00.839217+0000","last_active":"2024-09-21T09:13:34.294332+0000","last_peered":"2024-09-21T09:13:34.294332+0000","last_clean":"2024-09-21T09:13:34.294332+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:13:34.294332+0000","last_undegraded":"2024-09-21T09:13:34.294332+0000","last_fullsized":"2024-09-21T09:13:34.294332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:23.833810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"71'18","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293754+0000","last_change":"2024-09-21T09:11:02.872614+0000","last_active":"2024-09-21T09:13:34.293754+0000","last_peered":"2024-09-21T09:13:34.293754+0000","last_clean":"2024-09-21T09:13:34.293754+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:13:34.293754+0000","last_undegraded":"2024-09-21T09:13:34.293754+0000","last_fullsized":"2024-09-21T09:13:34.293754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525609+0000","last_change":"2024-09-21T09:11:04.882308+0000","last_active":"2024-09-21T09:13:34.525609+0000","last_peered":"2024-09-21T09:13:34.525609+0000","last_clean":"2024-09-21T09:13:34.525609+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:13:34.525609+0000","last_undegraded":"2024-09-21T09:13:34.525609+0000","last_fullsized":"2024-09-21T09:13:34.525609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:42.301147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"61'16","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527236+0000","last_change":"2024-09-21T09:11:06.892382+0000","last_active":"2024-09-21T09:13:34.527236+0000","last_peered":"2024-09-21T09:13:34.527236+0000","last_clean":"2024-09-21T09:13:34.527236+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:13:34.527236+0000","last_undegraded":"2024-09-21T09:13:34.527236+0000","last_fullsized":"2024-09-21T09:13:34.527236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:20.449346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"62'6","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376845+0000","last_change":"2024-09-21T09:10:58.869150+0000","last_active":"2024-09-21T09:13:35.376845+0000","last_peered":"2024-09-21T09:13:35.376845+0000","last_clean":"2024-09-21T09:13:35.376845+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:13:35.376845+0000","last_undegraded":"2024-09-21T09:13:35.376845+0000","last_fullsized":"2024-09-21T09:13:35.376845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:58.386210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"66'9","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298150+0000","last_change":"2024-09-21T09:10:56.854764+0000","last_active":"2024-09-21T09:13:34.298150+0000","last_peered":"2024-09-21T09:13:34.298150+0000","last_clean":"2024-09-21T09:13:34.298150+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:13:34.298150+0000","last_undegraded":"2024-09-21T09:13:34.298150+0000","last_fullsized":"2024-09-21T09:13:34.298150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376855+0000","last_change":"2024-09-21T09:11:00.839265+0000","last_active":"2024-09-21T09:13:35.376855+0000","last_peered":"2024-09-21T09:13:35.376855+0000","last_clean":"2024-09-21T09:13:35.376855+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:13:35.376855+0000","last_undegraded":"2024-09-21T09:13:35.376855+0000","last_fullsized":"2024-09-21T09:13:35.376855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:14.524942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"45'5","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375333+0000","last_change":"2024-09-21T09:13:20.848665+0000","last_active":"2024-09-21T09:13:35.375333+0000","last_peered":"2024-09-21T09:13:35.375333+0000","last_clean":"2024-09-21T09:13:35.375333+0000","last_became_active":"2024-09-21T09:13:19.154000+0000","last_became_peered":"2024-09-21T09:13:19.154000+0000","last_unstale":"2024-09-21T09:13:35.375333+0000","last_undegraded":"2024-09-21T09:13:35.375333+0000","last_fullsized":"2024-09-21T09:13:35.375333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:40.242838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297539+0000","last_change":"2024-09-21T09:13:19.160157+0000","last_active":"2024-09-21T09:13:34.297539+0000","last_peered":"2024-09-21T09:13:34.297539+0000","last_clean":"2024-09-21T09:13:34.297539+0000","last_became_active":"2024-09-21T09:13:19.157523+0000","last_became_peered":"2024-09-21T09:13:19.157523+0000","last_unstale":"2024-09-21T09:13:34.297539+0000","last_undegraded":"2024-09-21T09:13:34.297539+0000","last_fullsized":"2024-09-21T09:13:34.297539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:07.414777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294790+0000","last_change":"2024-09-21T09:11:06.879042+0000","last_active":"2024-09-21T09:13:34.294790+0000","last_peered":"2024-09-21T09:13:34.294790+0000","last_clean":"2024-09-21T09:13:34.294790+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:13:34.294790+0000","last_undegraded":"2024-09-21T09:13:34.294790+0000","last_fullsized":"2024-09-21T09:13:34.294790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:34.670949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377778+0000","last_change":"2024-09-21T09:10:58.864481+0000","last_active":"2024-09-21T09:13:35.377778+0000","last_peered":"2024-09-21T09:13:35.377778+0000","last_clean":"2024-09-21T09:13:35.377778+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:13:35.377778+0000","last_undegraded":"2024-09-21T09:13:35.377778+0000","last_fullsized":"2024-09-21T09:13:35.377778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:33.405020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"67'12","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298309+0000","last_change":"2024-09-21T09:13:20.071816+0000","last_active":"2024-09-21T09:13:34.298309+0000","last_peered":"2024-09-21T09:13:34.298309+0000","last_clean":"2024-09-21T09:13:34.298309+0000","last_became_active":"2024-09-21T09:13:19.160370+0000","last_became_peered":"2024-09-21T09:13:19.160370+0000","last_unstale":"2024-09-21T09:13:34.298309+0000","last_undegraded":"2024-09-21T09:13:34.298309+0000","last_fullsized":"2024-09-21T09:13:34.298309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:13.089799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292818+0000","last_change":"2024-09-21T09:13:19.145601+0000","last_active":"2024-09-21T09:13:34.292818+0000","last_peered":"2024-09-21T09:13:34.292818+0000","last_clean":"2024-09-21T09:13:34.292818+0000","last_became_active":"2024-09-21T09:13:19.142672+0000","last_became_peered":"2024-09-21T09:13:19.142672+0000","last_unstale":"2024-09-21T09:13:34.292818+0000","last_undegraded":"2024-09-21T09:13:34.292818+0000","last_fullsized":"2024-09-21T09:13:34.292818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.000309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"71'17","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526668+0000","last_change":"2024-09-21T09:11:02.869796+0000","last_active":"2024-09-21T09:13:34.526668+0000","last_peered":"2024-09-21T09:13:34.526668+0000","last_clean":"2024-09-21T09:13:34.526668+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:13:34.526668+0000","last_undegraded":"2024-09-21T09:13:34.526668+0000","last_fullsized":"2024-09-21T09:13:34.526668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:48.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528134+0000","last_change":"2024-09-21T09:11:04.893727+0000","last_active":"2024-09-21T09:13:35.528134+0000","last_peered":"2024-09-21T09:13:35.528134+0000","last_clean":"2024-09-21T09:13:35.528134+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:35.528134+0000","last_undegraded":"2024-09-21T09:13:35.528134+0000","last_fullsized":"2024-09-21T09:13:35.528134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:18.437905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"71'7","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482678+0000","last_change":"2024-09-21T09:13:21.128242+0000","last_active":"2024-09-21T09:13:34.482678+0000","last_peered":"2024-09-21T09:13:34.482678+0000","last_clean":"2024-09-21T09:13:34.482678+0000","last_became_active":"2024-09-21T09:13:19.167169+0000","last_became_peered":"2024-09-21T09:13:19.167169+0000","last_unstale":"2024-09-21T09:13:34.482678+0000","last_undegraded":"2024-09-21T09:13:34.482678+0000","last_fullsized":"2024-09-21T09:13:34.482678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:46.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526036+0000","last_change":"2024-09-21T09:10:58.859005+0000","last_active":"2024-09-21T09:13:34.526036+0000","last_peered":"2024-09-21T09:13:34.526036+0000","last_clean":"2024-09-21T09:13:34.526036+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:13:34.526036+0000","last_undegraded":"2024-09-21T09:13:34.526036+0000","last_fullsized":"2024-09-21T09:13:34.526036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:38.110596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"66'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958780+0000","last_change":"2024-09-21T09:10:56.860416+0000","last_active":"2024-09-21T09:13:34.958780+0000","last_peered":"2024-09-21T09:13:34.958780+0000","last_clean":"2024-09-21T09:13:34.958780+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:13:34.958780+0000","last_undegraded":"2024-09-21T09:13:34.958780+0000","last_fullsized":"2024-09-21T09:13:34.958780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:48.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482021+0000","last_change":"2024-09-21T09:13:19.153082+0000","last_active":"2024-09-21T09:13:34.482021+0000","last_peered":"2024-09-21T09:13:34.482021+0000","last_clean":"2024-09-21T09:13:34.482021+0000","last_became_active":"2024-09-21T09:13:19.152722+0000","last_became_peered":"2024-09-21T09:13:19.152722+0000","last_unstale":"2024-09-21T09:13:34.482021+0000","last_undegraded":"2024-09-21T09:13:34.482021+0000","last_fullsized":"2024-09-21T09:13:34.482021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:26.550403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"71'16","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295783+0000","last_change":"2024-09-21T09:11:02.872950+0000","last_active":"2024-09-21T09:13:34.295783+0000","last_peered":"2024-09-21T09:13:34.295783+0000","last_clean":"2024-09-21T09:13:34.295783+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:13:34.295783+0000","last_undegraded":"2024-09-21T09:13:34.295783+0000","last_fullsized":"2024-09-21T09:13:34.295783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526197+0000","last_change":"2024-09-21T09:13:19.144593+0000","last_active":"2024-09-21T09:13:34.526197+0000","last_peered":"2024-09-21T09:13:34.526197+0000","last_clean":"2024-09-21T09:13:34.526197+0000","last_became_active":"2024-09-21T09:13:19.143577+0000","last_became_peered":"2024-09-21T09:13:19.143577+0000","last_unstale":"2024-09-21T09:13:34.526197+0000","last_undegraded":"2024-09-21T09:13:34.526197+0000","last_fullsized":"2024-09-21T09:13:34.526197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:02.985464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483155+0000","last_change":"2024-09-21T09:10:58.839092+0000","last_active":"2024-09-21T09:13:34.483155+0000","last_peered":"2024-09-21T09:13:34.483155+0000","last_clean":"2024-09-21T09:13:34.483155+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:13:34.483155+0000","last_undegraded":"2024-09-21T09:13:34.483155+0000","last_fullsized":"2024-09-21T09:13:34.483155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:02.458655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"66'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956457+0000","last_change":"2024-09-21T09:10:56.865435+0000","last_active":"2024-09-21T09:13:34.956457+0000","last_peered":"2024-09-21T09:13:34.956457+0000","last_clean":"2024-09-21T09:13:34.956457+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:13:34.956457+0000","last_undegraded":"2024-09-21T09:13:34.956457+0000","last_fullsized":"2024-09-21T09:13:34.956457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295267+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.295267+0000","last_peered":"2024-09-21T09:13:34.295267+0000","last_clean":"2024-09-21T09:13:34.295267+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:13:34.295267+0000","last_undegraded":"2024-09-21T09:13:34.295267+0000","last_fullsized":"2024-09-21T09:13:34.295267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:10.134818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"71'24","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294966+0000","last_change":"2024-09-21T09:11:02.879895+0000","last_active":"2024-09-21T09:13:34.294966+0000","last_peered":"2024-09-21T09:13:34.294966+0000","last_clean":"2024-09-21T09:13:34.294966+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:13:34.294966+0000","last_undegraded":"2024-09-21T09:13:34.294966+0000","last_fullsized":"2024-09-21T09:13:34.294966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298886+0000","last_change":"2024-09-21T09:13:19.166381+0000","last_active":"2024-09-21T09:13:34.298886+0000","last_peered":"2024-09-21T09:13:34.298886+0000","last_clean":"2024-09-21T09:13:34.298886+0000","last_became_active":"2024-09-21T09:13:19.165859+0000","last_became_peered":"2024-09-21T09:13:19.165859+0000","last_unstale":"2024-09-21T09:13:34.298886+0000","last_undegraded":"2024-09-21T09:13:34.298886+0000","last_fullsized":"2024-09-21T09:13:34.298886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:20.747731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957270+0000","last_change":"2024-09-21T09:11:06.896002+0000","last_active":"2024-09-21T09:13:34.957270+0000","last_peered":"2024-09-21T09:13:34.957270+0000","last_clean":"2024-09-21T09:13:34.957270+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:13:34.957270+0000","last_undegraded":"2024-09-21T09:13:34.957270+0000","last_fullsized":"2024-09-21T09:13:34.957270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:01.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"71'10","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378657+0000","last_change":"2024-09-21T09:10:58.868892+0000","last_active":"2024-09-21T09:13:35.378657+0000","last_peered":"2024-09-21T09:13:35.378657+0000","last_clean":"2024-09-21T09:13:35.378657+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:13:35.378657+0000","last_undegraded":"2024-09-21T09:13:35.378657+0000","last_fullsized":"2024-09-21T09:13:35.378657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"66'5","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377535+0000","last_change":"2024-09-21T09:10:56.827351+0000","last_active":"2024-09-21T09:13:35.377535+0000","last_peered":"2024-09-21T09:13:35.377535+0000","last_clean":"2024-09-21T09:13:35.377535+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:13:35.377535+0000","last_undegraded":"2024-09-21T09:13:35.377535+0000","last_fullsized":"2024-09-21T09:13:35.377535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:49.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298002+0000","last_change":"2024-09-21T09:13:19.159092+0000","last_active":"2024-09-21T09:13:34.298002+0000","last_peered":"2024-09-21T09:13:34.298002+0000","last_clean":"2024-09-21T09:13:34.298002+0000","last_became_active":"2024-09-21T09:13:19.158652+0000","last_became_peered":"2024-09-21T09:13:19.158652+0000","last_unstale":"2024-09-21T09:13:34.298002+0000","last_undegraded":"2024-09-21T09:13:34.298002+0000","last_fullsized":"2024-09-21T09:13:34.298002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:32.340994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"71'22","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482767+0000","last_change":"2024-09-21T09:13:21.165572+0000","last_active":"2024-09-21T09:13:34.482767+0000","last_peered":"2024-09-21T09:13:34.482767+0000","last_clean":"2024-09-21T09:13:34.482767+0000","last_became_active":"2024-09-21T09:13:19.167344+0000","last_became_peered":"2024-09-21T09:13:19.167344+0000","last_unstale":"2024-09-21T09:13:34.482767+0000","last_undegraded":"2024-09-21T09:13:34.482767+0000","last_fullsized":"2024-09-21T09:13:34.482767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:05.930094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956457+0000","last_change":"2024-09-21T09:11:04.890782+0000","last_active":"2024-09-21T09:13:34.956457+0000","last_peered":"2024-09-21T09:13:34.956457+0000","last_clean":"2024-09-21T09:13:34.956457+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:13:34.956457+0000","last_undegraded":"2024-09-21T09:13:34.956457+0000","last_fullsized":"2024-09-21T09:13:34.956457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:42.740558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"71'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482532+0000","last_change":"2024-09-21T09:11:06.889510+0000","last_active":"2024-09-21T09:13:34.482532+0000","last_peered":"2024-09-21T09:13:34.482532+0000","last_clean":"2024-09-21T09:13:34.482532+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:13:34.482532+0000","last_undegraded":"2024-09-21T09:13:34.482532+0000","last_fullsized":"2024-09-21T09:13:34.482532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:38.377418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527248+0000","last_change":"2024-09-21T09:10:58.854750+0000","last_active":"2024-09-21T09:13:34.527248+0000","last_peered":"2024-09-21T09:13:34.527248+0000","last_clean":"2024-09-21T09:13:34.527248+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:13:34.527248+0000","last_undegraded":"2024-09-21T09:13:34.527248+0000","last_fullsized":"2024-09-21T09:13:34.527248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.559151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"67'10","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528620+0000","last_change":"2024-09-21T09:10:56.863198+0000","last_active":"2024-09-21T09:13:35.528620+0000","last_peered":"2024-09-21T09:13:35.528620+0000","last_clean":"2024-09-21T09:13:35.528620+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:13:35.528620+0000","last_undegraded":"2024-09-21T09:13:35.528620+0000","last_fullsized":"2024-09-21T09:13:35.528620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298158+0000","last_change":"2024-09-21T09:13:20.592162+0000","last_active":"2024-09-21T09:13:34.298158+0000","last_peered":"2024-09-21T09:13:34.298158+0000","last_clean":"2024-09-21T09:13:34.298158+0000","last_became_active":"2024-09-21T09:13:19.165929+0000","last_became_peered":"2024-09-21T09:13:19.165929+0000","last_unstale":"2024-09-21T09:13:34.298158+0000","last_undegraded":"2024-09-21T09:13:34.298158+0000","last_fullsized":"2024-09-21T09:13:34.298158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:41.372526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"71'17","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295570+0000","last_change":"2024-09-21T09:11:02.879188+0000","last_active":"2024-09-21T09:13:34.295570+0000","last_peered":"2024-09-21T09:13:34.295570+0000","last_clean":"2024-09-21T09:13:34.295570+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:13:34.295570+0000","last_undegraded":"2024-09-21T09:13:34.295570+0000","last_fullsized":"2024-09-21T09:13:34.295570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:37.208901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527107+0000","last_change":"2024-09-21T09:11:04.880786+0000","last_active":"2024-09-21T09:13:34.527107+0000","last_peered":"2024-09-21T09:13:34.527107+0000","last_clean":"2024-09-21T09:13:34.527107+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:13:34.527107+0000","last_undegraded":"2024-09-21T09:13:34.527107+0000","last_fullsized":"2024-09-21T09:13:34.527107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:54.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"62'10","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481914+0000","last_change":"2024-09-21T09:11:06.898517+0000","last_active":"2024-09-21T09:13:34.481914+0000","last_peered":"2024-09-21T09:13:34.481914+0000","last_clean":"2024-09-21T09:13:34.481914+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:13:34.481914+0000","last_undegraded":"2024-09-21T09:13:34.481914+0000","last_fullsized":"2024-09-21T09:13:34.481914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:46.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":39,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377669+0000","last_change":"2024-09-21T09:10:58.868807+0000","last_active":"2024-09-21T09:13:35.377669+0000","last_peered":"2024-09-21T09:13:35.377669+0000","last_clean":"2024-09-21T09:13:35.377669+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:13:35.377669+0000","last_undegraded":"2024-09-21T09:13:35.377669+0000","last_fullsized":"2024-09-21T09:13:35.377669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.574650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"67'12","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378764+0000","last_change":"2024-09-21T09:10:56.851205+0000","last_active":"2024-09-21T09:13:35.378764+0000","last_peered":"2024-09-21T09:13:35.378764+0000","last_clean":"2024-09-21T09:13:35.378764+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:13:35.378764+0000","last_undegraded":"2024-09-21T09:13:35.378764+0000","last_fullsized":"2024-09-21T09:13:35.378764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:52.423650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377224+0000","last_change":"2024-09-21T09:11:00.856830+0000","last_active":"2024-09-21T09:13:35.377224+0000","last_peered":"2024-09-21T09:13:35.377224+0000","last_clean":"2024-09-21T09:13:35.377224+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:13:35.377224+0000","last_undegraded":"2024-09-21T09:13:35.377224+0000","last_fullsized":"2024-09-21T09:13:35.377224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:45.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"74'14","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483000+0000","last_change":"2024-09-21T09:13:21.153990+0000","last_active":"2024-09-21T09:13:34.483000+0000","last_peered":"2024-09-21T09:13:34.483000+0000","last_clean":"2024-09-21T09:13:34.483000+0000","last_became_active":"2024-09-21T09:13:19.167321+0000","last_became_peered":"2024-09-21T09:13:19.167321+0000","last_unstale":"2024-09-21T09:13:34.483000+0000","last_undegraded":"2024-09-21T09:13:34.483000+0000","last_fullsized":"2024-09-21T09:13:34.483000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:34.649177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"91'102","reported_seq":271,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042397+0000","last_change":"2024-09-21T09:11:04.870463+0000","last_active":"2024-09-21T09:13:36.042397+0000","last_peered":"2024-09-21T09:13:36.042397+0000","last_clean":"2024-09-21T09:13:36.042397+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:13:36.042397+0000","last_undegraded":"2024-09-21T09:13:36.042397+0000","last_fullsized":"2024-09-21T09:13:36.042397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:30.495090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"58'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481854+0000","last_change":"2024-09-21T09:11:06.883550+0000","last_active":"2024-09-21T09:13:34.481854+0000","last_peered":"2024-09-21T09:13:34.481854+0000","last_clean":"2024-09-21T09:13:34.481854+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:13:34.481854+0000","last_undegraded":"2024-09-21T09:13:34.481854+0000","last_fullsized":"2024-09-21T09:13:34.481854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:56.825424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"71'10","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296041+0000","last_change":"2024-09-21T09:13:19.537524+0000","last_active":"2024-09-21T09:13:34.296041+0000","last_peered":"2024-09-21T09:13:34.296041+0000","last_clean":"2024-09-21T09:13:34.296041+0000","last_became_active":"2024-09-21T09:13:19.159904+0000","last_became_peered":"2024-09-21T09:13:19.159904+0000","last_unstale":"2024-09-21T09:13:34.296041+0000","last_undegraded":"2024-09-21T09:13:34.296041+0000","last_fullsized":"2024-09-21T09:13:34.296041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:12.531734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"67'12","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529250+0000","last_change":"2024-09-21T09:10:56.852586+0000","last_active":"2024-09-21T09:13:35.529250+0000","last_peered":"2024-09-21T09:13:35.529250+0000","last_clean":"2024-09-21T09:13:35.529250+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:13:35.529250+0000","last_undegraded":"2024-09-21T09:13:35.529250+0000","last_fullsized":"2024-09-21T09:13:35.529250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528271+0000","last_change":"2024-09-21T09:11:00.839800+0000","last_active":"2024-09-21T09:13:35.528271+0000","last_peered":"2024-09-21T09:13:35.528271+0000","last_clean":"2024-09-21T09:13:35.528271+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:13:35.528271+0000","last_undegraded":"2024-09-21T09:13:35.528271+0000","last_fullsized":"2024-09-21T09:13:35.528271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:21.140377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"71'22","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293383+0000","last_change":"2024-09-21T09:11:02.857087+0000","last_active":"2024-09-21T09:13:34.293383+0000","last_peered":"2024-09-21T09:13:34.293383+0000","last_clean":"2024-09-21T09:13:34.293383+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:13:34.293383+0000","last_undegraded":"2024-09-21T09:13:34.293383+0000","last_fullsized":"2024-09-21T09:13:34.293383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376271+0000","last_change":"2024-09-21T09:11:04.872303+0000","last_active":"2024-09-21T09:13:35.376271+0000","last_peered":"2024-09-21T09:13:35.376271+0000","last_clean":"2024-09-21T09:13:35.376271+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:13:35.376271+0000","last_undegraded":"2024-09-21T09:13:35.376271+0000","last_fullsized":"2024-09-21T09:13:35.376271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.517451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"71'10","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527841+0000","last_change":"2024-09-21T09:11:06.873636+0000","last_active":"2024-09-21T09:13:35.527841+0000","last_peered":"2024-09-21T09:13:35.527841+0000","last_clean":"2024-09-21T09:13:35.527841+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:13:35.527841+0000","last_undegraded":"2024-09-21T09:13:35.527841+0000","last_fullsized":"2024-09-21T09:13:35.527841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:52.693664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293210+0000","last_change":"2024-09-21T09:13:19.144377+0000","last_active":"2024-09-21T09:13:34.293210+0000","last_peered":"2024-09-21T09:13:34.293210+0000","last_clean":"2024-09-21T09:13:34.293210+0000","last_became_active":"2024-09-21T09:13:19.143746+0000","last_became_peered":"2024-09-21T09:13:19.143746+0000","last_unstale":"2024-09-21T09:13:34.293210+0000","last_undegraded":"2024-09-21T09:13:34.293210+0000","last_fullsized":"2024-09-21T09:13:34.293210+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:48.781954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"67'15","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482960+0000","last_change":"2024-09-21T09:11:34.170912+0000","last_active":"2024-09-21T09:13:34.482960+0000","last_peered":"2024-09-21T09:13:34.482960+0000","last_clean":"2024-09-21T09:13:34.482960+0000","last_became_active":"2024-09-21T09:11:34.170599+0000","last_became_peered":"2024-09-21T09:11:34.170599+0000","last_unstale":"2024-09-21T09:13:34.482960+0000","last_undegraded":"2024-09-21T09:13:34.482960+0000","last_fullsized":"2024-09-21T09:13:34.482960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296362+0000","last_change":"2024-09-21T09:13:19.144365+0000","last_active":"2024-09-21T09:13:34.296362+0000","last_peered":"2024-09-21T09:13:34.296362+0000","last_clean":"2024-09-21T09:13:34.296362+0000","last_became_active":"2024-09-21T09:13:19.141404+0000","last_became_peered":"2024-09-21T09:13:19.141404+0000","last_unstale":"2024-09-21T09:13:34.296362+0000","last_undegraded":"2024-09-21T09:13:34.296362+0000","last_fullsized":"2024-09-21T09:13:34.296362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:05.438476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"71'16","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376621+0000","last_change":"2024-09-21T09:11:02.847926+0000","last_active":"2024-09-21T09:13:35.376621+0000","last_peered":"2024-09-21T09:13:35.376621+0000","last_clean":"2024-09-21T09:13:35.376621+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:13:35.376621+0000","last_undegraded":"2024-09-21T09:13:35.376621+0000","last_fullsized":"2024-09-21T09:13:35.376621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:15.592269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482045+0000","last_change":"2024-09-21T09:11:04.880866+0000","last_active":"2024-09-21T09:13:34.482045+0000","last_peered":"2024-09-21T09:13:34.482045+0000","last_clean":"2024-09-21T09:13:34.482045+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:13:34.482045+0000","last_undegraded":"2024-09-21T09:13:34.482045+0000","last_fullsized":"2024-09-21T09:13:34.482045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:02.568576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957411+0000","last_change":"2024-09-21T09:11:06.899493+0000","last_active":"2024-09-21T09:13:34.957411+0000","last_peered":"2024-09-21T09:13:34.957411+0000","last_clean":"2024-09-21T09:13:34.957411+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:13:34.957411+0000","last_undegraded":"2024-09-21T09:13:34.957411+0000","last_fullsized":"2024-09-21T09:13:34.957411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:50.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525954+0000","last_change":"2024-09-21T09:10:58.856310+0000","last_active":"2024-09-21T09:13:34.525954+0000","last_peered":"2024-09-21T09:13:34.525954+0000","last_clean":"2024-09-21T09:13:34.525954+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:13:34.525954+0000","last_undegraded":"2024-09-21T09:13:34.525954+0000","last_fullsized":"2024-09-21T09:13:34.525954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:12.549438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"66'11","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958076+0000","last_change":"2024-09-21T09:13:20.628384+0000","last_active":"2024-09-21T09:13:34.958076+0000","last_peered":"2024-09-21T09:13:34.958076+0000","last_clean":"2024-09-21T09:13:34.958076+0000","last_became_active":"2024-09-21T09:13:19.169569+0000","last_became_peered":"2024-09-21T09:13:19.169569+0000","last_unstale":"2024-09-21T09:13:34.958076+0000","last_undegraded":"2024-09-21T09:13:34.958076+0000","last_fullsized":"2024-09-21T09:13:34.958076+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:00.389819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526949+0000","last_change":"2024-09-21T09:11:00.837141+0000","last_active":"2024-09-21T09:13:35.526949+0000","last_peered":"2024-09-21T09:13:35.526949+0000","last_clean":"2024-09-21T09:13:35.526949+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:13:35.526949+0000","last_undegraded":"2024-09-21T09:13:35.526949+0000","last_fullsized":"2024-09-21T09:13:35.526949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"71'11","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294478+0000","last_change":"2024-09-21T09:13:20.076515+0000","last_active":"2024-09-21T09:13:34.294478+0000","last_peered":"2024-09-21T09:13:34.294478+0000","last_clean":"2024-09-21T09:13:34.294478+0000","last_became_active":"2024-09-21T09:13:19.150207+0000","last_became_peered":"2024-09-21T09:13:19.150207+0000","last_unstale":"2024-09-21T09:13:34.294478+0000","last_undegraded":"2024-09-21T09:13:34.294478+0000","last_fullsized":"2024-09-21T09:13:34.294478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482052+0000","last_change":"2024-09-21T09:11:04.887172+0000","last_active":"2024-09-21T09:13:34.482052+0000","last_peered":"2024-09-21T09:13:34.482052+0000","last_clean":"2024-09-21T09:13:34.482052+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:13:34.482052+0000","last_undegraded":"2024-09-21T09:13:34.482052+0000","last_fullsized":"2024-09-21T09:13:34.482052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:01.250555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482536+0000","last_change":"2024-09-21T09:13:19.157682+0000","last_active":"2024-09-21T09:13:34.482536+0000","last_peered":"2024-09-21T09:13:34.482536+0000","last_clean":"2024-09-21T09:13:34.482536+0000","last_became_active":"2024-09-21T09:13:19.157306+0000","last_became_peered":"2024-09-21T09:13:19.157306+0000","last_unstale":"2024-09-21T09:13:34.482536+0000","last_undegraded":"2024-09-21T09:13:34.482536+0000","last_fullsized":"2024-09-21T09:13:34.482536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.786122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292810+0000","last_change":"2024-09-21T09:13:19.713138+0000","last_active":"2024-09-21T09:13:34.292810+0000","last_peered":"2024-09-21T09:13:34.292810+0000","last_clean":"2024-09-21T09:13:34.292810+0000","last_became_active":"2024-09-21T09:13:19.161496+0000","last_became_peered":"2024-09-21T09:13:19.161496+0000","last_unstale":"2024-09-21T09:13:34.292810+0000","last_undegraded":"2024-09-21T09:13:34.292810+0000","last_fullsized":"2024-09-21T09:13:34.292810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:42.440821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958517+0000","last_change":"2024-09-21T09:10:56.861373+0000","last_active":"2024-09-21T09:13:34.958517+0000","last_peered":"2024-09-21T09:13:34.958517+0000","last_clean":"2024-09-21T09:13:34.958517+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:13:34.958517+0000","last_undegraded":"2024-09-21T09:13:34.958517+0000","last_fullsized":"2024-09-21T09:13:34.958517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:45.846021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376270+0000","last_change":"2024-09-21T09:11:00.838647+0000","last_active":"2024-09-21T09:13:35.376270+0000","last_peered":"2024-09-21T09:13:35.376270+0000","last_clean":"2024-09-21T09:13:35.376270+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:13:35.376270+0000","last_undegraded":"2024-09-21T09:13:35.376270+0000","last_fullsized":"2024-09-21T09:13:35.376270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:16.279789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"71'17","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482115+0000","last_change":"2024-09-21T09:11:02.877357+0000","last_active":"2024-09-21T09:13:34.482115+0000","last_peered":"2024-09-21T09:13:34.482115+0000","last_clean":"2024-09-21T09:13:34.482115+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:13:34.482115+0000","last_undegraded":"2024-09-21T09:13:34.482115+0000","last_fullsized":"2024-09-21T09:13:34.482115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:46.845302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67351,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378889+0000","last_change":"2024-09-21T09:11:04.896698+0000","last_active":"2024-09-21T09:13:35.378889+0000","last_peered":"2024-09-21T09:13:35.378889+0000","last_clean":"2024-09-21T09:13:35.378889+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:13:35.378889+0000","last_undegraded":"2024-09-21T09:13:35.378889+0000","last_fullsized":"2024-09-21T09:13:35.378889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:59.924890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297318+0000","last_change":"2024-09-21T09:13:20.646926+0000","last_active":"2024-09-21T09:13:34.297318+0000","last_peered":"2024-09-21T09:13:34.297318+0000","last_clean":"2024-09-21T09:13:34.297318+0000","last_became_active":"2024-09-21T09:13:19.153765+0000","last_became_peered":"2024-09-21T09:13:19.153765+0000","last_unstale":"2024-09-21T09:13:34.297318+0000","last_undegraded":"2024-09-21T09:13:34.297318+0000","last_fullsized":"2024-09-21T09:13:34.297318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'6","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378620+0000","last_change":"2024-09-21T09:10:58.865842+0000","last_active":"2024-09-21T09:13:35.378620+0000","last_peered":"2024-09-21T09:13:35.378620+0000","last_clean":"2024-09-21T09:13:35.378620+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:13:35.378620+0000","last_undegraded":"2024-09-21T09:13:35.378620+0000","last_fullsized":"2024-09-21T09:13:35.378620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:10.069785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"66'7","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293255+0000","last_change":"2024-09-21T09:13:19.522324+0000","last_active":"2024-09-21T09:13:34.293255+0000","last_peered":"2024-09-21T09:13:34.293255+0000","last_clean":"2024-09-21T09:13:34.293255+0000","last_became_active":"2024-09-21T09:13:19.143052+0000","last_became_peered":"2024-09-21T09:13:19.143052+0000","last_unstale":"2024-09-21T09:13:34.293255+0000","last_undegraded":"2024-09-21T09:13:34.293255+0000","last_fullsized":"2024-09-21T09:13:34.293255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:36.362618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"71'8","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527890+0000","last_change":"2024-09-21T09:10:58.871267+0000","last_active":"2024-09-21T09:13:34.527890+0000","last_peered":"2024-09-21T09:13:34.527890+0000","last_clean":"2024-09-21T09:13:34.527890+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:13:34.527890+0000","last_undegraded":"2024-09-21T09:13:34.527890+0000","last_fullsized":"2024-09-21T09:13:34.527890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"66'8","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525789+0000","last_change":"2024-09-21T09:10:56.847914+0000","last_active":"2024-09-21T09:13:34.525789+0000","last_peered":"2024-09-21T09:13:34.525789+0000","last_clean":"2024-09-21T09:13:34.525789+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:13:34.525789+0000","last_undegraded":"2024-09-21T09:13:34.525789+0000","last_fullsized":"2024-09-21T09:13:34.525789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482765+0000","last_change":"2024-09-21T09:10:58.837841+0000","last_active":"2024-09-21T09:13:34.482765+0000","last_peered":"2024-09-21T09:13:34.482765+0000","last_clean":"2024-09-21T09:13:34.482765+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:13:34.482765+0000","last_undegraded":"2024-09-21T09:13:34.482765+0000","last_fullsized":"2024-09-21T09:13:34.482765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:54.101397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"67'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482421+0000","last_change":"2024-09-21T09:10:56.861995+0000","last_active":"2024-09-21T09:13:34.482421+0000","last_peered":"2024-09-21T09:13:34.482421+0000","last_clean":"2024-09-21T09:13:34.482421+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:13:34.482421+0000","last_undegraded":"2024-09-21T09:13:34.482421+0000","last_fullsized":"2024-09-21T09:13:34.482421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:44.655482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"58'4","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957038+0000","last_change":"2024-09-21T09:13:20.835461+0000","last_active":"2024-09-21T09:13:34.957038+0000","last_peered":"2024-09-21T09:13:34.957038+0000","last_clean":"2024-09-21T09:13:34.957038+0000","last_became_active":"2024-09-21T09:13:19.169698+0000","last_became_peered":"2024-09-21T09:13:19.169698+0000","last_unstale":"2024-09-21T09:13:34.957038+0000","last_undegraded":"2024-09-21T09:13:34.957038+0000","last_fullsized":"2024-09-21T09:13:34.957038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:00.406380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"62'6","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955827+0000","last_change":"2024-09-21T09:10:56.866139+0000","last_active":"2024-09-21T09:13:34.955827+0000","last_peered":"2024-09-21T09:13:34.955827+0000","last_clean":"2024-09-21T09:13:34.955827+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:13:34.955827+0000","last_undegraded":"2024-09-21T09:13:34.955827+0000","last_fullsized":"2024-09-21T09:13:34.955827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:33.551996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"58'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956535+0000","last_change":"2024-09-21T09:10:58.840408+0000","last_active":"2024-09-21T09:13:34.956535+0000","last_peered":"2024-09-21T09:13:34.956535+0000","last_clean":"2024-09-21T09:13:34.956535+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:13:34.956535+0000","last_undegraded":"2024-09-21T09:13:34.956535+0000","last_fullsized":"2024-09-21T09:13:34.956535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:42.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"66'8","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295479+0000","last_change":"2024-09-21T09:10:56.860054+0000","last_active":"2024-09-21T09:13:34.295479+0000","last_peered":"2024-09-21T09:13:34.295479+0000","last_clean":"2024-09-21T09:13:34.295479+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:13:34.295479+0000","last_undegraded":"2024-09-21T09:13:34.295479+0000","last_fullsized":"2024-09-21T09:13:34.295479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296113+0000","last_change":"2024-09-21T09:10:58.836500+0000","last_active":"2024-09-21T09:13:34.296113+0000","last_peered":"2024-09-21T09:13:34.296113+0000","last_clean":"2024-09-21T09:13:34.296113+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:13:34.296113+0000","last_undegraded":"2024-09-21T09:13:34.296113+0000","last_fullsized":"2024-09-21T09:13:34.296113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"66'8","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295940+0000","last_change":"2024-09-21T09:10:56.862765+0000","last_active":"2024-09-21T09:13:34.295940+0000","last_peered":"2024-09-21T09:13:34.295940+0000","last_clean":"2024-09-21T09:13:34.295940+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:13:34.295940+0000","last_undegraded":"2024-09-21T09:13:34.295940+0000","last_fullsized":"2024-09-21T09:13:34.295940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"62'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294186+0000","last_change":"2024-09-21T09:10:58.826466+0000","last_active":"2024-09-21T09:13:34.294186+0000","last_peered":"2024-09-21T09:13:34.294186+0000","last_clean":"2024-09-21T09:13:34.294186+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:13:34.294186+0000","last_undegraded":"2024-09-21T09:13:34.294186+0000","last_fullsized":"2024-09-21T09:13:34.294186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"66'9","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299107+0000","last_change":"2024-09-21T09:13:20.211974+0000","last_active":"2024-09-21T09:13:34.299107+0000","last_peered":"2024-09-21T09:13:34.299107+0000","last_clean":"2024-09-21T09:13:34.299107+0000","last_became_active":"2024-09-21T09:13:19.161214+0000","last_became_peered":"2024-09-21T09:13:19.161214+0000","last_unstale":"2024-09-21T09:13:34.299107+0000","last_undegraded":"2024-09-21T09:13:34.299107+0000","last_fullsized":"2024-09-21T09:13:34.299107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:40:58.281738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"62'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527446+0000","last_change":"2024-09-21T09:10:58.872072+0000","last_active":"2024-09-21T09:13:35.527446+0000","last_peered":"2024-09-21T09:13:35.527446+0000","last_clean":"2024-09-21T09:13:35.527446+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:13:35.527446+0000","last_undegraded":"2024-09-21T09:13:35.527446+0000","last_fullsized":"2024-09-21T09:13:35.527446+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"67'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958252+0000","last_change":"2024-09-21T09:10:56.861072+0000","last_active":"2024-09-21T09:13:34.958252+0000","last_peered":"2024-09-21T09:13:34.958252+0000","last_clean":"2024-09-21T09:13:34.958252+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:13:34.958252+0000","last_undegraded":"2024-09-21T09:13:34.958252+0000","last_fullsized":"2024-09-21T09:13:34.958252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527799+0000","last_change":"2024-09-21T09:10:58.856982+0000","last_active":"2024-09-21T09:13:34.527799+0000","last_peered":"2024-09-21T09:13:34.527799+0000","last_clean":"2024-09-21T09:13:34.527799+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:13:34.527799+0000","last_undegraded":"2024-09-21T09:13:34.527799+0000","last_fullsized":"2024-09-21T09:13:34.527799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"66'7","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482177+0000","last_change":"2024-09-21T09:10:56.847793+0000","last_active":"2024-09-21T09:13:34.482177+0000","last_peered":"2024-09-21T09:13:34.482177+0000","last_clean":"2024-09-21T09:13:34.482177+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:13:34.482177+0000","last_undegraded":"2024-09-21T09:13:34.482177+0000","last_fullsized":"2024-09-21T09:13:34.482177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:22.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"62'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298133+0000","last_change":"2024-09-21T09:10:58.851481+0000","last_active":"2024-09-21T09:13:34.298133+0000","last_peered":"2024-09-21T09:13:34.298133+0000","last_clean":"2024-09-21T09:13:34.298133+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:13:34.298133+0000","last_undegraded":"2024-09-21T09:13:34.298133+0000","last_fullsized":"2024-09-21T09:13:34.298133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:42.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"67'12","reported_seq":215,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956033+0000","last_change":"2024-09-21T09:13:20.068227+0000","last_active":"2024-09-21T09:13:34.956033+0000","last_peered":"2024-09-21T09:13:34.956033+0000","last_clean":"2024-09-21T09:13:34.956033+0000","last_became_active":"2024-09-21T09:13:19.169480+0000","last_became_peered":"2024-09-21T09:13:19.169480+0000","last_unstale":"2024-09-21T09:13:34.956033+0000","last_undegraded":"2024-09-21T09:13:34.956033+0000","last_fullsized":"2024-09-21T09:13:34.956033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:08.928533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957005+0000","last_change":"2024-09-21T09:10:58.843673+0000","last_active":"2024-09-21T09:13:34.957005+0000","last_peered":"2024-09-21T09:13:34.957005+0000","last_clean":"2024-09-21T09:13:34.957005+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:13:34.957005+0000","last_undegraded":"2024-09-21T09:13:34.957005+0000","last_fullsized":"2024-09-21T09:13:34.957005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:19.133330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"67'6","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528514+0000","last_change":"2024-09-21T09:10:56.838835+0000","last_active":"2024-09-21T09:13:35.528514+0000","last_peered":"2024-09-21T09:13:35.528514+0000","last_clean":"2024-09-21T09:13:35.528514+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:13:35.528514+0000","last_undegraded":"2024-09-21T09:13:35.528514+0000","last_fullsized":"2024-09-21T09:13:35.528514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529034+0000","last_change":"2024-09-21T09:10:58.869168+0000","last_active":"2024-09-21T09:13:35.529034+0000","last_peered":"2024-09-21T09:13:35.529034+0000","last_clean":"2024-09-21T09:13:35.529034+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:13:35.529034+0000","last_undegraded":"2024-09-21T09:13:35.529034+0000","last_fullsized":"2024-09-21T09:13:35.529034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"66'13","reported_seq":222,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375170+0000","last_change":"2024-09-21T09:13:20.275872+0000","last_active":"2024-09-21T09:13:35.375170+0000","last_peered":"2024-09-21T09:13:35.375170+0000","last_clean":"2024-09-21T09:13:35.375170+0000","last_became_active":"2024-09-21T09:13:19.153073+0000","last_became_peered":"2024-09-21T09:13:19.153073+0000","last_unstale":"2024-09-21T09:13:35.375170+0000","last_undegraded":"2024-09-21T09:13:35.375170+0000","last_fullsized":"2024-09-21T09:13:35.375170+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:51.699749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526744+0000","last_change":"2024-09-21T09:10:58.840930+0000","last_active":"2024-09-21T09:13:35.526744+0000","last_peered":"2024-09-21T09:13:35.526744+0000","last_clean":"2024-09-21T09:13:35.526744+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:13:35.526744+0000","last_undegraded":"2024-09-21T09:13:35.526744+0000","last_fullsized":"2024-09-21T09:13:35.526744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"67'13","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297144+0000","last_change":"2024-09-21T09:10:56.841366+0000","last_active":"2024-09-21T09:13:34.297144+0000","last_peered":"2024-09-21T09:13:34.297144+0000","last_clean":"2024-09-21T09:13:34.297144+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:13:34.297144+0000","last_undegraded":"2024-09-21T09:13:34.297144+0000","last_fullsized":"2024-09-21T09:13:34.297144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:15.948479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526167+0000","last_change":"2024-09-21T09:10:58.873865+0000","last_active":"2024-09-21T09:13:34.526167+0000","last_peered":"2024-09-21T09:13:34.526167+0000","last_clean":"2024-09-21T09:13:34.526167+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:13:34.526167+0000","last_undegraded":"2024-09-21T09:13:34.526167+0000","last_fullsized":"2024-09-21T09:13:34.526167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"67'5","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482963+0000","last_change":"2024-09-21T09:10:56.843359+0000","last_active":"2024-09-21T09:13:34.482963+0000","last_peered":"2024-09-21T09:13:34.482963+0000","last_clean":"2024-09-21T09:13:34.482963+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:13:34.482963+0000","last_undegraded":"2024-09-21T09:13:34.482963+0000","last_fullsized":"2024-09-21T09:13:34.482963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:17.126175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"71'4","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377059+0000","last_change":"2024-09-21T09:10:58.864268+0000","last_active":"2024-09-21T09:13:35.377059+0000","last_peered":"2024-09-21T09:13:35.377059+0000","last_clean":"2024-09-21T09:13:35.377059+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:13:35.377059+0000","last_undegraded":"2024-09-21T09:13:35.377059+0000","last_fullsized":"2024-09-21T09:13:35.377059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:22.929821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"66'10","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.528171+0000","last_change":"2024-09-21T09:13:19.704634+0000","last_active":"2024-09-21T09:13:34.528171+0000","last_peered":"2024-09-21T09:13:34.528171+0000","last_clean":"2024-09-21T09:13:34.528171+0000","last_became_active":"2024-09-21T09:13:19.159408+0000","last_became_peered":"2024-09-21T09:13:19.159408+0000","last_unstale":"2024-09-21T09:13:34.528171+0000","last_undegraded":"2024-09-21T09:13:34.528171+0000","last_fullsized":"2024-09-21T09:13:34.528171+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:49.771475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527340+0000","last_change":"2024-09-21T09:10:58.840040+0000","last_active":"2024-09-21T09:13:35.527340+0000","last_peered":"2024-09-21T09:13:35.527340+0000","last_clean":"2024-09-21T09:13:35.527340+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:13:35.527340+0000","last_undegraded":"2024-09-21T09:13:35.527340+0000","last_fullsized":"2024-09-21T09:13:35.527340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"66'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483406+0000","last_change":"2024-09-21T09:10:56.845828+0000","last_active":"2024-09-21T09:13:34.483406+0000","last_peered":"2024-09-21T09:13:34.483406+0000","last_clean":"2024-09-21T09:13:34.483406+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:13:34.483406+0000","last_undegraded":"2024-09-21T09:13:34.483406+0000","last_fullsized":"2024-09-21T09:13:34.483406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:37.489093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"67'8","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:13:20.828458+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:13:19.155182+0000","last_became_peered":"2024-09-21T09:13:19.155182+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:34.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378422+0000","last_change":"2024-09-21T09:10:58.871879+0000","last_active":"2024-09-21T09:13:35.378422+0000","last_peered":"2024-09-21T09:13:35.378422+0000","last_clean":"2024-09-21T09:13:35.378422+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:13:35.378422+0000","last_undegraded":"2024-09-21T09:13:35.378422+0000","last_fullsized":"2024-09-21T09:13:35.378422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:28.117298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"66'10","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955726+0000","last_change":"2024-09-21T09:10:56.862439+0000","last_active":"2024-09-21T09:13:34.955726+0000","last_peered":"2024-09-21T09:13:34.955726+0000","last_clean":"2024-09-21T09:13:34.955726+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:13:34.955726+0000","last_undegraded":"2024-09-21T09:13:34.955726+0000","last_fullsized":"2024-09-21T09:13:34.955726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527158+0000","last_change":"2024-09-21T09:10:58.828974+0000","last_active":"2024-09-21T09:13:35.527158+0000","last_peered":"2024-09-21T09:13:35.527158+0000","last_clean":"2024-09-21T09:13:35.527158+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:13:35.527158+0000","last_undegraded":"2024-09-21T09:13:35.527158+0000","last_fullsized":"2024-09-21T09:13:35.527158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":233,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":848,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":820,"ondisk_log_size":820,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":156302,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":813,"num_read_kb":575,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":660,"num_keys_recovered":24,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":272744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":668,"ondisk_log_size":668,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":545,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":23,"num_write":644,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":1149239296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384648,"kb_used_data":349304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93987192,"statfs":{"total":96636764160,"available":96242884608,"internally_reserved":0,"allocated":357687296,"data_stored":357174157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":511572,"kb_used_data":476224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93860268,"statfs":{"total":96636764160,"available":96112914432,"internally_reserved":0,"allocated":487653376,"data_stored":487144593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":790672,"kb_used_data":755328,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93581168,"statfs":{"total":96636764160,"available":95827116032,"internally_reserved":0,"allocated":773455872,"data_stored":772942678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763532,"kb_used_data":728184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93608308,"statfs":{"total":96636764160,"available":95854907392,"internally_reserved":0,"allocated":745660416,"data_stored":745152324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":677440,"kb_used_data":642084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93694400,"statfs":{"total":96636764160,"available":95943065600,"internally_reserved":0,"allocated":657494016,"data_stored":657008169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":594160,"kb_used_data":558816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93777680,"statfs":{"total":96636764160,"available":96028344320,"internally_reserved":0,"allocated":572227584,"data_stored":571684881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":794284,"kb_used_data":758940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93577556,"statfs":{"total":96636764160,"available":95823417344,"internally_reserved":0,"allocated":777154560,"data_stored":776616419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462480,"kb_used_data":422976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93909360,"statfs":{"total":96636764160,"available":96163184640,"internally_reserved":0,"allocated":433127424,"data_stored":432613611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":775946240,"data_stored":775946240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":570425344,"data_stored":570425344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":656408576,"data_stored":656408576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":744488960,"data_stored":744488960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":432013312,"data_stored":432013312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":771751936,"data_stored":771751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":486539264,"data_stored":486539264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":356515840,"data_stored":356515840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":70250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":6483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":58451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:13:46.441 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T09:13:46.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:13:46.825 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:13:46.832 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:13:46.848 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-21T09:13:45.024801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397793038,"num_objects":773,"num_object_clones":0,"num_object_copies":1546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":773,"num_whiteouts":0,"num_read":2000,"num_read_kb":1716,"num_write":1739,"num_write_kb":2368151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":1149241676,"num_keys_recovered":26,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2531,"ondisk_log_size":2531,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4978788,"kb_used_data":4691856,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":749995932,"statfs":{"total":773094113280,"available":767995834368,"internally_reserved":0,"allocated":4804460544,"data_stored":4800336832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.735051"},"pg_stats":[{"pgid":"3.3f","version":"66'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299072+0000","last_change":"2024-09-21T09:10:56.846463+0000","last_active":"2024-09-21T09:13:34.299072+0000","last_peered":"2024-09-21T09:13:34.299072+0000","last_clean":"2024-09-21T09:13:34.299072+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:13:34.299072+0000","last_undegraded":"2024-09-21T09:13:34.299072+0000","last_fullsized":"2024-09-21T09:13:34.299072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527158+0000","last_change":"2024-09-21T09:10:58.836923+0000","last_active":"2024-09-21T09:13:35.527158+0000","last_peered":"2024-09-21T09:13:35.527158+0000","last_clean":"2024-09-21T09:13:35.527158+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:13:35.527158+0000","last_undegraded":"2024-09-21T09:13:35.527158+0000","last_fullsized":"2024-09-21T09:13:35.527158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:30.880333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"67'13","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957928+0000","last_change":"2024-09-21T09:10:56.865056+0000","last_active":"2024-09-21T09:13:34.957928+0000","last_peered":"2024-09-21T09:13:34.957928+0000","last_clean":"2024-09-21T09:13:34.957928+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:13:34.957928+0000","last_undegraded":"2024-09-21T09:13:34.957928+0000","last_fullsized":"2024-09-21T09:13:34.957928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482290+0000","last_change":"2024-09-21T09:10:58.835355+0000","last_active":"2024-09-21T09:13:34.482290+0000","last_peered":"2024-09-21T09:13:34.482290+0000","last_clean":"2024-09-21T09:13:34.482290+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:13:34.482290+0000","last_undegraded":"2024-09-21T09:13:34.482290+0000","last_fullsized":"2024-09-21T09:13:34.482290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:24.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"67'13","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957115+0000","last_change":"2024-09-21T09:10:56.861504+0000","last_active":"2024-09-21T09:13:34.957115+0000","last_peered":"2024-09-21T09:13:34.957115+0000","last_clean":"2024-09-21T09:13:34.957115+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:13:34.957115+0000","last_undegraded":"2024-09-21T09:13:34.957115+0000","last_fullsized":"2024-09-21T09:13:34.957115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:00.409267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482198+0000","last_change":"2024-09-21T09:13:19.490368+0000","last_active":"2024-09-21T09:13:34.482198+0000","last_peered":"2024-09-21T09:13:34.482198+0000","last_clean":"2024-09-21T09:13:34.482198+0000","last_became_active":"2024-09-21T09:13:19.153424+0000","last_became_peered":"2024-09-21T09:13:19.153424+0000","last_unstale":"2024-09-21T09:13:34.482198+0000","last_undegraded":"2024-09-21T09:13:34.482198+0000","last_fullsized":"2024-09-21T09:13:34.482198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:25.154789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"66'13","reported_seq":68,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298556+0000","last_change":"2024-09-21T09:13:20.586732+0000","last_active":"2024-09-21T09:13:34.298556+0000","last_peered":"2024-09-21T09:13:34.298556+0000","last_clean":"2024-09-21T09:13:34.298556+0000","last_became_active":"2024-09-21T09:13:19.165441+0000","last_became_peered":"2024-09-21T09:13:19.165441+0000","last_unstale":"2024-09-21T09:13:34.298556+0000","last_undegraded":"2024-09-21T09:13:34.298556+0000","last_fullsized":"2024-09-21T09:13:34.298556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:51.794446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"58'4","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375167+0000","last_change":"2024-09-21T09:13:20.643217+0000","last_active":"2024-09-21T09:13:35.375167+0000","last_peered":"2024-09-21T09:13:35.375167+0000","last_clean":"2024-09-21T09:13:35.375167+0000","last_became_active":"2024-09-21T09:13:19.153875+0000","last_became_peered":"2024-09-21T09:13:19.153875+0000","last_unstale":"2024-09-21T09:13:35.375167+0000","last_undegraded":"2024-09-21T09:13:35.375167+0000","last_fullsized":"2024-09-21T09:13:35.375167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:03.004434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"67'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296553+0000","last_change":"2024-09-21T09:10:56.863607+0000","last_active":"2024-09-21T09:13:34.296553+0000","last_peered":"2024-09-21T09:13:34.296553+0000","last_clean":"2024-09-21T09:13:34.296553+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:13:34.296553+0000","last_undegraded":"2024-09-21T09:13:34.296553+0000","last_fullsized":"2024-09-21T09:13:34.296553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296333+0000","last_change":"2024-09-21T09:10:58.851357+0000","last_active":"2024-09-21T09:13:34.296333+0000","last_peered":"2024-09-21T09:13:34.296333+0000","last_clean":"2024-09-21T09:13:34.296333+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:13:34.296333+0000","last_undegraded":"2024-09-21T09:13:34.296333+0000","last_fullsized":"2024-09-21T09:13:34.296333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"66'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293642+0000","last_change":"2024-09-21T09:13:19.704935+0000","last_active":"2024-09-21T09:13:34.293642+0000","last_peered":"2024-09-21T09:13:34.293642+0000","last_clean":"2024-09-21T09:13:34.293642+0000","last_became_active":"2024-09-21T09:13:19.160915+0000","last_became_peered":"2024-09-21T09:13:19.160915+0000","last_unstale":"2024-09-21T09:13:34.293642+0000","last_undegraded":"2024-09-21T09:13:34.293642+0000","last_fullsized":"2024-09-21T09:13:34.293642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:00.863610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297928+0000","last_change":"2024-09-21T09:10:58.825880+0000","last_active":"2024-09-21T09:13:34.297928+0000","last_peered":"2024-09-21T09:13:34.297928+0000","last_clean":"2024-09-21T09:13:34.297928+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:13:34.297928+0000","last_undegraded":"2024-09-21T09:13:34.297928+0000","last_fullsized":"2024-09-21T09:13:34.297928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:46.662637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"66'5","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294804+0000","last_change":"2024-09-21T09:10:56.851331+0000","last_active":"2024-09-21T09:13:34.294804+0000","last_peered":"2024-09-21T09:13:34.294804+0000","last_clean":"2024-09-21T09:13:34.294804+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:13:34.294804+0000","last_undegraded":"2024-09-21T09:13:34.294804+0000","last_fullsized":"2024-09-21T09:13:34.294804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"62'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298620+0000","last_change":"2024-09-21T09:13:20.336460+0000","last_active":"2024-09-21T09:13:34.298620+0000","last_peered":"2024-09-21T09:13:34.298620+0000","last_clean":"2024-09-21T09:13:34.298620+0000","last_became_active":"2024-09-21T09:13:19.164775+0000","last_became_peered":"2024-09-21T09:13:19.164775+0000","last_unstale":"2024-09-21T09:13:34.298620+0000","last_undegraded":"2024-09-21T09:13:34.298620+0000","last_fullsized":"2024-09-21T09:13:34.298620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:16.166364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"67'11","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955584+0000","last_change":"2024-09-21T09:10:56.864409+0000","last_active":"2024-09-21T09:13:34.955584+0000","last_peered":"2024-09-21T09:13:34.955584+0000","last_clean":"2024-09-21T09:13:34.955584+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:13:34.955584+0000","last_undegraded":"2024-09-21T09:13:34.955584+0000","last_fullsized":"2024-09-21T09:13:34.955584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"62'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958533+0000","last_change":"2024-09-21T09:10:58.837006+0000","last_active":"2024-09-21T09:13:34.958533+0000","last_peered":"2024-09-21T09:13:34.958533+0000","last_clean":"2024-09-21T09:13:34.958533+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:13:34.958533+0000","last_undegraded":"2024-09-21T09:13:34.958533+0000","last_fullsized":"2024-09-21T09:13:34.958533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:52.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482026+0000","last_change":"2024-09-21T09:10:58.853249+0000","last_active":"2024-09-21T09:13:34.482026+0000","last_peered":"2024-09-21T09:13:34.482026+0000","last_clean":"2024-09-21T09:13:34.482026+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:13:34.482026+0000","last_undegraded":"2024-09-21T09:13:34.482026+0000","last_fullsized":"2024-09-21T09:13:34.482026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:03.692219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"66'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528471+0000","last_change":"2024-09-21T09:10:56.838955+0000","last_active":"2024-09-21T09:13:35.528471+0000","last_peered":"2024-09-21T09:13:35.528471+0000","last_clean":"2024-09-21T09:13:35.528471+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:13:35.528471+0000","last_undegraded":"2024-09-21T09:13:35.528471+0000","last_fullsized":"2024-09-21T09:13:35.528471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294467+0000","last_change":"2024-09-21T09:10:58.869303+0000","last_active":"2024-09-21T09:13:34.294467+0000","last_peered":"2024-09-21T09:13:34.294467+0000","last_clean":"2024-09-21T09:13:34.294467+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:13:34.294467+0000","last_undegraded":"2024-09-21T09:13:34.294467+0000","last_fullsized":"2024-09-21T09:13:34.294467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"67'7","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298558+0000","last_change":"2024-09-21T09:13:21.021044+0000","last_active":"2024-09-21T09:13:34.298558+0000","last_peered":"2024-09-21T09:13:34.298558+0000","last_clean":"2024-09-21T09:13:34.298558+0000","last_became_active":"2024-09-21T09:13:19.154413+0000","last_became_peered":"2024-09-21T09:13:19.154413+0000","last_unstale":"2024-09-21T09:13:34.298558+0000","last_undegraded":"2024-09-21T09:13:34.298558+0000","last_fullsized":"2024-09-21T09:13:34.298558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'8","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528416+0000","last_change":"2024-09-21T09:10:58.840976+0000","last_active":"2024-09-21T09:13:35.528416+0000","last_peered":"2024-09-21T09:13:35.528416+0000","last_clean":"2024-09-21T09:13:35.528416+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:13:35.528416+0000","last_undegraded":"2024-09-21T09:13:35.528416+0000","last_fullsized":"2024-09-21T09:13:35.528416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"66'9","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298092+0000","last_change":"2024-09-21T09:10:56.853888+0000","last_active":"2024-09-21T09:13:34.298092+0000","last_peered":"2024-09-21T09:13:34.298092+0000","last_clean":"2024-09-21T09:13:34.298092+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:13:34.298092+0000","last_undegraded":"2024-09-21T09:13:34.298092+0000","last_fullsized":"2024-09-21T09:13:34.298092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294562+0000","last_change":"2024-09-21T09:10:58.838132+0000","last_active":"2024-09-21T09:13:34.294562+0000","last_peered":"2024-09-21T09:13:34.294562+0000","last_clean":"2024-09-21T09:13:34.294562+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:13:34.294562+0000","last_undegraded":"2024-09-21T09:13:34.294562+0000","last_fullsized":"2024-09-21T09:13:34.294562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"66'10","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296777+0000","last_change":"2024-09-21T09:10:56.845923+0000","last_active":"2024-09-21T09:13:34.296777+0000","last_peered":"2024-09-21T09:13:34.296777+0000","last_clean":"2024-09-21T09:13:34.296777+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:13:34.296777+0000","last_undegraded":"2024-09-21T09:13:34.296777+0000","last_fullsized":"2024-09-21T09:13:34.296777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'8","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956761+0000","last_change":"2024-09-21T09:10:58.848326+0000","last_active":"2024-09-21T09:13:34.956761+0000","last_peered":"2024-09-21T09:13:34.956761+0000","last_clean":"2024-09-21T09:13:34.956761+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:13:34.956761+0000","last_undegraded":"2024-09-21T09:13:34.956761+0000","last_fullsized":"2024-09-21T09:13:34.956761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:44.318321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"71'12","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295345+0000","last_change":"2024-09-21T09:10:56.859019+0000","last_active":"2024-09-21T09:13:34.295345+0000","last_peered":"2024-09-21T09:13:34.295345+0000","last_clean":"2024-09-21T09:13:34.295345+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:13:34.295345+0000","last_undegraded":"2024-09-21T09:13:34.295345+0000","last_fullsized":"2024-09-21T09:13:34.295345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529197+0000","last_change":"2024-09-21T09:10:58.830335+0000","last_active":"2024-09-21T09:13:35.529197+0000","last_peered":"2024-09-21T09:13:35.529197+0000","last_clean":"2024-09-21T09:13:35.529197+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:13:35.529197+0000","last_undegraded":"2024-09-21T09:13:35.529197+0000","last_fullsized":"2024-09-21T09:13:35.529197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"67'7","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294674+0000","last_change":"2024-09-21T09:10:56.862662+0000","last_active":"2024-09-21T09:13:34.294674+0000","last_peered":"2024-09-21T09:13:34.294674+0000","last_clean":"2024-09-21T09:13:34.294674+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:13:34.294674+0000","last_undegraded":"2024-09-21T09:13:34.294674+0000","last_fullsized":"2024-09-21T09:13:34.294674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295061+0000","last_change":"2024-09-21T09:11:06.898983+0000","last_active":"2024-09-21T09:13:34.295061+0000","last_peered":"2024-09-21T09:13:34.295061+0000","last_clean":"2024-09-21T09:13:34.295061+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:13:34.295061+0000","last_undegraded":"2024-09-21T09:13:34.295061+0000","last_fullsized":"2024-09-21T09:13:34.295061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294904+0000","last_change":"2024-09-21T09:10:58.876069+0000","last_active":"2024-09-21T09:13:34.294904+0000","last_peered":"2024-09-21T09:13:34.294904+0000","last_clean":"2024-09-21T09:13:34.294904+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:13:34.294904+0000","last_undegraded":"2024-09-21T09:13:34.294904+0000","last_fullsized":"2024-09-21T09:13:34.294904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"66'4","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482459+0000","last_change":"2024-09-21T09:10:56.848523+0000","last_active":"2024-09-21T09:13:34.482459+0000","last_peered":"2024-09-21T09:13:34.482459+0000","last_clean":"2024-09-21T09:13:34.482459+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:13:34.482459+0000","last_undegraded":"2024-09-21T09:13:34.482459+0000","last_fullsized":"2024-09-21T09:13:34.482459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:19.819608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483302+0000","last_change":"2024-09-21T09:11:00.842168+0000","last_active":"2024-09-21T09:13:34.483302+0000","last_peered":"2024-09-21T09:13:34.483302+0000","last_clean":"2024-09-21T09:13:34.483302+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:13:34.483302+0000","last_undegraded":"2024-09-21T09:13:34.483302+0000","last_fullsized":"2024-09-21T09:13:34.483302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:33.920548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"71'15","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377878+0000","last_change":"2024-09-21T09:11:02.866403+0000","last_active":"2024-09-21T09:13:35.377878+0000","last_peered":"2024-09-21T09:13:35.377878+0000","last_clean":"2024-09-21T09:13:35.377878+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:13:35.377878+0000","last_undegraded":"2024-09-21T09:13:35.377878+0000","last_fullsized":"2024-09-21T09:13:35.377878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:12.124539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527948+0000","last_change":"2024-09-21T09:11:04.894715+0000","last_active":"2024-09-21T09:13:35.527948+0000","last_peered":"2024-09-21T09:13:35.527948+0000","last_clean":"2024-09-21T09:13:35.527948+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:13:35.527948+0000","last_undegraded":"2024-09-21T09:13:35.527948+0000","last_fullsized":"2024-09-21T09:13:35.527948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:59.579572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"58'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527415+0000","last_change":"2024-09-21T09:11:06.885484+0000","last_active":"2024-09-21T09:13:35.527415+0000","last_peered":"2024-09-21T09:13:35.527415+0000","last_clean":"2024-09-21T09:13:35.527415+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:13:35.527415+0000","last_undegraded":"2024-09-21T09:13:35.527415+0000","last_fullsized":"2024-09-21T09:13:35.527415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:13.165470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"61'6","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483104+0000","last_change":"2024-09-21T09:10:58.842832+0000","last_active":"2024-09-21T09:13:34.483104+0000","last_peered":"2024-09-21T09:13:34.483104+0000","last_clean":"2024-09-21T09:13:34.483104+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:13:34.483104+0000","last_undegraded":"2024-09-21T09:13:34.483104+0000","last_fullsized":"2024-09-21T09:13:34.483104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:12.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:56.849428+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375922+0000","last_change":"2024-09-21T09:13:19.156069+0000","last_active":"2024-09-21T09:13:35.375922+0000","last_peered":"2024-09-21T09:13:35.375922+0000","last_clean":"2024-09-21T09:13:35.375922+0000","last_became_active":"2024-09-21T09:13:19.153940+0000","last_became_peered":"2024-09-21T09:13:19.153940+0000","last_unstale":"2024-09-21T09:13:35.375922+0000","last_undegraded":"2024-09-21T09:13:35.375922+0000","last_fullsized":"2024-09-21T09:13:35.375922+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:57.795849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526564+0000","last_change":"2024-09-21T09:11:02.866594+0000","last_active":"2024-09-21T09:13:35.526564+0000","last_peered":"2024-09-21T09:13:35.526564+0000","last_clean":"2024-09-21T09:13:35.526564+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:13:35.526564+0000","last_undegraded":"2024-09-21T09:13:35.526564+0000","last_fullsized":"2024-09-21T09:13:35.526564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526934+0000","last_change":"2024-09-21T09:11:04.887299+0000","last_active":"2024-09-21T09:13:35.526934+0000","last_peered":"2024-09-21T09:13:35.526934+0000","last_clean":"2024-09-21T09:13:35.526934+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:13:35.526934+0000","last_undegraded":"2024-09-21T09:13:35.526934+0000","last_fullsized":"2024-09-21T09:13:35.526934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:08.490686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":129,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294124+0000","last_change":"2024-09-21T09:13:19.145016+0000","last_active":"2024-09-21T09:13:34.294124+0000","last_peered":"2024-09-21T09:13:34.294124+0000","last_clean":"2024-09-21T09:13:34.294124+0000","last_became_active":"2024-09-21T09:13:19.144143+0000","last_became_peered":"2024-09-21T09:13:19.144143+0000","last_unstale":"2024-09-21T09:13:34.294124+0000","last_undegraded":"2024-09-21T09:13:34.294124+0000","last_fullsized":"2024-09-21T09:13:34.294124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957751+0000","last_change":"2024-09-21T09:10:58.851370+0000","last_active":"2024-09-21T09:13:34.957751+0000","last_peered":"2024-09-21T09:13:34.957751+0000","last_clean":"2024-09-21T09:13:34.957751+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:13:34.957751+0000","last_undegraded":"2024-09-21T09:13:34.957751+0000","last_fullsized":"2024-09-21T09:13:34.957751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:05.984687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"66'4","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482409+0000","last_change":"2024-09-21T09:13:21.119832+0000","last_active":"2024-09-21T09:13:34.482409+0000","last_peered":"2024-09-21T09:13:34.482409+0000","last_clean":"2024-09-21T09:13:34.482409+0000","last_became_active":"2024-09-21T09:13:19.159398+0000","last_became_peered":"2024-09-21T09:13:19.159398+0000","last_unstale":"2024-09-21T09:13:34.482409+0000","last_undegraded":"2024-09-21T09:13:34.482409+0000","last_fullsized":"2024-09-21T09:13:34.482409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:40.942331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377709+0000","last_change":"2024-09-21T09:11:00.845836+0000","last_active":"2024-09-21T09:13:35.377709+0000","last_peered":"2024-09-21T09:13:35.377709+0000","last_clean":"2024-09-21T09:13:35.377709+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:13:35.377709+0000","last_undegraded":"2024-09-21T09:13:35.377709+0000","last_fullsized":"2024-09-21T09:13:35.377709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:06.353993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376373+0000","last_change":"2024-09-21T09:11:02.852500+0000","last_active":"2024-09-21T09:13:35.376373+0000","last_peered":"2024-09-21T09:13:35.376373+0000","last_clean":"2024-09-21T09:13:35.376373+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:13:35.376373+0000","last_undegraded":"2024-09-21T09:13:35.376373+0000","last_fullsized":"2024-09-21T09:13:35.376373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:19.073540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"91'102","reported_seq":329,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042597+0000","last_change":"2024-09-21T09:11:04.895087+0000","last_active":"2024-09-21T09:13:36.042597+0000","last_peered":"2024-09-21T09:13:36.042597+0000","last_clean":"2024-09-21T09:13:36.042597+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:13:36.042597+0000","last_undegraded":"2024-09-21T09:13:36.042597+0000","last_fullsized":"2024-09-21T09:13:36.042597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:11.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295621+0000","last_change":"2024-09-21T09:13:19.162437+0000","last_active":"2024-09-21T09:13:34.295621+0000","last_peered":"2024-09-21T09:13:34.295621+0000","last_clean":"2024-09-21T09:13:34.295621+0000","last_became_active":"2024-09-21T09:13:19.161659+0000","last_became_peered":"2024-09-21T09:13:19.161659+0000","last_unstale":"2024-09-21T09:13:34.295621+0000","last_undegraded":"2024-09-21T09:13:34.295621+0000","last_fullsized":"2024-09-21T09:13:34.295621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:59.822101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958090+0000","last_change":"2024-09-21T09:10:58.837602+0000","last_active":"2024-09-21T09:13:34.958090+0000","last_peered":"2024-09-21T09:13:34.958090+0000","last_clean":"2024-09-21T09:13:34.958090+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:13:34.958090+0000","last_undegraded":"2024-09-21T09:13:34.958090+0000","last_fullsized":"2024-09-21T09:13:34.958090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:36.269116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"67'17","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527550+0000","last_change":"2024-09-21T09:10:56.844292+0000","last_active":"2024-09-21T09:13:35.527550+0000","last_peered":"2024-09-21T09:13:35.527550+0000","last_clean":"2024-09-21T09:13:35.527550+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:13:35.527550+0000","last_undegraded":"2024-09-21T09:13:35.527550+0000","last_fullsized":"2024-09-21T09:13:35.527550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482929+0000","last_change":"2024-09-21T09:11:00.852984+0000","last_active":"2024-09-21T09:13:34.482929+0000","last_peered":"2024-09-21T09:13:34.482929+0000","last_clean":"2024-09-21T09:13:34.482929+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:13:34.482929+0000","last_undegraded":"2024-09-21T09:13:34.482929+0000","last_fullsized":"2024-09-21T09:13:34.482929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:33.175145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"71'15","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299712+0000","last_change":"2024-09-21T09:13:19.543924+0000","last_active":"2024-09-21T09:13:34.299712+0000","last_peered":"2024-09-21T09:13:34.299712+0000","last_clean":"2024-09-21T09:13:34.299712+0000","last_became_active":"2024-09-21T09:13:19.160798+0000","last_became_peered":"2024-09-21T09:13:19.160798+0000","last_unstale":"2024-09-21T09:13:34.299712+0000","last_undegraded":"2024-09-21T09:13:34.299712+0000","last_fullsized":"2024-09-21T09:13:34.299712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"91'102","reported_seq":303,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042349+0000","last_change":"2024-09-21T09:11:04.894947+0000","last_active":"2024-09-21T09:13:36.042349+0000","last_peered":"2024-09-21T09:13:36.042349+0000","last_clean":"2024-09-21T09:13:36.042349+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:13:36.042349+0000","last_undegraded":"2024-09-21T09:13:36.042349+0000","last_fullsized":"2024-09-21T09:13:36.042349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:21.481386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482063+0000","last_change":"2024-09-21T09:10:58.841384+0000","last_active":"2024-09-21T09:13:34.482063+0000","last_peered":"2024-09-21T09:13:34.482063+0000","last_clean":"2024-09-21T09:13:34.482063+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:13:34.482063+0000","last_undegraded":"2024-09-21T09:13:34.482063+0000","last_fullsized":"2024-09-21T09:13:34.482063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:08.308265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"67'11","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299480+0000","last_change":"2024-09-21T09:10:56.846710+0000","last_active":"2024-09-21T09:13:34.299480+0000","last_peered":"2024-09-21T09:13:34.299480+0000","last_clean":"2024-09-21T09:13:34.299480+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:13:34.299480+0000","last_undegraded":"2024-09-21T09:13:34.299480+0000","last_fullsized":"2024-09-21T09:13:34.299480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527660+0000","last_change":"2024-09-21T09:11:00.839560+0000","last_active":"2024-09-21T09:13:35.527660+0000","last_peered":"2024-09-21T09:13:35.527660+0000","last_clean":"2024-09-21T09:13:35.527660+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:13:35.527660+0000","last_undegraded":"2024-09-21T09:13:35.527660+0000","last_fullsized":"2024-09-21T09:13:35.527660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:41.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"71'26","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295964+0000","last_change":"2024-09-21T09:11:02.872323+0000","last_active":"2024-09-21T09:13:34.295964+0000","last_peered":"2024-09-21T09:13:34.295964+0000","last_clean":"2024-09-21T09:13:34.295964+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:13:34.295964+0000","last_undegraded":"2024-09-21T09:13:34.295964+0000","last_fullsized":"2024-09-21T09:13:34.295964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294211+0000","last_change":"2024-09-21T09:13:19.150862+0000","last_active":"2024-09-21T09:13:34.294211+0000","last_peered":"2024-09-21T09:13:34.294211+0000","last_clean":"2024-09-21T09:13:34.294211+0000","last_became_active":"2024-09-21T09:13:19.149936+0000","last_became_peered":"2024-09-21T09:13:19.149936+0000","last_unstale":"2024-09-21T09:13:34.294211+0000","last_undegraded":"2024-09-21T09:13:34.294211+0000","last_fullsized":"2024-09-21T09:13:34.294211+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.535171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"62'12","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298350+0000","last_change":"2024-09-21T09:13:20.340381+0000","last_active":"2024-09-21T09:13:34.298350+0000","last_peered":"2024-09-21T09:13:34.298350+0000","last_clean":"2024-09-21T09:13:34.298350+0000","last_became_active":"2024-09-21T09:13:19.165108+0000","last_became_peered":"2024-09-21T09:13:19.165108+0000","last_unstale":"2024-09-21T09:13:34.298350+0000","last_undegraded":"2024-09-21T09:13:34.298350+0000","last_fullsized":"2024-09-21T09:13:34.298350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:41.830217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527807+0000","last_change":"2024-09-21T09:10:58.839960+0000","last_active":"2024-09-21T09:13:35.527807+0000","last_peered":"2024-09-21T09:13:35.527807+0000","last_clean":"2024-09-21T09:13:35.527807+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:13:35.527807+0000","last_undegraded":"2024-09-21T09:13:35.527807+0000","last_fullsized":"2024-09-21T09:13:35.527807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"67'7","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298110+0000","last_change":"2024-09-21T09:13:20.333955+0000","last_active":"2024-09-21T09:13:34.298110+0000","last_peered":"2024-09-21T09:13:34.298110+0000","last_clean":"2024-09-21T09:13:34.298110+0000","last_became_active":"2024-09-21T09:13:19.162605+0000","last_became_peered":"2024-09-21T09:13:19.162605+0000","last_unstale":"2024-09-21T09:13:34.298110+0000","last_undegraded":"2024-09-21T09:13:34.298110+0000","last_fullsized":"2024-09-21T09:13:34.298110+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:21.030407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293432+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.293432+0000","last_peered":"2024-09-21T09:13:34.293432+0000","last_clean":"2024-09-21T09:13:34.293432+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:13:34.293432+0000","last_undegraded":"2024-09-21T09:13:34.293432+0000","last_fullsized":"2024-09-21T09:13:34.293432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:48.669684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"71'16","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376624+0000","last_change":"2024-09-21T09:11:02.866165+0000","last_active":"2024-09-21T09:13:35.376624+0000","last_peered":"2024-09-21T09:13:35.376624+0000","last_clean":"2024-09-21T09:13:35.376624+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:13:35.376624+0000","last_undegraded":"2024-09-21T09:13:35.376624+0000","last_fullsized":"2024-09-21T09:13:35.376624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:54:48.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376278+0000","last_change":"2024-09-21T09:11:04.871999+0000","last_active":"2024-09-21T09:13:35.376278+0000","last_peered":"2024-09-21T09:13:35.376278+0000","last_clean":"2024-09-21T09:13:35.376278+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:13:35.376278+0000","last_undegraded":"2024-09-21T09:13:35.376278+0000","last_fullsized":"2024-09-21T09:13:35.376278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:03.218684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"58'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528795+0000","last_change":"2024-09-21T09:13:19.709890+0000","last_active":"2024-09-21T09:13:35.528795+0000","last_peered":"2024-09-21T09:13:35.528795+0000","last_clean":"2024-09-21T09:13:35.528795+0000","last_became_active":"2024-09-21T09:13:19.167145+0000","last_became_peered":"2024-09-21T09:13:19.167145+0000","last_unstale":"2024-09-21T09:13:35.528795+0000","last_undegraded":"2024-09-21T09:13:35.528795+0000","last_fullsized":"2024-09-21T09:13:35.528795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294491+0000","last_change":"2024-09-21T09:13:19.528866+0000","last_active":"2024-09-21T09:13:34.294491+0000","last_peered":"2024-09-21T09:13:34.294491+0000","last_clean":"2024-09-21T09:13:34.294491+0000","last_became_active":"2024-09-21T09:13:19.158113+0000","last_became_peered":"2024-09-21T09:13:19.158113+0000","last_unstale":"2024-09-21T09:13:34.294491+0000","last_undegraded":"2024-09-21T09:13:34.294491+0000","last_fullsized":"2024-09-21T09:13:34.294491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:48.503141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"66'18","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482839+0000","last_change":"2024-09-21T09:10:56.842697+0000","last_active":"2024-09-21T09:13:34.482839+0000","last_peered":"2024-09-21T09:13:34.482839+0000","last_clean":"2024-09-21T09:13:34.482839+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:13:34.482839+0000","last_undegraded":"2024-09-21T09:13:34.482839+0000","last_fullsized":"2024-09-21T09:13:34.482839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:42.311166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957018+0000","last_change":"2024-09-21T09:11:00.852970+0000","last_active":"2024-09-21T09:13:34.957018+0000","last_peered":"2024-09-21T09:13:34.957018+0000","last_clean":"2024-09-21T09:13:34.957018+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:13:34.957018+0000","last_undegraded":"2024-09-21T09:13:34.957018+0000","last_fullsized":"2024-09-21T09:13:34.957018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:35.201984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"71'21","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481917+0000","last_change":"2024-09-21T09:11:02.859081+0000","last_active":"2024-09-21T09:13:34.481917+0000","last_peered":"2024-09-21T09:13:34.481917+0000","last_clean":"2024-09-21T09:13:34.481917+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:13:34.481917+0000","last_undegraded":"2024-09-21T09:13:34.481917+0000","last_fullsized":"2024-09-21T09:13:34.481917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:19.576627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"91'102","reported_seq":258,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042372+0000","last_change":"2024-09-21T09:11:04.895980+0000","last_active":"2024-09-21T09:13:36.042372+0000","last_peered":"2024-09-21T09:13:36.042372+0000","last_clean":"2024-09-21T09:13:36.042372+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:13:36.042372+0000","last_undegraded":"2024-09-21T09:13:36.042372+0000","last_fullsized":"2024-09-21T09:13:36.042372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:57.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295156+0000","last_change":"2024-09-21T09:13:20.635132+0000","last_active":"2024-09-21T09:13:34.295156+0000","last_peered":"2024-09-21T09:13:34.295156+0000","last_clean":"2024-09-21T09:13:34.295156+0000","last_became_active":"2024-09-21T09:13:19.159646+0000","last_became_peered":"2024-09-21T09:13:19.159646+0000","last_unstale":"2024-09-21T09:13:34.295156+0000","last_undegraded":"2024-09-21T09:13:34.295156+0000","last_fullsized":"2024-09-21T09:13:34.295156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:10.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956296+0000","last_change":"2024-09-21T09:10:58.871951+0000","last_active":"2024-09-21T09:13:34.956296+0000","last_peered":"2024-09-21T09:13:34.956296+0000","last_clean":"2024-09-21T09:13:34.956296+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:13:34.956296+0000","last_undegraded":"2024-09-21T09:13:34.956296+0000","last_fullsized":"2024-09-21T09:13:34.956296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:16.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"66'7","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297543+0000","last_change":"2024-09-21T09:10:56.855073+0000","last_active":"2024-09-21T09:13:34.297543+0000","last_peered":"2024-09-21T09:13:34.297543+0000","last_clean":"2024-09-21T09:13:34.297543+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:13:34.297543+0000","last_undegraded":"2024-09-21T09:13:34.297543+0000","last_fullsized":"2024-09-21T09:13:34.297543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:43.818365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294089+0000","last_change":"2024-09-21T09:11:00.845552+0000","last_active":"2024-09-21T09:13:34.294089+0000","last_peered":"2024-09-21T09:13:34.294089+0000","last_clean":"2024-09-21T09:13:34.294089+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:13:34.294089+0000","last_undegraded":"2024-09-21T09:13:34.294089+0000","last_fullsized":"2024-09-21T09:13:34.294089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:44.841947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"71'24","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376051+0000","last_change":"2024-09-21T09:11:02.868260+0000","last_active":"2024-09-21T09:13:35.376051+0000","last_peered":"2024-09-21T09:13:35.376051+0000","last_clean":"2024-09-21T09:13:35.376051+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:13:35.376051+0000","last_undegraded":"2024-09-21T09:13:35.376051+0000","last_fullsized":"2024-09-21T09:13:35.376051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:38.299285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955882+0000","last_change":"2024-09-21T09:11:04.890815+0000","last_active":"2024-09-21T09:13:34.955882+0000","last_peered":"2024-09-21T09:13:34.955882+0000","last_clean":"2024-09-21T09:13:34.955882+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:13:34.955882+0000","last_undegraded":"2024-09-21T09:13:34.955882+0000","last_fullsized":"2024-09-21T09:13:34.955882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:26.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527522+0000","last_change":"2024-09-21T09:11:06.888148+0000","last_active":"2024-09-21T09:13:34.527522+0000","last_peered":"2024-09-21T09:13:34.527522+0000","last_clean":"2024-09-21T09:13:34.527522+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:13:34.527522+0000","last_undegraded":"2024-09-21T09:13:34.527522+0000","last_fullsized":"2024-09-21T09:13:34.527522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296971+0000","last_change":"2024-09-21T09:10:58.871840+0000","last_active":"2024-09-21T09:13:34.296971+0000","last_peered":"2024-09-21T09:13:34.296971+0000","last_clean":"2024-09-21T09:13:34.296971+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:13:34.296971+0000","last_undegraded":"2024-09-21T09:13:34.296971+0000","last_fullsized":"2024-09-21T09:13:34.296971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"67'7","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526772+0000","last_change":"2024-09-21T09:10:56.855886+0000","last_active":"2024-09-21T09:13:34.526772+0000","last_peered":"2024-09-21T09:13:34.526772+0000","last_clean":"2024-09-21T09:13:34.526772+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:13:34.526772+0000","last_undegraded":"2024-09-21T09:13:34.526772+0000","last_fullsized":"2024-09-21T09:13:34.526772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526968+0000","last_change":"2024-09-21T09:11:00.850308+0000","last_active":"2024-09-21T09:13:34.526968+0000","last_peered":"2024-09-21T09:13:34.526968+0000","last_clean":"2024-09-21T09:13:34.526968+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:13:34.526968+0000","last_undegraded":"2024-09-21T09:13:34.526968+0000","last_fullsized":"2024-09-21T09:13:34.526968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:13.608546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"71'17","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526415+0000","last_change":"2024-09-21T09:11:02.866122+0000","last_active":"2024-09-21T09:13:35.526415+0000","last_peered":"2024-09-21T09:13:35.526415+0000","last_clean":"2024-09-21T09:13:35.526415+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:13:35.526415+0000","last_undegraded":"2024-09-21T09:13:35.526415+0000","last_fullsized":"2024-09-21T09:13:35.526415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527462+0000","last_change":"2024-09-21T09:11:04.880608+0000","last_active":"2024-09-21T09:13:34.527462+0000","last_peered":"2024-09-21T09:13:34.527462+0000","last_clean":"2024-09-21T09:13:34.527462+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:13:34.527462+0000","last_undegraded":"2024-09-21T09:13:34.527462+0000","last_fullsized":"2024-09-21T09:13:34.527462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:39.226968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955061+0000","last_change":"2024-09-21T09:11:06.892201+0000","last_active":"2024-09-21T09:13:34.955061+0000","last_peered":"2024-09-21T09:13:34.955061+0000","last_clean":"2024-09-21T09:13:34.955061+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:13:34.955061+0000","last_undegraded":"2024-09-21T09:13:34.955061+0000","last_fullsized":"2024-09-21T09:13:34.955061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:32.463353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483248+0000","last_change":"2024-09-21T09:10:58.838223+0000","last_active":"2024-09-21T09:13:34.483248+0000","last_peered":"2024-09-21T09:13:34.483248+0000","last_clean":"2024-09-21T09:13:34.483248+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:13:34.483248+0000","last_undegraded":"2024-09-21T09:13:34.483248+0000","last_fullsized":"2024-09-21T09:13:34.483248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:01.253234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"67'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482527+0000","last_change":"2024-09-21T09:10:56.841106+0000","last_active":"2024-09-21T09:13:34.482527+0000","last_peered":"2024-09-21T09:13:34.482527+0000","last_clean":"2024-09-21T09:13:34.482527+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:13:34.482527+0000","last_undegraded":"2024-09-21T09:13:34.482527+0000","last_fullsized":"2024-09-21T09:13:34.482527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:40.827746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956508+0000","last_change":"2024-09-21T09:11:00.841164+0000","last_active":"2024-09-21T09:13:34.956508+0000","last_peered":"2024-09-21T09:13:34.956508+0000","last_clean":"2024-09-21T09:13:34.956508+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:13:34.956508+0000","last_undegraded":"2024-09-21T09:13:34.956508+0000","last_fullsized":"2024-09-21T09:13:34.956508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:05.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"71'23","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957641+0000","last_change":"2024-09-21T09:11:02.852292+0000","last_active":"2024-09-21T09:13:34.957641+0000","last_peered":"2024-09-21T09:13:34.957641+0000","last_clean":"2024-09-21T09:13:34.957641+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:13:34.957641+0000","last_undegraded":"2024-09-21T09:13:34.957641+0000","last_fullsized":"2024-09-21T09:13:34.957641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:12.322229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"91'102","reported_seq":297,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042645+0000","last_change":"2024-09-21T09:11:04.892391+0000","last_active":"2024-09-21T09:13:36.042645+0000","last_peered":"2024-09-21T09:13:36.042645+0000","last_clean":"2024-09-21T09:13:36.042645+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:13:36.042645+0000","last_undegraded":"2024-09-21T09:13:36.042645+0000","last_fullsized":"2024-09-21T09:13:36.042645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:52.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293567+0000","last_change":"2024-09-21T09:11:06.883898+0000","last_active":"2024-09-21T09:13:34.293567+0000","last_peered":"2024-09-21T09:13:34.293567+0000","last_clean":"2024-09-21T09:13:34.293567+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:13:34.293567+0000","last_undegraded":"2024-09-21T09:13:34.293567+0000","last_fullsized":"2024-09-21T09:13:34.293567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298809+0000","last_change":"2024-09-21T09:13:20.217794+0000","last_active":"2024-09-21T09:13:34.298809+0000","last_peered":"2024-09-21T09:13:34.298809+0000","last_clean":"2024-09-21T09:13:34.298809+0000","last_became_active":"2024-09-21T09:13:19.161819+0000","last_became_peered":"2024-09-21T09:13:19.161819+0000","last_unstale":"2024-09-21T09:13:34.298809+0000","last_undegraded":"2024-09-21T09:13:34.298809+0000","last_fullsized":"2024-09-21T09:13:34.298809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:41.176970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"67'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482438+0000","last_change":"2024-09-21T09:10:56.844590+0000","last_active":"2024-09-21T09:13:34.482438+0000","last_peered":"2024-09-21T09:13:34.482438+0000","last_clean":"2024-09-21T09:13:34.482438+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:13:34.482438+0000","last_undegraded":"2024-09-21T09:13:34.482438+0000","last_fullsized":"2024-09-21T09:13:34.482438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:20.839825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":268,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528244+0000","last_change":"2024-09-21T09:11:00.839056+0000","last_active":"2024-09-21T09:13:35.528244+0000","last_peered":"2024-09-21T09:13:35.528244+0000","last_clean":"2024-09-21T09:13:35.528244+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:13:35.528244+0000","last_undegraded":"2024-09-21T09:13:35.528244+0000","last_fullsized":"2024-09-21T09:13:35.528244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:07.991734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"65'11","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294566+0000","last_change":"2024-09-21T09:11:02.876439+0000","last_active":"2024-09-21T09:13:34.294566+0000","last_peered":"2024-09-21T09:13:34.294566+0000","last_clean":"2024-09-21T09:13:34.294566+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:13:34.294566+0000","last_undegraded":"2024-09-21T09:13:34.294566+0000","last_fullsized":"2024-09-21T09:13:34.294566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"91'102","reported_seq":311,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042974+0000","last_change":"2024-09-21T09:11:04.884790+0000","last_active":"2024-09-21T09:13:36.042974+0000","last_peered":"2024-09-21T09:13:36.042974+0000","last_clean":"2024-09-21T09:13:36.042974+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:13:36.042974+0000","last_undegraded":"2024-09-21T09:13:36.042974+0000","last_fullsized":"2024-09-21T09:13:36.042974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:00.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294059+0000","last_change":"2024-09-21T09:13:19.158996+0000","last_active":"2024-09-21T09:13:34.294059+0000","last_peered":"2024-09-21T09:13:34.294059+0000","last_clean":"2024-09-21T09:13:34.294059+0000","last_became_active":"2024-09-21T09:13:19.139533+0000","last_became_peered":"2024-09-21T09:13:19.139533+0000","last_unstale":"2024-09-21T09:13:34.294059+0000","last_undegraded":"2024-09-21T09:13:34.294059+0000","last_fullsized":"2024-09-21T09:13:34.294059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:03.695046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527899+0000","last_change":"2024-09-21T09:10:58.873730+0000","last_active":"2024-09-21T09:13:34.527899+0000","last_peered":"2024-09-21T09:13:34.527899+0000","last_clean":"2024-09-21T09:13:34.527899+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:13:34.527899+0000","last_undegraded":"2024-09-21T09:13:34.527899+0000","last_fullsized":"2024-09-21T09:13:34.527899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"67'2","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377281+0000","last_change":"2024-09-21T09:10:56.849104+0000","last_active":"2024-09-21T09:13:35.377281+0000","last_peered":"2024-09-21T09:13:35.377281+0000","last_clean":"2024-09-21T09:13:35.377281+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:13:35.377281+0000","last_undegraded":"2024-09-21T09:13:35.377281+0000","last_fullsized":"2024-09-21T09:13:35.377281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:34.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483039+0000","last_change":"2024-09-21T09:11:00.841893+0000","last_active":"2024-09-21T09:13:34.483039+0000","last_peered":"2024-09-21T09:13:34.483039+0000","last_clean":"2024-09-21T09:13:34.483039+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:13:34.483039+0000","last_undegraded":"2024-09-21T09:13:34.483039+0000","last_fullsized":"2024-09-21T09:13:34.483039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:55.253483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"71'23","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528948+0000","last_change":"2024-09-21T09:11:02.867833+0000","last_active":"2024-09-21T09:13:35.528948+0000","last_peered":"2024-09-21T09:13:35.528948+0000","last_clean":"2024-09-21T09:13:35.528948+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:13:35.528948+0000","last_undegraded":"2024-09-21T09:13:35.528948+0000","last_fullsized":"2024-09-21T09:13:35.528948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298750+0000","last_change":"2024-09-21T09:13:19.166139+0000","last_active":"2024-09-21T09:13:34.298750+0000","last_peered":"2024-09-21T09:13:34.298750+0000","last_clean":"2024-09-21T09:13:34.298750+0000","last_became_active":"2024-09-21T09:13:19.164969+0000","last_became_peered":"2024-09-21T09:13:19.164969+0000","last_unstale":"2024-09-21T09:13:34.298750+0000","last_undegraded":"2024-09-21T09:13:34.298750+0000","last_fullsized":"2024-09-21T09:13:34.298750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:05.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"62'12","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526114+0000","last_change":"2024-09-21T09:11:06.883751+0000","last_active":"2024-09-21T09:13:34.526114+0000","last_peered":"2024-09-21T09:13:34.526114+0000","last_clean":"2024-09-21T09:13:34.526114+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:13:34.526114+0000","last_undegraded":"2024-09-21T09:13:34.526114+0000","last_fullsized":"2024-09-21T09:13:34.526114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:09.296705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482855+0000","last_change":"2024-09-21T09:10:58.838888+0000","last_active":"2024-09-21T09:13:34.482855+0000","last_peered":"2024-09-21T09:13:34.482855+0000","last_clean":"2024-09-21T09:13:34.482855+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:13:34.482855+0000","last_undegraded":"2024-09-21T09:13:34.482855+0000","last_fullsized":"2024-09-21T09:13:34.482855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:53.547541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":304,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527650+0000","last_change":"2024-09-21T09:10:44.726458+0000","last_active":"2024-09-21T09:13:35.527650+0000","last_peered":"2024-09-21T09:13:35.527650+0000","last_clean":"2024-09-21T09:13:35.527650+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:13:35.527650+0000","last_undegraded":"2024-09-21T09:13:35.527650+0000","last_fullsized":"2024-09-21T09:13:35.527650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_clean_scrub_stamp":"2024-09-21T09:10:43.702491+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:07.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482574+0000","last_change":"2024-09-21T09:13:20.381044+0000","last_active":"2024-09-21T09:13:34.482574+0000","last_peered":"2024-09-21T09:13:34.482574+0000","last_clean":"2024-09-21T09:13:34.482574+0000","last_became_active":"2024-09-21T09:13:19.155065+0000","last_became_peered":"2024-09-21T09:13:19.155065+0000","last_unstale":"2024-09-21T09:13:34.482574+0000","last_undegraded":"2024-09-21T09:13:34.482574+0000","last_fullsized":"2024-09-21T09:13:34.482574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:51.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":204,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375084+0000","last_change":"2024-09-21T09:13:19.483993+0000","last_active":"2024-09-21T09:13:35.375084+0000","last_peered":"2024-09-21T09:13:35.375084+0000","last_clean":"2024-09-21T09:13:35.375084+0000","last_became_active":"2024-09-21T09:13:19.152677+0000","last_became_peered":"2024-09-21T09:13:19.152677+0000","last_unstale":"2024-09-21T09:13:35.375084+0000","last_undegraded":"2024-09-21T09:13:35.375084+0000","last_fullsized":"2024-09-21T09:13:35.375084+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:26.411630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:11:00.845448+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"71'33","reported_seq":175,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483133+0000","last_change":"2024-09-21T09:11:02.863275+0000","last_active":"2024-09-21T09:13:34.483133+0000","last_peered":"2024-09-21T09:13:34.483133+0000","last_clean":"2024-09-21T09:13:34.483133+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:13:34.483133+0000","last_undegraded":"2024-09-21T09:13:34.483133+0000","last_fullsized":"2024-09-21T09:13:34.483133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:39.968749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4873,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957584+0000","last_change":"2024-09-21T09:11:04.894538+0000","last_active":"2024-09-21T09:13:34.957584+0000","last_peered":"2024-09-21T09:13:34.957584+0000","last_clean":"2024-09-21T09:13:34.957584+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:13:34.957584+0000","last_undegraded":"2024-09-21T09:13:34.957584+0000","last_fullsized":"2024-09-21T09:13:34.957584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.154030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"71'6","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294223+0000","last_change":"2024-09-21T09:13:19.487021+0000","last_active":"2024-09-21T09:13:34.294223+0000","last_peered":"2024-09-21T09:13:34.294223+0000","last_clean":"2024-09-21T09:13:34.294223+0000","last_became_active":"2024-09-21T09:13:19.153438+0000","last_became_peered":"2024-09-21T09:13:19.153438+0000","last_unstale":"2024-09-21T09:13:34.294223+0000","last_undegraded":"2024-09-21T09:13:34.294223+0000","last_fullsized":"2024-09-21T09:13:34.294223+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:22.759172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":422,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957786+0000","last_change":"2024-09-21T09:10:58.855489+0000","last_active":"2024-09-21T09:13:34.957786+0000","last_peered":"2024-09-21T09:13:34.957786+0000","last_clean":"2024-09-21T09:13:34.957786+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:13:34.957786+0000","last_undegraded":"2024-09-21T09:13:34.957786+0000","last_fullsized":"2024-09-21T09:13:34.957786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:04.859633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482280+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:13:34.482280+0000","last_peered":"2024-09-21T09:13:34.482280+0000","last_clean":"2024-09-21T09:13:34.482280+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:13:34.482280+0000","last_undegraded":"2024-09-21T09:13:34.482280+0000","last_fullsized":"2024-09-21T09:13:34.482280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:09.405380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"66'7","reported_seq":188,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294349+0000","last_change":"2024-09-21T09:13:19.304956+0000","last_active":"2024-09-21T09:13:34.294349+0000","last_peered":"2024-09-21T09:13:34.294349+0000","last_clean":"2024-09-21T09:13:34.294349+0000","last_became_active":"2024-09-21T09:13:19.142666+0000","last_became_peered":"2024-09-21T09:13:19.142666+0000","last_unstale":"2024-09-21T09:13:34.294349+0000","last_undegraded":"2024-09-21T09:13:34.294349+0000","last_fullsized":"2024-09-21T09:13:34.294349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:08.103741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483007+0000","last_change":"2024-09-21T09:11:00.845917+0000","last_active":"2024-09-21T09:13:34.483007+0000","last_peered":"2024-09-21T09:13:34.483007+0000","last_clean":"2024-09-21T09:13:34.483007+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:13:34.483007+0000","last_undegraded":"2024-09-21T09:13:34.483007+0000","last_fullsized":"2024-09-21T09:13:34.483007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:59.152254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"91'109","reported_seq":320,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042404+0000","last_change":"2024-09-21T09:11:02.871422+0000","last_active":"2024-09-21T09:13:36.042404+0000","last_peered":"2024-09-21T09:13:36.042404+0000","last_clean":"2024-09-21T09:13:36.042404+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:13:36.042404+0000","last_undegraded":"2024-09-21T09:13:36.042404+0000","last_fullsized":"2024-09-21T09:13:36.042404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:57.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61997,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":28,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483210+0000","last_change":"2024-09-21T09:11:04.893734+0000","last_active":"2024-09-21T09:13:34.483210+0000","last_peered":"2024-09-21T09:13:34.483210+0000","last_clean":"2024-09-21T09:13:34.483210+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:34.483210+0000","last_undegraded":"2024-09-21T09:13:34.483210+0000","last_fullsized":"2024-09-21T09:13:34.483210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.709917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"58'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955754+0000","last_change":"2024-09-21T09:11:06.895362+0000","last_active":"2024-09-21T09:13:34.955754+0000","last_peered":"2024-09-21T09:13:34.955754+0000","last_clean":"2024-09-21T09:13:34.955754+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:13:34.955754+0000","last_undegraded":"2024-09-21T09:13:34.955754+0000","last_fullsized":"2024-09-21T09:13:34.955754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:23.606134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:10:58.831552+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526089+0000","last_change":"2024-09-21T09:10:51.587265+0000","last_active":"2024-09-21T09:13:34.526089+0000","last_peered":"2024-09-21T09:13:34.526089+0000","last_clean":"2024-09-21T09:13:34.526089+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:13:34.526089+0000","last_undegraded":"2024-09-21T09:13:34.526089+0000","last_fullsized":"2024-09-21T09:13:34.526089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"66'11","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955635+0000","last_change":"2024-09-21T09:10:56.866005+0000","last_active":"2024-09-21T09:13:34.955635+0000","last_peered":"2024-09-21T09:13:34.955635+0000","last_clean":"2024-09-21T09:13:34.955635+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:13:34.955635+0000","last_undegraded":"2024-09-21T09:13:34.955635+0000","last_fullsized":"2024-09-21T09:13:34.955635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527710+0000","last_change":"2024-09-21T09:11:00.850206+0000","last_active":"2024-09-21T09:13:34.527710+0000","last_peered":"2024-09-21T09:13:34.527710+0000","last_clean":"2024-09-21T09:13:34.527710+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:13:34.527710+0000","last_undegraded":"2024-09-21T09:13:34.527710+0000","last_fullsized":"2024-09-21T09:13:34.527710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:26.137691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"91'16","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042418+0000","last_change":"2024-09-21T09:11:02.873117+0000","last_active":"2024-09-21T09:13:36.042418+0000","last_peered":"2024-09-21T09:13:36.042418+0000","last_clean":"2024-09-21T09:13:36.042418+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:13:36.042418+0000","last_undegraded":"2024-09-21T09:13:36.042418+0000","last_fullsized":"2024-09-21T09:13:36.042418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376851+0000","last_change":"2024-09-21T09:11:04.873369+0000","last_active":"2024-09-21T09:13:35.376851+0000","last_peered":"2024-09-21T09:13:35.376851+0000","last_clean":"2024-09-21T09:13:35.376851+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:13:35.376851+0000","last_undegraded":"2024-09-21T09:13:35.376851+0000","last_fullsized":"2024-09-21T09:13:35.376851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.868816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375992+0000","last_change":"2024-09-21T09:11:06.896298+0000","last_active":"2024-09-21T09:13:35.375992+0000","last_peered":"2024-09-21T09:13:35.375992+0000","last_clean":"2024-09-21T09:13:35.375992+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:13:35.375992+0000","last_undegraded":"2024-09-21T09:13:35.375992+0000","last_fullsized":"2024-09-21T09:13:35.375992+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:42.784843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"58'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:58.838558+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482642+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:13:34.482642+0000","last_peered":"2024-09-21T09:13:34.482642+0000","last_clean":"2024-09-21T09:13:34.482642+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:13:34.482642+0000","last_undegraded":"2024-09-21T09:13:34.482642+0000","last_fullsized":"2024-09-21T09:13:34.482642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:07.894252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"66'7","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296736+0000","last_change":"2024-09-21T09:13:20.378657+0000","last_active":"2024-09-21T09:13:34.296736+0000","last_peered":"2024-09-21T09:13:34.296736+0000","last_clean":"2024-09-21T09:13:34.296736+0000","last_became_active":"2024-09-21T09:13:19.153710+0000","last_became_peered":"2024-09-21T09:13:19.153710+0000","last_unstale":"2024-09-21T09:13:34.296736+0000","last_undegraded":"2024-09-21T09:13:34.296736+0000","last_fullsized":"2024-09-21T09:13:34.296736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526975+0000","last_change":"2024-09-21T09:11:00.852944+0000","last_active":"2024-09-21T09:13:34.526975+0000","last_peered":"2024-09-21T09:13:34.526975+0000","last_clean":"2024-09-21T09:13:34.526975+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:13:34.526975+0000","last_undegraded":"2024-09-21T09:13:34.526975+0000","last_fullsized":"2024-09-21T09:13:34.526975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:24.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.954874+0000","last_change":"2024-09-21T09:11:02.856485+0000","last_active":"2024-09-21T09:13:34.954874+0000","last_peered":"2024-09-21T09:13:34.954874+0000","last_clean":"2024-09-21T09:13:34.954874+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:13:34.954874+0000","last_undegraded":"2024-09-21T09:13:34.954874+0000","last_fullsized":"2024-09-21T09:13:34.954874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:05.267197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483296+0000","last_change":"2024-09-21T09:11:04.880602+0000","last_active":"2024-09-21T09:13:34.483296+0000","last_peered":"2024-09-21T09:13:34.483296+0000","last_clean":"2024-09-21T09:13:34.483296+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:13:34.483296+0000","last_undegraded":"2024-09-21T09:13:34.483296+0000","last_fullsized":"2024-09-21T09:13:34.483296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:56.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"62'4","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526697+0000","last_change":"2024-09-21T09:11:06.869065+0000","last_active":"2024-09-21T09:13:35.526697+0000","last_peered":"2024-09-21T09:13:35.526697+0000","last_clean":"2024-09-21T09:13:35.526697+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:13:35.526697+0000","last_undegraded":"2024-09-21T09:13:35.526697+0000","last_fullsized":"2024-09-21T09:13:35.526697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:28.667296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"71'12","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294295+0000","last_change":"2024-09-21T09:10:58.846835+0000","last_active":"2024-09-21T09:13:34.294295+0000","last_peered":"2024-09-21T09:13:34.294295+0000","last_clean":"2024-09-21T09:13:34.294295+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:13:34.294295+0000","last_undegraded":"2024-09-21T09:13:34.294295+0000","last_fullsized":"2024-09-21T09:13:34.294295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"66'10","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299651+0000","last_change":"2024-09-21T09:13:19.380704+0000","last_active":"2024-09-21T09:13:34.299651+0000","last_peered":"2024-09-21T09:13:34.299651+0000","last_clean":"2024-09-21T09:13:34.299651+0000","last_became_active":"2024-09-21T09:13:19.142534+0000","last_became_peered":"2024-09-21T09:13:19.142534+0000","last_unstale":"2024-09-21T09:13:34.299651+0000","last_undegraded":"2024-09-21T09:13:34.299651+0000","last_fullsized":"2024-09-21T09:13:34.299651+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957216+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:13:34.957216+0000","last_peered":"2024-09-21T09:13:34.957216+0000","last_clean":"2024-09-21T09:13:34.957216+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:13:34.957216+0000","last_undegraded":"2024-09-21T09:13:34.957216+0000","last_fullsized":"2024-09-21T09:13:34.957216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377768+0000","last_change":"2024-09-21T09:11:00.855241+0000","last_active":"2024-09-21T09:13:35.377768+0000","last_peered":"2024-09-21T09:13:35.377768+0000","last_clean":"2024-09-21T09:13:35.377768+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:13:35.377768+0000","last_undegraded":"2024-09-21T09:13:35.377768+0000","last_fullsized":"2024-09-21T09:13:35.377768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:56:14.401301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"71'30","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525679+0000","last_change":"2024-09-21T09:11:02.864623+0000","last_active":"2024-09-21T09:13:34.525679+0000","last_peered":"2024-09-21T09:13:34.525679+0000","last_clean":"2024-09-21T09:13:34.525679+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:13:34.525679+0000","last_undegraded":"2024-09-21T09:13:34.525679+0000","last_fullsized":"2024-09-21T09:13:34.525679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:12.141735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297500+0000","last_change":"2024-09-21T09:13:19.146039+0000","last_active":"2024-09-21T09:13:34.297500+0000","last_peered":"2024-09-21T09:13:34.297500+0000","last_clean":"2024-09-21T09:13:34.297500+0000","last_became_active":"2024-09-21T09:13:19.145677+0000","last_became_peered":"2024-09-21T09:13:19.145677+0000","last_unstale":"2024-09-21T09:13:34.297500+0000","last_undegraded":"2024-09-21T09:13:34.297500+0000","last_fullsized":"2024-09-21T09:13:34.297500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:04.909499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"62'4","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957412+0000","last_change":"2024-09-21T09:11:06.896833+0000","last_active":"2024-09-21T09:13:34.957412+0000","last_peered":"2024-09-21T09:13:34.957412+0000","last_clean":"2024-09-21T09:13:34.957412+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:13:34.957412+0000","last_undegraded":"2024-09-21T09:13:34.957412+0000","last_fullsized":"2024-09-21T09:13:34.957412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:38.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"61'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294846+0000","last_change":"2024-09-21T09:10:58.825808+0000","last_active":"2024-09-21T09:13:34.294846+0000","last_peered":"2024-09-21T09:13:34.294846+0000","last_clean":"2024-09-21T09:13:34.294846+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:13:34.294846+0000","last_undegraded":"2024-09-21T09:13:34.294846+0000","last_fullsized":"2024-09-21T09:13:34.294846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"67'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295613+0000","last_change":"2024-09-21T09:10:56.851643+0000","last_active":"2024-09-21T09:13:34.295613+0000","last_peered":"2024-09-21T09:13:34.295613+0000","last_clean":"2024-09-21T09:13:34.295613+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:13:34.295613+0000","last_undegraded":"2024-09-21T09:13:34.295613+0000","last_fullsized":"2024-09-21T09:13:34.295613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482740+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:13:34.482740+0000","last_peered":"2024-09-21T09:13:34.482740+0000","last_clean":"2024-09-21T09:13:34.482740+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:13:34.482740+0000","last_undegraded":"2024-09-21T09:13:34.482740+0000","last_fullsized":"2024-09-21T09:13:34.482740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:24.356684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295776+0000","last_change":"2024-09-21T09:11:00.847115+0000","last_active":"2024-09-21T09:13:34.295776+0000","last_peered":"2024-09-21T09:13:34.295776+0000","last_clean":"2024-09-21T09:13:34.295776+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:13:34.295776+0000","last_undegraded":"2024-09-21T09:13:34.295776+0000","last_fullsized":"2024-09-21T09:13:34.295776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:55.012417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293962+0000","last_change":"2024-09-21T09:11:02.862921+0000","last_active":"2024-09-21T09:13:34.293962+0000","last_peered":"2024-09-21T09:13:34.293962+0000","last_clean":"2024-09-21T09:13:34.293962+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:13:34.293962+0000","last_undegraded":"2024-09-21T09:13:34.293962+0000","last_fullsized":"2024-09-21T09:13:34.293962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"91'102","reported_seq":263,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042964+0000","last_change":"2024-09-21T09:11:04.894220+0000","last_active":"2024-09-21T09:13:36.042964+0000","last_peered":"2024-09-21T09:13:36.042964+0000","last_clean":"2024-09-21T09:13:36.042964+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:13:36.042964+0000","last_undegraded":"2024-09-21T09:13:36.042964+0000","last_fullsized":"2024-09-21T09:13:36.042964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:07.285264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527292+0000","last_change":"2024-09-21T09:11:06.881113+0000","last_active":"2024-09-21T09:13:34.527292+0000","last_peered":"2024-09-21T09:13:34.527292+0000","last_clean":"2024-09-21T09:13:34.527292+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:13:34.527292+0000","last_undegraded":"2024-09-21T09:13:34.527292+0000","last_fullsized":"2024-09-21T09:13:34.527292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376991+0000","last_change":"2024-09-21T09:10:58.868894+0000","last_active":"2024-09-21T09:13:35.376991+0000","last_peered":"2024-09-21T09:13:35.376991+0000","last_clean":"2024-09-21T09:13:35.376991+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:13:35.376991+0000","last_undegraded":"2024-09-21T09:13:35.376991+0000","last_fullsized":"2024-09-21T09:13:35.376991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:41.448227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"66'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378658+0000","last_change":"2024-09-21T09:10:56.853201+0000","last_active":"2024-09-21T09:13:35.378658+0000","last_peered":"2024-09-21T09:13:35.378658+0000","last_clean":"2024-09-21T09:13:35.378658+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:13:35.378658+0000","last_undegraded":"2024-09-21T09:13:35.378658+0000","last_fullsized":"2024-09-21T09:13:35.378658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:58.587669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378974+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:13:35.378974+0000","last_peered":"2024-09-21T09:13:35.378974+0000","last_clean":"2024-09-21T09:13:35.378974+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:13:35.378974+0000","last_undegraded":"2024-09-21T09:13:35.378974+0000","last_fullsized":"2024-09-21T09:13:35.378974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:03.383843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:11:00.850095+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:17.456402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"62'11","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482326+0000","last_change":"2024-09-21T09:11:02.853229+0000","last_active":"2024-09-21T09:13:34.482326+0000","last_peered":"2024-09-21T09:13:34.482326+0000","last_clean":"2024-09-21T09:13:34.482326+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:13:34.482326+0000","last_undegraded":"2024-09-21T09:13:34.482326+0000","last_fullsized":"2024-09-21T09:13:34.482326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:25.468451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"91'106","reported_seq":287,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042491+0000","last_change":"2024-09-21T09:13:22.165756+0000","last_active":"2024-09-21T09:13:36.042491+0000","last_peered":"2024-09-21T09:13:36.042491+0000","last_clean":"2024-09-21T09:13:36.042491+0000","last_became_active":"2024-09-21T09:13:22.164964+0000","last_became_peered":"2024-09-21T09:13:22.164964+0000","last_unstale":"2024-09-21T09:13:36.042491+0000","last_undegraded":"2024-09-21T09:13:36.042491+0000","last_fullsized":"2024-09-21T09:13:36.042491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:18.044791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"62'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956097+0000","last_change":"2024-09-21T09:11:06.887900+0000","last_active":"2024-09-21T09:13:34.956097+0000","last_peered":"2024-09-21T09:13:34.956097+0000","last_clean":"2024-09-21T09:13:34.956097+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:13:34.956097+0000","last_undegraded":"2024-09-21T09:13:34.956097+0000","last_fullsized":"2024-09-21T09:13:34.956097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:03.433485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297268+0000","last_change":"2024-09-21T09:13:19.160539+0000","last_active":"2024-09-21T09:13:34.297268+0000","last_peered":"2024-09-21T09:13:34.297268+0000","last_clean":"2024-09-21T09:13:34.297268+0000","last_became_active":"2024-09-21T09:13:19.158513+0000","last_became_peered":"2024-09-21T09:13:19.158513+0000","last_unstale":"2024-09-21T09:13:34.297268+0000","last_undegraded":"2024-09-21T09:13:34.297268+0000","last_fullsized":"2024-09-21T09:13:34.297268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:56.953433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"66'6","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378711+0000","last_change":"2024-09-21T09:10:56.849803+0000","last_active":"2024-09-21T09:13:35.378711+0000","last_peered":"2024-09-21T09:13:35.378711+0000","last_clean":"2024-09-21T09:13:35.378711+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:13:35.378711+0000","last_undegraded":"2024-09-21T09:13:35.378711+0000","last_fullsized":"2024-09-21T09:13:35.378711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:47.709157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483413+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:13:34.483413+0000","last_peered":"2024-09-21T09:13:34.483413+0000","last_clean":"2024-09-21T09:13:34.483413+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:13:34.483413+0000","last_undegraded":"2024-09-21T09:13:34.483413+0000","last_fullsized":"2024-09-21T09:13:34.483413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:33.465317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.374990+0000","last_change":"2024-09-21T09:13:19.154303+0000","last_active":"2024-09-21T09:13:35.374990+0000","last_peered":"2024-09-21T09:13:35.374990+0000","last_clean":"2024-09-21T09:13:35.374990+0000","last_became_active":"2024-09-21T09:13:19.152735+0000","last_became_peered":"2024-09-21T09:13:19.152735+0000","last_unstale":"2024-09-21T09:13:35.374990+0000","last_undegraded":"2024-09-21T09:13:35.374990+0000","last_fullsized":"2024-09-21T09:13:35.374990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:24.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"71'37","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295954+0000","last_change":"2024-09-21T09:11:02.856720+0000","last_active":"2024-09-21T09:13:34.295954+0000","last_peered":"2024-09-21T09:13:34.295954+0000","last_clean":"2024-09-21T09:13:34.295954+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:13:34.295954+0000","last_undegraded":"2024-09-21T09:13:34.295954+0000","last_fullsized":"2024-09-21T09:13:34.295954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376998+0000","last_change":"2024-09-21T09:11:04.872979+0000","last_active":"2024-09-21T09:13:35.376998+0000","last_peered":"2024-09-21T09:13:35.376998+0000","last_clean":"2024-09-21T09:13:35.376998+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:13:35.376998+0000","last_undegraded":"2024-09-21T09:13:35.376998+0000","last_fullsized":"2024-09-21T09:13:35.376998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:17.499450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"71'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299731+0000","last_change":"2024-09-21T09:13:19.169497+0000","last_active":"2024-09-21T09:13:34.299731+0000","last_peered":"2024-09-21T09:13:34.299731+0000","last_clean":"2024-09-21T09:13:34.299731+0000","last_became_active":"2024-09-21T09:13:19.140926+0000","last_became_peered":"2024-09-21T09:13:19.140926+0000","last_unstale":"2024-09-21T09:13:34.299731+0000","last_undegraded":"2024-09-21T09:13:34.299731+0000","last_fullsized":"2024-09-21T09:13:34.299731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:44.853024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":426,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377317+0000","last_change":"2024-09-21T09:11:06.900571+0000","last_active":"2024-09-21T09:13:35.377317+0000","last_peered":"2024-09-21T09:13:35.377317+0000","last_clean":"2024-09-21T09:13:35.377317+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:13:35.377317+0000","last_undegraded":"2024-09-21T09:13:35.377317+0000","last_fullsized":"2024-09-21T09:13:35.377317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:40.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295838+0000","last_change":"2024-09-21T09:13:19.531538+0000","last_active":"2024-09-21T09:13:34.295838+0000","last_peered":"2024-09-21T09:13:34.295838+0000","last_clean":"2024-09-21T09:13:34.295838+0000","last_became_active":"2024-09-21T09:13:19.158305+0000","last_became_peered":"2024-09-21T09:13:19.158305+0000","last_unstale":"2024-09-21T09:13:34.295838+0000","last_undegraded":"2024-09-21T09:13:34.295838+0000","last_fullsized":"2024-09-21T09:13:34.295838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:10.110896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"66'8","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482868+0000","last_change":"2024-09-21T09:13:21.278992+0000","last_active":"2024-09-21T09:13:34.482868+0000","last_peered":"2024-09-21T09:13:34.482868+0000","last_clean":"2024-09-21T09:13:34.482868+0000","last_became_active":"2024-09-21T09:13:19.168562+0000","last_became_peered":"2024-09-21T09:13:19.168562+0000","last_unstale":"2024-09-21T09:13:34.482868+0000","last_undegraded":"2024-09-21T09:13:34.482868+0000","last_fullsized":"2024-09-21T09:13:34.482868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:29.147931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294332+0000","last_change":"2024-09-21T09:11:00.839217+0000","last_active":"2024-09-21T09:13:34.294332+0000","last_peered":"2024-09-21T09:13:34.294332+0000","last_clean":"2024-09-21T09:13:34.294332+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:13:34.294332+0000","last_undegraded":"2024-09-21T09:13:34.294332+0000","last_fullsized":"2024-09-21T09:13:34.294332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:23.833810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"71'18","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293754+0000","last_change":"2024-09-21T09:11:02.872614+0000","last_active":"2024-09-21T09:13:34.293754+0000","last_peered":"2024-09-21T09:13:34.293754+0000","last_clean":"2024-09-21T09:13:34.293754+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:13:34.293754+0000","last_undegraded":"2024-09-21T09:13:34.293754+0000","last_fullsized":"2024-09-21T09:13:34.293754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525609+0000","last_change":"2024-09-21T09:11:04.882308+0000","last_active":"2024-09-21T09:13:34.525609+0000","last_peered":"2024-09-21T09:13:34.525609+0000","last_clean":"2024-09-21T09:13:34.525609+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:13:34.525609+0000","last_undegraded":"2024-09-21T09:13:34.525609+0000","last_fullsized":"2024-09-21T09:13:34.525609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:42.301147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"61'16","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527236+0000","last_change":"2024-09-21T09:11:06.892382+0000","last_active":"2024-09-21T09:13:34.527236+0000","last_peered":"2024-09-21T09:13:34.527236+0000","last_clean":"2024-09-21T09:13:34.527236+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:13:34.527236+0000","last_undegraded":"2024-09-21T09:13:34.527236+0000","last_fullsized":"2024-09-21T09:13:34.527236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:20.449346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"62'6","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376845+0000","last_change":"2024-09-21T09:10:58.869150+0000","last_active":"2024-09-21T09:13:35.376845+0000","last_peered":"2024-09-21T09:13:35.376845+0000","last_clean":"2024-09-21T09:13:35.376845+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:13:35.376845+0000","last_undegraded":"2024-09-21T09:13:35.376845+0000","last_fullsized":"2024-09-21T09:13:35.376845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:58.386210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"66'9","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298150+0000","last_change":"2024-09-21T09:10:56.854764+0000","last_active":"2024-09-21T09:13:34.298150+0000","last_peered":"2024-09-21T09:13:34.298150+0000","last_clean":"2024-09-21T09:13:34.298150+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:13:34.298150+0000","last_undegraded":"2024-09-21T09:13:34.298150+0000","last_fullsized":"2024-09-21T09:13:34.298150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376855+0000","last_change":"2024-09-21T09:11:00.839265+0000","last_active":"2024-09-21T09:13:35.376855+0000","last_peered":"2024-09-21T09:13:35.376855+0000","last_clean":"2024-09-21T09:13:35.376855+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:13:35.376855+0000","last_undegraded":"2024-09-21T09:13:35.376855+0000","last_fullsized":"2024-09-21T09:13:35.376855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:14.524942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"45'5","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375333+0000","last_change":"2024-09-21T09:13:20.848665+0000","last_active":"2024-09-21T09:13:35.375333+0000","last_peered":"2024-09-21T09:13:35.375333+0000","last_clean":"2024-09-21T09:13:35.375333+0000","last_became_active":"2024-09-21T09:13:19.154000+0000","last_became_peered":"2024-09-21T09:13:19.154000+0000","last_unstale":"2024-09-21T09:13:35.375333+0000","last_undegraded":"2024-09-21T09:13:35.375333+0000","last_fullsized":"2024-09-21T09:13:35.375333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:40.242838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297539+0000","last_change":"2024-09-21T09:13:19.160157+0000","last_active":"2024-09-21T09:13:34.297539+0000","last_peered":"2024-09-21T09:13:34.297539+0000","last_clean":"2024-09-21T09:13:34.297539+0000","last_became_active":"2024-09-21T09:13:19.157523+0000","last_became_peered":"2024-09-21T09:13:19.157523+0000","last_unstale":"2024-09-21T09:13:34.297539+0000","last_undegraded":"2024-09-21T09:13:34.297539+0000","last_fullsized":"2024-09-21T09:13:34.297539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:07.414777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294790+0000","last_change":"2024-09-21T09:11:06.879042+0000","last_active":"2024-09-21T09:13:34.294790+0000","last_peered":"2024-09-21T09:13:34.294790+0000","last_clean":"2024-09-21T09:13:34.294790+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:13:34.294790+0000","last_undegraded":"2024-09-21T09:13:34.294790+0000","last_fullsized":"2024-09-21T09:13:34.294790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:34.670949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377778+0000","last_change":"2024-09-21T09:10:58.864481+0000","last_active":"2024-09-21T09:13:35.377778+0000","last_peered":"2024-09-21T09:13:35.377778+0000","last_clean":"2024-09-21T09:13:35.377778+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:13:35.377778+0000","last_undegraded":"2024-09-21T09:13:35.377778+0000","last_fullsized":"2024-09-21T09:13:35.377778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:33.405020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"67'12","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298309+0000","last_change":"2024-09-21T09:13:20.071816+0000","last_active":"2024-09-21T09:13:34.298309+0000","last_peered":"2024-09-21T09:13:34.298309+0000","last_clean":"2024-09-21T09:13:34.298309+0000","last_became_active":"2024-09-21T09:13:19.160370+0000","last_became_peered":"2024-09-21T09:13:19.160370+0000","last_unstale":"2024-09-21T09:13:34.298309+0000","last_undegraded":"2024-09-21T09:13:34.298309+0000","last_fullsized":"2024-09-21T09:13:34.298309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:13.089799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292818+0000","last_change":"2024-09-21T09:13:19.145601+0000","last_active":"2024-09-21T09:13:34.292818+0000","last_peered":"2024-09-21T09:13:34.292818+0000","last_clean":"2024-09-21T09:13:34.292818+0000","last_became_active":"2024-09-21T09:13:19.142672+0000","last_became_peered":"2024-09-21T09:13:19.142672+0000","last_unstale":"2024-09-21T09:13:34.292818+0000","last_undegraded":"2024-09-21T09:13:34.292818+0000","last_fullsized":"2024-09-21T09:13:34.292818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.000309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"71'17","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526668+0000","last_change":"2024-09-21T09:11:02.869796+0000","last_active":"2024-09-21T09:13:34.526668+0000","last_peered":"2024-09-21T09:13:34.526668+0000","last_clean":"2024-09-21T09:13:34.526668+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:13:34.526668+0000","last_undegraded":"2024-09-21T09:13:34.526668+0000","last_fullsized":"2024-09-21T09:13:34.526668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:48.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528134+0000","last_change":"2024-09-21T09:11:04.893727+0000","last_active":"2024-09-21T09:13:35.528134+0000","last_peered":"2024-09-21T09:13:35.528134+0000","last_clean":"2024-09-21T09:13:35.528134+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:35.528134+0000","last_undegraded":"2024-09-21T09:13:35.528134+0000","last_fullsized":"2024-09-21T09:13:35.528134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:18.437905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"71'7","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482678+0000","last_change":"2024-09-21T09:13:21.128242+0000","last_active":"2024-09-21T09:13:34.482678+0000","last_peered":"2024-09-21T09:13:34.482678+0000","last_clean":"2024-09-21T09:13:34.482678+0000","last_became_active":"2024-09-21T09:13:19.167169+0000","last_became_peered":"2024-09-21T09:13:19.167169+0000","last_unstale":"2024-09-21T09:13:34.482678+0000","last_undegraded":"2024-09-21T09:13:34.482678+0000","last_fullsized":"2024-09-21T09:13:34.482678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:46.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526036+0000","last_change":"2024-09-21T09:10:58.859005+0000","last_active":"2024-09-21T09:13:34.526036+0000","last_peered":"2024-09-21T09:13:34.526036+0000","last_clean":"2024-09-21T09:13:34.526036+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:13:34.526036+0000","last_undegraded":"2024-09-21T09:13:34.526036+0000","last_fullsized":"2024-09-21T09:13:34.526036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:38.110596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"66'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958780+0000","last_change":"2024-09-21T09:10:56.860416+0000","last_active":"2024-09-21T09:13:34.958780+0000","last_peered":"2024-09-21T09:13:34.958780+0000","last_clean":"2024-09-21T09:13:34.958780+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:13:34.958780+0000","last_undegraded":"2024-09-21T09:13:34.958780+0000","last_fullsized":"2024-09-21T09:13:34.958780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:48.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482021+0000","last_change":"2024-09-21T09:13:19.153082+0000","last_active":"2024-09-21T09:13:34.482021+0000","last_peered":"2024-09-21T09:13:34.482021+0000","last_clean":"2024-09-21T09:13:34.482021+0000","last_became_active":"2024-09-21T09:13:19.152722+0000","last_became_peered":"2024-09-21T09:13:19.152722+0000","last_unstale":"2024-09-21T09:13:34.482021+0000","last_undegraded":"2024-09-21T09:13:34.482021+0000","last_fullsized":"2024-09-21T09:13:34.482021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:26.550403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"71'16","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295783+0000","last_change":"2024-09-21T09:11:02.872950+0000","last_active":"2024-09-21T09:13:34.295783+0000","last_peered":"2024-09-21T09:13:34.295783+0000","last_clean":"2024-09-21T09:13:34.295783+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:13:34.295783+0000","last_undegraded":"2024-09-21T09:13:34.295783+0000","last_fullsized":"2024-09-21T09:13:34.295783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526197+0000","last_change":"2024-09-21T09:13:19.144593+0000","last_active":"2024-09-21T09:13:34.526197+0000","last_peered":"2024-09-21T09:13:34.526197+0000","last_clean":"2024-09-21T09:13:34.526197+0000","last_became_active":"2024-09-21T09:13:19.143577+0000","last_became_peered":"2024-09-21T09:13:19.143577+0000","last_unstale":"2024-09-21T09:13:34.526197+0000","last_undegraded":"2024-09-21T09:13:34.526197+0000","last_fullsized":"2024-09-21T09:13:34.526197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:02.985464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483155+0000","last_change":"2024-09-21T09:10:58.839092+0000","last_active":"2024-09-21T09:13:34.483155+0000","last_peered":"2024-09-21T09:13:34.483155+0000","last_clean":"2024-09-21T09:13:34.483155+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:13:34.483155+0000","last_undegraded":"2024-09-21T09:13:34.483155+0000","last_fullsized":"2024-09-21T09:13:34.483155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:02.458655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"66'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956457+0000","last_change":"2024-09-21T09:10:56.865435+0000","last_active":"2024-09-21T09:13:34.956457+0000","last_peered":"2024-09-21T09:13:34.956457+0000","last_clean":"2024-09-21T09:13:34.956457+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:13:34.956457+0000","last_undegraded":"2024-09-21T09:13:34.956457+0000","last_fullsized":"2024-09-21T09:13:34.956457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295267+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.295267+0000","last_peered":"2024-09-21T09:13:34.295267+0000","last_clean":"2024-09-21T09:13:34.295267+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:13:34.295267+0000","last_undegraded":"2024-09-21T09:13:34.295267+0000","last_fullsized":"2024-09-21T09:13:34.295267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:10.134818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"71'24","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294966+0000","last_change":"2024-09-21T09:11:02.879895+0000","last_active":"2024-09-21T09:13:34.294966+0000","last_peered":"2024-09-21T09:13:34.294966+0000","last_clean":"2024-09-21T09:13:34.294966+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:13:34.294966+0000","last_undegraded":"2024-09-21T09:13:34.294966+0000","last_fullsized":"2024-09-21T09:13:34.294966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298886+0000","last_change":"2024-09-21T09:13:19.166381+0000","last_active":"2024-09-21T09:13:34.298886+0000","last_peered":"2024-09-21T09:13:34.298886+0000","last_clean":"2024-09-21T09:13:34.298886+0000","last_became_active":"2024-09-21T09:13:19.165859+0000","last_became_peered":"2024-09-21T09:13:19.165859+0000","last_unstale":"2024-09-21T09:13:34.298886+0000","last_undegraded":"2024-09-21T09:13:34.298886+0000","last_fullsized":"2024-09-21T09:13:34.298886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:20.747731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957270+0000","last_change":"2024-09-21T09:11:06.896002+0000","last_active":"2024-09-21T09:13:34.957270+0000","last_peered":"2024-09-21T09:13:34.957270+0000","last_clean":"2024-09-21T09:13:34.957270+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:13:34.957270+0000","last_undegraded":"2024-09-21T09:13:34.957270+0000","last_fullsized":"2024-09-21T09:13:34.957270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:01.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"71'10","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378657+0000","last_change":"2024-09-21T09:10:58.868892+0000","last_active":"2024-09-21T09:13:35.378657+0000","last_peered":"2024-09-21T09:13:35.378657+0000","last_clean":"2024-09-21T09:13:35.378657+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:13:35.378657+0000","last_undegraded":"2024-09-21T09:13:35.378657+0000","last_fullsized":"2024-09-21T09:13:35.378657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"66'5","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377535+0000","last_change":"2024-09-21T09:10:56.827351+0000","last_active":"2024-09-21T09:13:35.377535+0000","last_peered":"2024-09-21T09:13:35.377535+0000","last_clean":"2024-09-21T09:13:35.377535+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:13:35.377535+0000","last_undegraded":"2024-09-21T09:13:35.377535+0000","last_fullsized":"2024-09-21T09:13:35.377535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:49.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298002+0000","last_change":"2024-09-21T09:13:19.159092+0000","last_active":"2024-09-21T09:13:34.298002+0000","last_peered":"2024-09-21T09:13:34.298002+0000","last_clean":"2024-09-21T09:13:34.298002+0000","last_became_active":"2024-09-21T09:13:19.158652+0000","last_became_peered":"2024-09-21T09:13:19.158652+0000","last_unstale":"2024-09-21T09:13:34.298002+0000","last_undegraded":"2024-09-21T09:13:34.298002+0000","last_fullsized":"2024-09-21T09:13:34.298002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:32.340994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"71'22","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482767+0000","last_change":"2024-09-21T09:13:21.165572+0000","last_active":"2024-09-21T09:13:34.482767+0000","last_peered":"2024-09-21T09:13:34.482767+0000","last_clean":"2024-09-21T09:13:34.482767+0000","last_became_active":"2024-09-21T09:13:19.167344+0000","last_became_peered":"2024-09-21T09:13:19.167344+0000","last_unstale":"2024-09-21T09:13:34.482767+0000","last_undegraded":"2024-09-21T09:13:34.482767+0000","last_fullsized":"2024-09-21T09:13:34.482767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:05.930094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956457+0000","last_change":"2024-09-21T09:11:04.890782+0000","last_active":"2024-09-21T09:13:34.956457+0000","last_peered":"2024-09-21T09:13:34.956457+0000","last_clean":"2024-09-21T09:13:34.956457+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:13:34.956457+0000","last_undegraded":"2024-09-21T09:13:34.956457+0000","last_fullsized":"2024-09-21T09:13:34.956457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:42.740558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"71'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482532+0000","last_change":"2024-09-21T09:11:06.889510+0000","last_active":"2024-09-21T09:13:34.482532+0000","last_peered":"2024-09-21T09:13:34.482532+0000","last_clean":"2024-09-21T09:13:34.482532+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:13:34.482532+0000","last_undegraded":"2024-09-21T09:13:34.482532+0000","last_fullsized":"2024-09-21T09:13:34.482532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:38.377418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527248+0000","last_change":"2024-09-21T09:10:58.854750+0000","last_active":"2024-09-21T09:13:34.527248+0000","last_peered":"2024-09-21T09:13:34.527248+0000","last_clean":"2024-09-21T09:13:34.527248+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:13:34.527248+0000","last_undegraded":"2024-09-21T09:13:34.527248+0000","last_fullsized":"2024-09-21T09:13:34.527248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.559151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"67'10","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528620+0000","last_change":"2024-09-21T09:10:56.863198+0000","last_active":"2024-09-21T09:13:35.528620+0000","last_peered":"2024-09-21T09:13:35.528620+0000","last_clean":"2024-09-21T09:13:35.528620+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:13:35.528620+0000","last_undegraded":"2024-09-21T09:13:35.528620+0000","last_fullsized":"2024-09-21T09:13:35.528620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298158+0000","last_change":"2024-09-21T09:13:20.592162+0000","last_active":"2024-09-21T09:13:34.298158+0000","last_peered":"2024-09-21T09:13:34.298158+0000","last_clean":"2024-09-21T09:13:34.298158+0000","last_became_active":"2024-09-21T09:13:19.165929+0000","last_became_peered":"2024-09-21T09:13:19.165929+0000","last_unstale":"2024-09-21T09:13:34.298158+0000","last_undegraded":"2024-09-21T09:13:34.298158+0000","last_fullsized":"2024-09-21T09:13:34.298158+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:41.372526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"71'17","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295570+0000","last_change":"2024-09-21T09:11:02.879188+0000","last_active":"2024-09-21T09:13:34.295570+0000","last_peered":"2024-09-21T09:13:34.295570+0000","last_clean":"2024-09-21T09:13:34.295570+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:13:34.295570+0000","last_undegraded":"2024-09-21T09:13:34.295570+0000","last_fullsized":"2024-09-21T09:13:34.295570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:37.208901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527107+0000","last_change":"2024-09-21T09:11:04.880786+0000","last_active":"2024-09-21T09:13:34.527107+0000","last_peered":"2024-09-21T09:13:34.527107+0000","last_clean":"2024-09-21T09:13:34.527107+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:13:34.527107+0000","last_undegraded":"2024-09-21T09:13:34.527107+0000","last_fullsized":"2024-09-21T09:13:34.527107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:54.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"62'10","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481914+0000","last_change":"2024-09-21T09:11:06.898517+0000","last_active":"2024-09-21T09:13:34.481914+0000","last_peered":"2024-09-21T09:13:34.481914+0000","last_clean":"2024-09-21T09:13:34.481914+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:13:34.481914+0000","last_undegraded":"2024-09-21T09:13:34.481914+0000","last_fullsized":"2024-09-21T09:13:34.481914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:46.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":39,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377669+0000","last_change":"2024-09-21T09:10:58.868807+0000","last_active":"2024-09-21T09:13:35.377669+0000","last_peered":"2024-09-21T09:13:35.377669+0000","last_clean":"2024-09-21T09:13:35.377669+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:13:35.377669+0000","last_undegraded":"2024-09-21T09:13:35.377669+0000","last_fullsized":"2024-09-21T09:13:35.377669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.574650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"67'12","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378764+0000","last_change":"2024-09-21T09:10:56.851205+0000","last_active":"2024-09-21T09:13:35.378764+0000","last_peered":"2024-09-21T09:13:35.378764+0000","last_clean":"2024-09-21T09:13:35.378764+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:13:35.378764+0000","last_undegraded":"2024-09-21T09:13:35.378764+0000","last_fullsized":"2024-09-21T09:13:35.378764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:52.423650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377224+0000","last_change":"2024-09-21T09:11:00.856830+0000","last_active":"2024-09-21T09:13:35.377224+0000","last_peered":"2024-09-21T09:13:35.377224+0000","last_clean":"2024-09-21T09:13:35.377224+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:13:35.377224+0000","last_undegraded":"2024-09-21T09:13:35.377224+0000","last_fullsized":"2024-09-21T09:13:35.377224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:45.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"74'14","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483000+0000","last_change":"2024-09-21T09:13:21.153990+0000","last_active":"2024-09-21T09:13:34.483000+0000","last_peered":"2024-09-21T09:13:34.483000+0000","last_clean":"2024-09-21T09:13:34.483000+0000","last_became_active":"2024-09-21T09:13:19.167321+0000","last_became_peered":"2024-09-21T09:13:19.167321+0000","last_unstale":"2024-09-21T09:13:34.483000+0000","last_undegraded":"2024-09-21T09:13:34.483000+0000","last_fullsized":"2024-09-21T09:13:34.483000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:34.649177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"91'102","reported_seq":271,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042397+0000","last_change":"2024-09-21T09:11:04.870463+0000","last_active":"2024-09-21T09:13:36.042397+0000","last_peered":"2024-09-21T09:13:36.042397+0000","last_clean":"2024-09-21T09:13:36.042397+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:13:36.042397+0000","last_undegraded":"2024-09-21T09:13:36.042397+0000","last_fullsized":"2024-09-21T09:13:36.042397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:30.495090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"58'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481854+0000","last_change":"2024-09-21T09:11:06.883550+0000","last_active":"2024-09-21T09:13:34.481854+0000","last_peered":"2024-09-21T09:13:34.481854+0000","last_clean":"2024-09-21T09:13:34.481854+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:13:34.481854+0000","last_undegraded":"2024-09-21T09:13:34.481854+0000","last_fullsized":"2024-09-21T09:13:34.481854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:56.825424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"71'10","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296041+0000","last_change":"2024-09-21T09:13:19.537524+0000","last_active":"2024-09-21T09:13:34.296041+0000","last_peered":"2024-09-21T09:13:34.296041+0000","last_clean":"2024-09-21T09:13:34.296041+0000","last_became_active":"2024-09-21T09:13:19.159904+0000","last_became_peered":"2024-09-21T09:13:19.159904+0000","last_unstale":"2024-09-21T09:13:34.296041+0000","last_undegraded":"2024-09-21T09:13:34.296041+0000","last_fullsized":"2024-09-21T09:13:34.296041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:12.531734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"67'12","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529250+0000","last_change":"2024-09-21T09:10:56.852586+0000","last_active":"2024-09-21T09:13:35.529250+0000","last_peered":"2024-09-21T09:13:35.529250+0000","last_clean":"2024-09-21T09:13:35.529250+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:13:35.529250+0000","last_undegraded":"2024-09-21T09:13:35.529250+0000","last_fullsized":"2024-09-21T09:13:35.529250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528271+0000","last_change":"2024-09-21T09:11:00.839800+0000","last_active":"2024-09-21T09:13:35.528271+0000","last_peered":"2024-09-21T09:13:35.528271+0000","last_clean":"2024-09-21T09:13:35.528271+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:13:35.528271+0000","last_undegraded":"2024-09-21T09:13:35.528271+0000","last_fullsized":"2024-09-21T09:13:35.528271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:21.140377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"71'22","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293383+0000","last_change":"2024-09-21T09:11:02.857087+0000","last_active":"2024-09-21T09:13:34.293383+0000","last_peered":"2024-09-21T09:13:34.293383+0000","last_clean":"2024-09-21T09:13:34.293383+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:13:34.293383+0000","last_undegraded":"2024-09-21T09:13:34.293383+0000","last_fullsized":"2024-09-21T09:13:34.293383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376271+0000","last_change":"2024-09-21T09:11:04.872303+0000","last_active":"2024-09-21T09:13:35.376271+0000","last_peered":"2024-09-21T09:13:35.376271+0000","last_clean":"2024-09-21T09:13:35.376271+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:13:35.376271+0000","last_undegraded":"2024-09-21T09:13:35.376271+0000","last_fullsized":"2024-09-21T09:13:35.376271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.517451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"71'10","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527841+0000","last_change":"2024-09-21T09:11:06.873636+0000","last_active":"2024-09-21T09:13:35.527841+0000","last_peered":"2024-09-21T09:13:35.527841+0000","last_clean":"2024-09-21T09:13:35.527841+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:13:35.527841+0000","last_undegraded":"2024-09-21T09:13:35.527841+0000","last_fullsized":"2024-09-21T09:13:35.527841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:52.693664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293210+0000","last_change":"2024-09-21T09:13:19.144377+0000","last_active":"2024-09-21T09:13:34.293210+0000","last_peered":"2024-09-21T09:13:34.293210+0000","last_clean":"2024-09-21T09:13:34.293210+0000","last_became_active":"2024-09-21T09:13:19.143746+0000","last_became_peered":"2024-09-21T09:13:19.143746+0000","last_unstale":"2024-09-21T09:13:34.293210+0000","last_undegraded":"2024-09-21T09:13:34.293210+0000","last_fullsized":"2024-09-21T09:13:34.293210+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:48.781954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"67'15","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482960+0000","last_change":"2024-09-21T09:11:34.170912+0000","last_active":"2024-09-21T09:13:34.482960+0000","last_peered":"2024-09-21T09:13:34.482960+0000","last_clean":"2024-09-21T09:13:34.482960+0000","last_became_active":"2024-09-21T09:11:34.170599+0000","last_became_peered":"2024-09-21T09:11:34.170599+0000","last_unstale":"2024-09-21T09:13:34.482960+0000","last_undegraded":"2024-09-21T09:13:34.482960+0000","last_fullsized":"2024-09-21T09:13:34.482960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296362+0000","last_change":"2024-09-21T09:13:19.144365+0000","last_active":"2024-09-21T09:13:34.296362+0000","last_peered":"2024-09-21T09:13:34.296362+0000","last_clean":"2024-09-21T09:13:34.296362+0000","last_became_active":"2024-09-21T09:13:19.141404+0000","last_became_peered":"2024-09-21T09:13:19.141404+0000","last_unstale":"2024-09-21T09:13:34.296362+0000","last_undegraded":"2024-09-21T09:13:34.296362+0000","last_fullsized":"2024-09-21T09:13:34.296362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:05.438476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"71'16","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376621+0000","last_change":"2024-09-21T09:11:02.847926+0000","last_active":"2024-09-21T09:13:35.376621+0000","last_peered":"2024-09-21T09:13:35.376621+0000","last_clean":"2024-09-21T09:13:35.376621+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:13:35.376621+0000","last_undegraded":"2024-09-21T09:13:35.376621+0000","last_fullsized":"2024-09-21T09:13:35.376621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:15.592269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482045+0000","last_change":"2024-09-21T09:11:04.880866+0000","last_active":"2024-09-21T09:13:34.482045+0000","last_peered":"2024-09-21T09:13:34.482045+0000","last_clean":"2024-09-21T09:13:34.482045+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:13:34.482045+0000","last_undegraded":"2024-09-21T09:13:34.482045+0000","last_fullsized":"2024-09-21T09:13:34.482045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:02.568576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957411+0000","last_change":"2024-09-21T09:11:06.899493+0000","last_active":"2024-09-21T09:13:34.957411+0000","last_peered":"2024-09-21T09:13:34.957411+0000","last_clean":"2024-09-21T09:13:34.957411+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:13:34.957411+0000","last_undegraded":"2024-09-21T09:13:34.957411+0000","last_fullsized":"2024-09-21T09:13:34.957411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:50.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525954+0000","last_change":"2024-09-21T09:10:58.856310+0000","last_active":"2024-09-21T09:13:34.525954+0000","last_peered":"2024-09-21T09:13:34.525954+0000","last_clean":"2024-09-21T09:13:34.525954+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:13:34.525954+0000","last_undegraded":"2024-09-21T09:13:34.525954+0000","last_fullsized":"2024-09-21T09:13:34.525954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:12.549438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"66'11","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958076+0000","last_change":"2024-09-21T09:13:20.628384+0000","last_active":"2024-09-21T09:13:34.958076+0000","last_peered":"2024-09-21T09:13:34.958076+0000","last_clean":"2024-09-21T09:13:34.958076+0000","last_became_active":"2024-09-21T09:13:19.169569+0000","last_became_peered":"2024-09-21T09:13:19.169569+0000","last_unstale":"2024-09-21T09:13:34.958076+0000","last_undegraded":"2024-09-21T09:13:34.958076+0000","last_fullsized":"2024-09-21T09:13:34.958076+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:00.389819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526949+0000","last_change":"2024-09-21T09:11:00.837141+0000","last_active":"2024-09-21T09:13:35.526949+0000","last_peered":"2024-09-21T09:13:35.526949+0000","last_clean":"2024-09-21T09:13:35.526949+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:13:35.526949+0000","last_undegraded":"2024-09-21T09:13:35.526949+0000","last_fullsized":"2024-09-21T09:13:35.526949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"71'11","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294478+0000","last_change":"2024-09-21T09:13:20.076515+0000","last_active":"2024-09-21T09:13:34.294478+0000","last_peered":"2024-09-21T09:13:34.294478+0000","last_clean":"2024-09-21T09:13:34.294478+0000","last_became_active":"2024-09-21T09:13:19.150207+0000","last_became_peered":"2024-09-21T09:13:19.150207+0000","last_unstale":"2024-09-21T09:13:34.294478+0000","last_undegraded":"2024-09-21T09:13:34.294478+0000","last_fullsized":"2024-09-21T09:13:34.294478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482052+0000","last_change":"2024-09-21T09:11:04.887172+0000","last_active":"2024-09-21T09:13:34.482052+0000","last_peered":"2024-09-21T09:13:34.482052+0000","last_clean":"2024-09-21T09:13:34.482052+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:13:34.482052+0000","last_undegraded":"2024-09-21T09:13:34.482052+0000","last_fullsized":"2024-09-21T09:13:34.482052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:01.250555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482536+0000","last_change":"2024-09-21T09:13:19.157682+0000","last_active":"2024-09-21T09:13:34.482536+0000","last_peered":"2024-09-21T09:13:34.482536+0000","last_clean":"2024-09-21T09:13:34.482536+0000","last_became_active":"2024-09-21T09:13:19.157306+0000","last_became_peered":"2024-09-21T09:13:19.157306+0000","last_unstale":"2024-09-21T09:13:34.482536+0000","last_undegraded":"2024-09-21T09:13:34.482536+0000","last_fullsized":"2024-09-21T09:13:34.482536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.786122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292810+0000","last_change":"2024-09-21T09:13:19.713138+0000","last_active":"2024-09-21T09:13:34.292810+0000","last_peered":"2024-09-21T09:13:34.292810+0000","last_clean":"2024-09-21T09:13:34.292810+0000","last_became_active":"2024-09-21T09:13:19.161496+0000","last_became_peered":"2024-09-21T09:13:19.161496+0000","last_unstale":"2024-09-21T09:13:34.292810+0000","last_undegraded":"2024-09-21T09:13:34.292810+0000","last_fullsized":"2024-09-21T09:13:34.292810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:42.440821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"61'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958517+0000","last_change":"2024-09-21T09:10:56.861373+0000","last_active":"2024-09-21T09:13:34.958517+0000","last_peered":"2024-09-21T09:13:34.958517+0000","last_clean":"2024-09-21T09:13:34.958517+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:13:34.958517+0000","last_undegraded":"2024-09-21T09:13:34.958517+0000","last_fullsized":"2024-09-21T09:13:34.958517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:45.846021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376270+0000","last_change":"2024-09-21T09:11:00.838647+0000","last_active":"2024-09-21T09:13:35.376270+0000","last_peered":"2024-09-21T09:13:35.376270+0000","last_clean":"2024-09-21T09:13:35.376270+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:13:35.376270+0000","last_undegraded":"2024-09-21T09:13:35.376270+0000","last_fullsized":"2024-09-21T09:13:35.376270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:16.279789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"71'17","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482115+0000","last_change":"2024-09-21T09:11:02.877357+0000","last_active":"2024-09-21T09:13:34.482115+0000","last_peered":"2024-09-21T09:13:34.482115+0000","last_clean":"2024-09-21T09:13:34.482115+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:13:34.482115+0000","last_undegraded":"2024-09-21T09:13:34.482115+0000","last_fullsized":"2024-09-21T09:13:34.482115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:46.845302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67351,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378889+0000","last_change":"2024-09-21T09:11:04.896698+0000","last_active":"2024-09-21T09:13:35.378889+0000","last_peered":"2024-09-21T09:13:35.378889+0000","last_clean":"2024-09-21T09:13:35.378889+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:13:35.378889+0000","last_undegraded":"2024-09-21T09:13:35.378889+0000","last_fullsized":"2024-09-21T09:13:35.378889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:59.924890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297318+0000","last_change":"2024-09-21T09:13:20.646926+0000","last_active":"2024-09-21T09:13:34.297318+0000","last_peered":"2024-09-21T09:13:34.297318+0000","last_clean":"2024-09-21T09:13:34.297318+0000","last_became_active":"2024-09-21T09:13:19.153765+0000","last_became_peered":"2024-09-21T09:13:19.153765+0000","last_unstale":"2024-09-21T09:13:34.297318+0000","last_undegraded":"2024-09-21T09:13:34.297318+0000","last_fullsized":"2024-09-21T09:13:34.297318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'6","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378620+0000","last_change":"2024-09-21T09:10:58.865842+0000","last_active":"2024-09-21T09:13:35.378620+0000","last_peered":"2024-09-21T09:13:35.378620+0000","last_clean":"2024-09-21T09:13:35.378620+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:13:35.378620+0000","last_undegraded":"2024-09-21T09:13:35.378620+0000","last_fullsized":"2024-09-21T09:13:35.378620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:10.069785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"66'7","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293255+0000","last_change":"2024-09-21T09:13:19.522324+0000","last_active":"2024-09-21T09:13:34.293255+0000","last_peered":"2024-09-21T09:13:34.293255+0000","last_clean":"2024-09-21T09:13:34.293255+0000","last_became_active":"2024-09-21T09:13:19.143052+0000","last_became_peered":"2024-09-21T09:13:19.143052+0000","last_unstale":"2024-09-21T09:13:34.293255+0000","last_undegraded":"2024-09-21T09:13:34.293255+0000","last_fullsized":"2024-09-21T09:13:34.293255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:36.362618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"71'8","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527890+0000","last_change":"2024-09-21T09:10:58.871267+0000","last_active":"2024-09-21T09:13:34.527890+0000","last_peered":"2024-09-21T09:13:34.527890+0000","last_clean":"2024-09-21T09:13:34.527890+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:13:34.527890+0000","last_undegraded":"2024-09-21T09:13:34.527890+0000","last_fullsized":"2024-09-21T09:13:34.527890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"66'8","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525789+0000","last_change":"2024-09-21T09:10:56.847914+0000","last_active":"2024-09-21T09:13:34.525789+0000","last_peered":"2024-09-21T09:13:34.525789+0000","last_clean":"2024-09-21T09:13:34.525789+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:13:34.525789+0000","last_undegraded":"2024-09-21T09:13:34.525789+0000","last_fullsized":"2024-09-21T09:13:34.525789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482765+0000","last_change":"2024-09-21T09:10:58.837841+0000","last_active":"2024-09-21T09:13:34.482765+0000","last_peered":"2024-09-21T09:13:34.482765+0000","last_clean":"2024-09-21T09:13:34.482765+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:13:34.482765+0000","last_undegraded":"2024-09-21T09:13:34.482765+0000","last_fullsized":"2024-09-21T09:13:34.482765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:54.101397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"67'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482421+0000","last_change":"2024-09-21T09:10:56.861995+0000","last_active":"2024-09-21T09:13:34.482421+0000","last_peered":"2024-09-21T09:13:34.482421+0000","last_clean":"2024-09-21T09:13:34.482421+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:13:34.482421+0000","last_undegraded":"2024-09-21T09:13:34.482421+0000","last_fullsized":"2024-09-21T09:13:34.482421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:44.655482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"58'4","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957038+0000","last_change":"2024-09-21T09:13:20.835461+0000","last_active":"2024-09-21T09:13:34.957038+0000","last_peered":"2024-09-21T09:13:34.957038+0000","last_clean":"2024-09-21T09:13:34.957038+0000","last_became_active":"2024-09-21T09:13:19.169698+0000","last_became_peered":"2024-09-21T09:13:19.169698+0000","last_unstale":"2024-09-21T09:13:34.957038+0000","last_undegraded":"2024-09-21T09:13:34.957038+0000","last_fullsized":"2024-09-21T09:13:34.957038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:00.406380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"62'6","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955827+0000","last_change":"2024-09-21T09:10:56.866139+0000","last_active":"2024-09-21T09:13:34.955827+0000","last_peered":"2024-09-21T09:13:34.955827+0000","last_clean":"2024-09-21T09:13:34.955827+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:13:34.955827+0000","last_undegraded":"2024-09-21T09:13:34.955827+0000","last_fullsized":"2024-09-21T09:13:34.955827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:33.551996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"58'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956535+0000","last_change":"2024-09-21T09:10:58.840408+0000","last_active":"2024-09-21T09:13:34.956535+0000","last_peered":"2024-09-21T09:13:34.956535+0000","last_clean":"2024-09-21T09:13:34.956535+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:13:34.956535+0000","last_undegraded":"2024-09-21T09:13:34.956535+0000","last_fullsized":"2024-09-21T09:13:34.956535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:42.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"66'8","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295479+0000","last_change":"2024-09-21T09:10:56.860054+0000","last_active":"2024-09-21T09:13:34.295479+0000","last_peered":"2024-09-21T09:13:34.295479+0000","last_clean":"2024-09-21T09:13:34.295479+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:13:34.295479+0000","last_undegraded":"2024-09-21T09:13:34.295479+0000","last_fullsized":"2024-09-21T09:13:34.295479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296113+0000","last_change":"2024-09-21T09:10:58.836500+0000","last_active":"2024-09-21T09:13:34.296113+0000","last_peered":"2024-09-21T09:13:34.296113+0000","last_clean":"2024-09-21T09:13:34.296113+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:13:34.296113+0000","last_undegraded":"2024-09-21T09:13:34.296113+0000","last_fullsized":"2024-09-21T09:13:34.296113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"66'8","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295940+0000","last_change":"2024-09-21T09:10:56.862765+0000","last_active":"2024-09-21T09:13:34.295940+0000","last_peered":"2024-09-21T09:13:34.295940+0000","last_clean":"2024-09-21T09:13:34.295940+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:13:34.295940+0000","last_undegraded":"2024-09-21T09:13:34.295940+0000","last_fullsized":"2024-09-21T09:13:34.295940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"62'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294186+0000","last_change":"2024-09-21T09:10:58.826466+0000","last_active":"2024-09-21T09:13:34.294186+0000","last_peered":"2024-09-21T09:13:34.294186+0000","last_clean":"2024-09-21T09:13:34.294186+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:13:34.294186+0000","last_undegraded":"2024-09-21T09:13:34.294186+0000","last_fullsized":"2024-09-21T09:13:34.294186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"66'9","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299107+0000","last_change":"2024-09-21T09:13:20.211974+0000","last_active":"2024-09-21T09:13:34.299107+0000","last_peered":"2024-09-21T09:13:34.299107+0000","last_clean":"2024-09-21T09:13:34.299107+0000","last_became_active":"2024-09-21T09:13:19.161214+0000","last_became_peered":"2024-09-21T09:13:19.161214+0000","last_unstale":"2024-09-21T09:13:34.299107+0000","last_undegraded":"2024-09-21T09:13:34.299107+0000","last_fullsized":"2024-09-21T09:13:34.299107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:40:58.281738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"62'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527446+0000","last_change":"2024-09-21T09:10:58.872072+0000","last_active":"2024-09-21T09:13:35.527446+0000","last_peered":"2024-09-21T09:13:35.527446+0000","last_clean":"2024-09-21T09:13:35.527446+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:13:35.527446+0000","last_undegraded":"2024-09-21T09:13:35.527446+0000","last_fullsized":"2024-09-21T09:13:35.527446+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"67'9","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958252+0000","last_change":"2024-09-21T09:10:56.861072+0000","last_active":"2024-09-21T09:13:34.958252+0000","last_peered":"2024-09-21T09:13:34.958252+0000","last_clean":"2024-09-21T09:13:34.958252+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:13:34.958252+0000","last_undegraded":"2024-09-21T09:13:34.958252+0000","last_fullsized":"2024-09-21T09:13:34.958252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527799+0000","last_change":"2024-09-21T09:10:58.856982+0000","last_active":"2024-09-21T09:13:34.527799+0000","last_peered":"2024-09-21T09:13:34.527799+0000","last_clean":"2024-09-21T09:13:34.527799+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:13:34.527799+0000","last_undegraded":"2024-09-21T09:13:34.527799+0000","last_fullsized":"2024-09-21T09:13:34.527799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"66'7","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482177+0000","last_change":"2024-09-21T09:10:56.847793+0000","last_active":"2024-09-21T09:13:34.482177+0000","last_peered":"2024-09-21T09:13:34.482177+0000","last_clean":"2024-09-21T09:13:34.482177+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:13:34.482177+0000","last_undegraded":"2024-09-21T09:13:34.482177+0000","last_fullsized":"2024-09-21T09:13:34.482177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:22.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"62'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298133+0000","last_change":"2024-09-21T09:10:58.851481+0000","last_active":"2024-09-21T09:13:34.298133+0000","last_peered":"2024-09-21T09:13:34.298133+0000","last_clean":"2024-09-21T09:13:34.298133+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:13:34.298133+0000","last_undegraded":"2024-09-21T09:13:34.298133+0000","last_fullsized":"2024-09-21T09:13:34.298133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:42.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"67'12","reported_seq":215,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956033+0000","last_change":"2024-09-21T09:13:20.068227+0000","last_active":"2024-09-21T09:13:34.956033+0000","last_peered":"2024-09-21T09:13:34.956033+0000","last_clean":"2024-09-21T09:13:34.956033+0000","last_became_active":"2024-09-21T09:13:19.169480+0000","last_became_peered":"2024-09-21T09:13:19.169480+0000","last_unstale":"2024-09-21T09:13:34.956033+0000","last_undegraded":"2024-09-21T09:13:34.956033+0000","last_fullsized":"2024-09-21T09:13:34.956033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:08.928533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957005+0000","last_change":"2024-09-21T09:10:58.843673+0000","last_active":"2024-09-21T09:13:34.957005+0000","last_peered":"2024-09-21T09:13:34.957005+0000","last_clean":"2024-09-21T09:13:34.957005+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:13:34.957005+0000","last_undegraded":"2024-09-21T09:13:34.957005+0000","last_fullsized":"2024-09-21T09:13:34.957005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:19.133330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"67'6","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528514+0000","last_change":"2024-09-21T09:10:56.838835+0000","last_active":"2024-09-21T09:13:35.528514+0000","last_peered":"2024-09-21T09:13:35.528514+0000","last_clean":"2024-09-21T09:13:35.528514+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:13:35.528514+0000","last_undegraded":"2024-09-21T09:13:35.528514+0000","last_fullsized":"2024-09-21T09:13:35.528514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529034+0000","last_change":"2024-09-21T09:10:58.869168+0000","last_active":"2024-09-21T09:13:35.529034+0000","last_peered":"2024-09-21T09:13:35.529034+0000","last_clean":"2024-09-21T09:13:35.529034+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:13:35.529034+0000","last_undegraded":"2024-09-21T09:13:35.529034+0000","last_fullsized":"2024-09-21T09:13:35.529034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"66'13","reported_seq":222,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375170+0000","last_change":"2024-09-21T09:13:20.275872+0000","last_active":"2024-09-21T09:13:35.375170+0000","last_peered":"2024-09-21T09:13:35.375170+0000","last_clean":"2024-09-21T09:13:35.375170+0000","last_became_active":"2024-09-21T09:13:19.153073+0000","last_became_peered":"2024-09-21T09:13:19.153073+0000","last_unstale":"2024-09-21T09:13:35.375170+0000","last_undegraded":"2024-09-21T09:13:35.375170+0000","last_fullsized":"2024-09-21T09:13:35.375170+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:51.699749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526744+0000","last_change":"2024-09-21T09:10:58.840930+0000","last_active":"2024-09-21T09:13:35.526744+0000","last_peered":"2024-09-21T09:13:35.526744+0000","last_clean":"2024-09-21T09:13:35.526744+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:13:35.526744+0000","last_undegraded":"2024-09-21T09:13:35.526744+0000","last_fullsized":"2024-09-21T09:13:35.526744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"67'13","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297144+0000","last_change":"2024-09-21T09:10:56.841366+0000","last_active":"2024-09-21T09:13:34.297144+0000","last_peered":"2024-09-21T09:13:34.297144+0000","last_clean":"2024-09-21T09:13:34.297144+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:13:34.297144+0000","last_undegraded":"2024-09-21T09:13:34.297144+0000","last_fullsized":"2024-09-21T09:13:34.297144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:15.948479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526167+0000","last_change":"2024-09-21T09:10:58.873865+0000","last_active":"2024-09-21T09:13:34.526167+0000","last_peered":"2024-09-21T09:13:34.526167+0000","last_clean":"2024-09-21T09:13:34.526167+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:13:34.526167+0000","last_undegraded":"2024-09-21T09:13:34.526167+0000","last_fullsized":"2024-09-21T09:13:34.526167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"67'5","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482963+0000","last_change":"2024-09-21T09:10:56.843359+0000","last_active":"2024-09-21T09:13:34.482963+0000","last_peered":"2024-09-21T09:13:34.482963+0000","last_clean":"2024-09-21T09:13:34.482963+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:13:34.482963+0000","last_undegraded":"2024-09-21T09:13:34.482963+0000","last_fullsized":"2024-09-21T09:13:34.482963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:17.126175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"71'4","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377059+0000","last_change":"2024-09-21T09:10:58.864268+0000","last_active":"2024-09-21T09:13:35.377059+0000","last_peered":"2024-09-21T09:13:35.377059+0000","last_clean":"2024-09-21T09:13:35.377059+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:13:35.377059+0000","last_undegraded":"2024-09-21T09:13:35.377059+0000","last_fullsized":"2024-09-21T09:13:35.377059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:22.929821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"66'10","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.528171+0000","last_change":"2024-09-21T09:13:19.704634+0000","last_active":"2024-09-21T09:13:34.528171+0000","last_peered":"2024-09-21T09:13:34.528171+0000","last_clean":"2024-09-21T09:13:34.528171+0000","last_became_active":"2024-09-21T09:13:19.159408+0000","last_became_peered":"2024-09-21T09:13:19.159408+0000","last_unstale":"2024-09-21T09:13:34.528171+0000","last_undegraded":"2024-09-21T09:13:34.528171+0000","last_fullsized":"2024-09-21T09:13:34.528171+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:49.771475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527340+0000","last_change":"2024-09-21T09:10:58.840040+0000","last_active":"2024-09-21T09:13:35.527340+0000","last_peered":"2024-09-21T09:13:35.527340+0000","last_clean":"2024-09-21T09:13:35.527340+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:13:35.527340+0000","last_undegraded":"2024-09-21T09:13:35.527340+0000","last_fullsized":"2024-09-21T09:13:35.527340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"66'11","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483406+0000","last_change":"2024-09-21T09:10:56.845828+0000","last_active":"2024-09-21T09:13:34.483406+0000","last_peered":"2024-09-21T09:13:34.483406+0000","last_clean":"2024-09-21T09:13:34.483406+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:13:34.483406+0000","last_undegraded":"2024-09-21T09:13:34.483406+0000","last_fullsized":"2024-09-21T09:13:34.483406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:37.489093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"67'8","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:13:20.828458+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:13:19.155182+0000","last_became_peered":"2024-09-21T09:13:19.155182+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:34.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378422+0000","last_change":"2024-09-21T09:10:58.871879+0000","last_active":"2024-09-21T09:13:35.378422+0000","last_peered":"2024-09-21T09:13:35.378422+0000","last_clean":"2024-09-21T09:13:35.378422+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:13:35.378422+0000","last_undegraded":"2024-09-21T09:13:35.378422+0000","last_fullsized":"2024-09-21T09:13:35.378422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:28.117298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"66'10","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955726+0000","last_change":"2024-09-21T09:10:56.862439+0000","last_active":"2024-09-21T09:13:34.955726+0000","last_peered":"2024-09-21T09:13:34.955726+0000","last_clean":"2024-09-21T09:13:34.955726+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:13:34.955726+0000","last_undegraded":"2024-09-21T09:13:34.955726+0000","last_fullsized":"2024-09-21T09:13:34.955726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527158+0000","last_change":"2024-09-21T09:10:58.828974+0000","last_active":"2024-09-21T09:13:35.527158+0000","last_peered":"2024-09-21T09:13:35.527158+0000","last_clean":"2024-09-21T09:13:35.527158+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:13:35.527158+0000","last_undegraded":"2024-09-21T09:13:35.527158+0000","last_fullsized":"2024-09-21T09:13:35.527158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":233,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":848,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":820,"ondisk_log_size":820,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":156302,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":813,"num_read_kb":575,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":660,"num_keys_recovered":24,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":272744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":668,"ondisk_log_size":668,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":545,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":23,"num_write":644,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":1149239296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384648,"kb_used_data":349304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93987192,"statfs":{"total":96636764160,"available":96242884608,"internally_reserved":0,"allocated":357687296,"data_stored":357174157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":511572,"kb_used_data":476224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93860268,"statfs":{"total":96636764160,"available":96112914432,"internally_reserved":0,"allocated":487653376,"data_stored":487144593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":790672,"kb_used_data":755328,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93581168,"statfs":{"total":96636764160,"available":95827116032,"internally_reserved":0,"allocated":773455872,"data_stored":772942678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763532,"kb_used_data":728184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93608308,"statfs":{"total":96636764160,"available":95854907392,"internally_reserved":0,"allocated":745660416,"data_stored":745152324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":677440,"kb_used_data":642084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93694400,"statfs":{"total":96636764160,"available":95943065600,"internally_reserved":0,"allocated":657494016,"data_stored":657008169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":594160,"kb_used_data":558816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93777680,"statfs":{"total":96636764160,"available":96028344320,"internally_reserved":0,"allocated":572227584,"data_stored":571684881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":794284,"kb_used_data":758940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93577556,"statfs":{"total":96636764160,"available":95823417344,"internally_reserved":0,"allocated":777154560,"data_stored":776616419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462480,"kb_used_data":422976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93909360,"statfs":{"total":96636764160,"available":96163184640,"internally_reserved":0,"allocated":433127424,"data_stored":432613611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":775946240,"data_stored":775946240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":570425344,"data_stored":570425344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":656408576,"data_stored":656408576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":744488960,"data_stored":744488960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":432013312,"data_stored":432013312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":771751936,"data_stored":771751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":486539264,"data_stored":486539264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":356515840,"data_stored":356515840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":70250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":6483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":58451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:13:46.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T09:13:47.197 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:13:47.197 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"40ea9d0f-5384-4528-b1fd-6d8d8eba5ac3","created":"2024-09-21T09:10:28.086623+0000","modified":"2024-09-21T09:13:34.280445+0000","last_up_change":"2024-09-21T09:10:41.697031+0000","last_in_change":"2024-09-21T09:13:18.090416+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T09:10:43.023047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T09:10:47.239561+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-21T09:10:55.648452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-21T09:10:57.205791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-21T09:10:59.105322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-21T09:11:00.986978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-21T09:11:02.911448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-21T09:11:05.053819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d44c360-02ac-4142-a4a1-3ef3bae71ebf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6817","nonce":1603589667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6819","nonce":1603589667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6823","nonce":1603589667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1603589667},{"type":"v1","addr":"172.21.15.7:6821","nonce":1603589667}]},"public_addr":"172.21.15.7:6817/1603589667","cluster_addr":"172.21.15.7:6819/1603589667","heartbeat_back_addr":"172.21.15.7:6823/1603589667","heartbeat_front_addr":"172.21.15.7:6821/1603589667","state":["exists","up"]},{"osd":1,"uuid":"02fc3a59-f3a3-412b-ba73-5f43dc7c4714","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6825","nonce":4002665254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6827","nonce":4002665254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6831","nonce":4002665254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":4002665254},{"type":"v1","addr":"172.21.15.7:6829","nonce":4002665254}]},"public_addr":"172.21.15.7:6825/4002665254","cluster_addr":"172.21.15.7:6827/4002665254","heartbeat_back_addr":"172.21.15.7:6831/4002665254","heartbeat_front_addr":"172.21.15.7:6829/4002665254","state":["exists","up"]},{"osd":2,"uuid":"2ad4a646-5d8d-431d-89c1-5f13ae2c6048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6809","nonce":992756194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6811","nonce":992756194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6815","nonce":992756194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":992756194},{"type":"v1","addr":"172.21.15.7:6813","nonce":992756194}]},"public_addr":"172.21.15.7:6809/992756194","cluster_addr":"172.21.15.7:6811/992756194","heartbeat_back_addr":"172.21.15.7:6815/992756194","heartbeat_front_addr":"172.21.15.7:6813/992756194","state":["exists","up"]},{"osd":3,"uuid":"99b23411-8e42-453f-917e-8342abf03624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6801","nonce":1625592448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6803","nonce":1625592448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6807","nonce":1625592448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1625592448},{"type":"v1","addr":"172.21.15.7:6805","nonce":1625592448}]},"public_addr":"172.21.15.7:6801/1625592448","cluster_addr":"172.21.15.7:6803/1625592448","heartbeat_back_addr":"172.21.15.7:6807/1625592448","heartbeat_front_addr":"172.21.15.7:6805/1625592448","state":["exists","up"]},{"osd":4,"uuid":"7d1e4d92-c6ab-4218-bc8e-2809085574b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6803","nonce":50317293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6805","nonce":50317293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6809","nonce":50317293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":50317293},{"type":"v1","addr":"172.21.15.50:6807","nonce":50317293}]},"public_addr":"172.21.15.50:6803/50317293","cluster_addr":"172.21.15.50:6805/50317293","heartbeat_back_addr":"172.21.15.50:6809/50317293","heartbeat_front_addr":"172.21.15.50:6807/50317293","state":["exists","up"]},{"osd":5,"uuid":"2065653a-bbf5-4d55-b57c-a947d18b5fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6820","nonce":3773654391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6824","nonce":3773654391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6832","nonce":3773654391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":3773654391},{"type":"v1","addr":"172.21.15.50:6828","nonce":3773654391}]},"public_addr":"172.21.15.50:6820/3773654391","cluster_addr":"172.21.15.50:6824/3773654391","heartbeat_back_addr":"172.21.15.50:6832/3773654391","heartbeat_front_addr":"172.21.15.50:6828/3773654391","state":["exists","up"]},{"osd":6,"uuid":"59146344-8e80-4b04-8947-1c119e33be55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6819","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6821","nonce":2220031654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6823","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6825","nonce":2220031654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6831","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6833","nonce":2220031654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6827","nonce":2220031654},{"type":"v1","addr":"172.21.15.50:6829","nonce":2220031654}]},"public_addr":"172.21.15.50:6821/2220031654","cluster_addr":"172.21.15.50:6825/2220031654","heartbeat_back_addr":"172.21.15.50:6833/2220031654","heartbeat_front_addr":"172.21.15.50:6829/2220031654","state":["exists","up"]},{"osd":7,"uuid":"2bd65ed0-7bb8-43d1-a5c6-0713c265495a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6811","nonce":647878711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6813","nonce":647878711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6817","nonce":647878711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":647878711},{"type":"v1","addr":"172.21.15.50:6815","nonce":647878711}]},"public_addr":"172.21.15.50:6811/647878711","cluster_addr":"172.21.15.50:6813/647878711","heartbeat_back_addr":"172.21.15.50:6817/647878711","heartbeat_front_addr":"172.21.15.50:6815/647878711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.970712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.599658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.516125+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.728100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.283957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.740034+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.565564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T09:10:38.895681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T09:13:48.216 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T09:13:48.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:13:48.383 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:13:48.384 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:13:48.384 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:13:48.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T09:13:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T09:13:48.713 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T09:13:48.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:13:48.866 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:13:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:13:48.866 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:13:48.883 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T09:13:49.178 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T09:13:49.198 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T09:13:49.198 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:13:49.348 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:13:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:13:49.348 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:13:49.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T09:13:49.644 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T09:13:49.662 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T09:13:49.663 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:13:49.807 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:13:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:13:49.807 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:13:49.823 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T09:13:50.118 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T09:13:50.138 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T09:13:50.139 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:13:50.291 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:13:50.291 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:13:50.291 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:13:50.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T09:13:50.609 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T09:13:50.629 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T09:13:50.630 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:13:50.791 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:13:50.791 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:13:50.791 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:13:50.808 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T09:13:51.102 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T09:13:51.123 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T09:13:51.123 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:13:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:13:51.268 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:13:51.268 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:13:51.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T09:13:51.566 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T09:13:51.584 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T09:13:51.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T09:13:51.734 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T09:13:51.734 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T09:13:51.734 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T09:13:51.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T09:13:52.036 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T09:13:52.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:13:52.391 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:13:52.396 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:13:52.412 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-21T09:13:51.028102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615632,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":2792,"num_read_kb":2220,"num_write":2385,"num_write_kb":2368156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":1149241676,"num_keys_recovered":26,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3230,"ondisk_log_size":3230,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":305360,"kb_used_data":9840,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754669360,"statfs":{"total":773094113280,"available":772781424640,"internally_reserved":0,"allocated":10076160,"data_stored":5982020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2397177406,"num_objects":-572,"num_object_clones":0,"num_object_copies":-1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-572,"num_whiteouts":0,"num_read":792,"num_read_kb":504,"num_write":646,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007152"},"pg_stats":[{"pgid":"3.3f","version":"91'22","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.504198+0000","last_change":"2024-09-21T09:10:56.846463+0000","last_active":"2024-09-21T09:13:45.504198+0000","last_peered":"2024-09-21T09:13:45.504198+0000","last_clean":"2024-09-21T09:13:45.504198+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:13:45.504198+0000","last_undegraded":"2024-09-21T09:13:45.504198+0000","last_fullsized":"2024-09-21T09:13:45.504198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527158+0000","last_change":"2024-09-21T09:10:58.836923+0000","last_active":"2024-09-21T09:13:35.527158+0000","last_peered":"2024-09-21T09:13:35.527158+0000","last_clean":"2024-09-21T09:13:35.527158+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:13:35.527158+0000","last_undegraded":"2024-09-21T09:13:35.527158+0000","last_fullsized":"2024-09-21T09:13:35.527158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:45:30.880333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"91'26","reported_seq":167,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.512805+0000","last_change":"2024-09-21T09:10:56.865056+0000","last_active":"2024-09-21T09:13:45.512805+0000","last_peered":"2024-09-21T09:13:45.512805+0000","last_clean":"2024-09-21T09:13:45.512805+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:13:45.512805+0000","last_undegraded":"2024-09-21T09:13:45.512805+0000","last_fullsized":"2024-09-21T09:13:45.512805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482290+0000","last_change":"2024-09-21T09:10:58.835355+0000","last_active":"2024-09-21T09:13:34.482290+0000","last_peered":"2024-09-21T09:13:34.482290+0000","last_clean":"2024-09-21T09:13:34.482290+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:13:34.482290+0000","last_undegraded":"2024-09-21T09:13:34.482290+0000","last_fullsized":"2024-09-21T09:13:34.482290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:24.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"91'26","reported_seq":167,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.542984+0000","last_change":"2024-09-21T09:10:56.861504+0000","last_active":"2024-09-21T09:13:45.542984+0000","last_peered":"2024-09-21T09:13:45.542984+0000","last_clean":"2024-09-21T09:13:45.542984+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:13:45.542984+0000","last_undegraded":"2024-09-21T09:13:45.542984+0000","last_fullsized":"2024-09-21T09:13:45.542984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:00.409267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482198+0000","last_change":"2024-09-21T09:13:19.490368+0000","last_active":"2024-09-21T09:13:34.482198+0000","last_peered":"2024-09-21T09:13:34.482198+0000","last_clean":"2024-09-21T09:13:34.482198+0000","last_became_active":"2024-09-21T09:13:19.153424+0000","last_became_peered":"2024-09-21T09:13:19.153424+0000","last_unstale":"2024-09-21T09:13:34.482198+0000","last_undegraded":"2024-09-21T09:13:34.482198+0000","last_fullsized":"2024-09-21T09:13:34.482198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:25.154789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"91'26","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.512414+0000","last_change":"2024-09-21T09:13:20.586732+0000","last_active":"2024-09-21T09:13:45.512414+0000","last_peered":"2024-09-21T09:13:45.512414+0000","last_clean":"2024-09-21T09:13:45.512414+0000","last_became_active":"2024-09-21T09:13:19.165441+0000","last_became_peered":"2024-09-21T09:13:19.165441+0000","last_unstale":"2024-09-21T09:13:45.512414+0000","last_undegraded":"2024-09-21T09:13:45.512414+0000","last_fullsized":"2024-09-21T09:13:45.512414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:51.794446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"58'4","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375167+0000","last_change":"2024-09-21T09:13:20.643217+0000","last_active":"2024-09-21T09:13:35.375167+0000","last_peered":"2024-09-21T09:13:35.375167+0000","last_clean":"2024-09-21T09:13:35.375167+0000","last_became_active":"2024-09-21T09:13:19.153875+0000","last_became_peered":"2024-09-21T09:13:19.153875+0000","last_unstale":"2024-09-21T09:13:35.375167+0000","last_undegraded":"2024-09-21T09:13:35.375167+0000","last_fullsized":"2024-09-21T09:13:35.375167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:03.004434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'22","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.529067+0000","last_change":"2024-09-21T09:10:56.863607+0000","last_active":"2024-09-21T09:13:45.529067+0000","last_peered":"2024-09-21T09:13:45.529067+0000","last_clean":"2024-09-21T09:13:45.529067+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:13:45.529067+0000","last_undegraded":"2024-09-21T09:13:45.529067+0000","last_fullsized":"2024-09-21T09:13:45.529067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296333+0000","last_change":"2024-09-21T09:10:58.851357+0000","last_active":"2024-09-21T09:13:34.296333+0000","last_peered":"2024-09-21T09:13:34.296333+0000","last_clean":"2024-09-21T09:13:34.296333+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:13:34.296333+0000","last_undegraded":"2024-09-21T09:13:34.296333+0000","last_fullsized":"2024-09-21T09:13:34.296333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"91'12","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.503088+0000","last_change":"2024-09-21T09:13:19.704935+0000","last_active":"2024-09-21T09:13:45.503088+0000","last_peered":"2024-09-21T09:13:45.503088+0000","last_clean":"2024-09-21T09:13:45.503088+0000","last_became_active":"2024-09-21T09:13:19.160915+0000","last_became_peered":"2024-09-21T09:13:19.160915+0000","last_unstale":"2024-09-21T09:13:45.503088+0000","last_undegraded":"2024-09-21T09:13:45.503088+0000","last_fullsized":"2024-09-21T09:13:45.503088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:00.863610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297928+0000","last_change":"2024-09-21T09:10:58.825880+0000","last_active":"2024-09-21T09:13:34.297928+0000","last_peered":"2024-09-21T09:13:34.297928+0000","last_clean":"2024-09-21T09:13:34.297928+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:13:34.297928+0000","last_undegraded":"2024-09-21T09:13:34.297928+0000","last_fullsized":"2024-09-21T09:13:34.297928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:46.662637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"91'10","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.468470+0000","last_change":"2024-09-21T09:10:56.851331+0000","last_active":"2024-09-21T09:13:45.468470+0000","last_peered":"2024-09-21T09:13:45.468470+0000","last_clean":"2024-09-21T09:13:45.468470+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:13:45.468470+0000","last_undegraded":"2024-09-21T09:13:45.468470+0000","last_fullsized":"2024-09-21T09:13:45.468470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"62'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298620+0000","last_change":"2024-09-21T09:13:20.336460+0000","last_active":"2024-09-21T09:13:34.298620+0000","last_peered":"2024-09-21T09:13:34.298620+0000","last_clean":"2024-09-21T09:13:34.298620+0000","last_became_active":"2024-09-21T09:13:19.164775+0000","last_became_peered":"2024-09-21T09:13:19.164775+0000","last_unstale":"2024-09-21T09:13:34.298620+0000","last_undegraded":"2024-09-21T09:13:34.298620+0000","last_fullsized":"2024-09-21T09:13:34.298620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:16.166364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"91'22","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.523124+0000","last_change":"2024-09-21T09:10:56.864409+0000","last_active":"2024-09-21T09:13:45.523124+0000","last_peered":"2024-09-21T09:13:45.523124+0000","last_clean":"2024-09-21T09:13:45.523124+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:13:45.523124+0000","last_undegraded":"2024-09-21T09:13:45.523124+0000","last_fullsized":"2024-09-21T09:13:45.523124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"62'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958533+0000","last_change":"2024-09-21T09:10:58.837006+0000","last_active":"2024-09-21T09:13:34.958533+0000","last_peered":"2024-09-21T09:13:34.958533+0000","last_clean":"2024-09-21T09:13:34.958533+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:13:34.958533+0000","last_undegraded":"2024-09-21T09:13:34.958533+0000","last_fullsized":"2024-09-21T09:13:34.958533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:52.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482026+0000","last_change":"2024-09-21T09:10:58.853249+0000","last_active":"2024-09-21T09:13:34.482026+0000","last_peered":"2024-09-21T09:13:34.482026+0000","last_clean":"2024-09-21T09:13:34.482026+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:13:34.482026+0000","last_undegraded":"2024-09-21T09:13:34.482026+0000","last_fullsized":"2024-09-21T09:13:34.482026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:03.692219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'22","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.593404+0000","last_change":"2024-09-21T09:10:56.838955+0000","last_active":"2024-09-21T09:13:45.593404+0000","last_peered":"2024-09-21T09:13:45.593404+0000","last_clean":"2024-09-21T09:13:45.593404+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:13:45.593404+0000","last_undegraded":"2024-09-21T09:13:45.593404+0000","last_fullsized":"2024-09-21T09:13:45.593404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294467+0000","last_change":"2024-09-21T09:10:58.869303+0000","last_active":"2024-09-21T09:13:34.294467+0000","last_peered":"2024-09-21T09:13:34.294467+0000","last_clean":"2024-09-21T09:13:34.294467+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:13:34.294467+0000","last_undegraded":"2024-09-21T09:13:34.294467+0000","last_fullsized":"2024-09-21T09:13:34.294467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"91'14","reported_seq":198,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.468323+0000","last_change":"2024-09-21T09:13:21.021044+0000","last_active":"2024-09-21T09:13:45.468323+0000","last_peered":"2024-09-21T09:13:45.468323+0000","last_clean":"2024-09-21T09:13:45.468323+0000","last_became_active":"2024-09-21T09:13:19.154413+0000","last_became_peered":"2024-09-21T09:13:19.154413+0000","last_unstale":"2024-09-21T09:13:45.468323+0000","last_undegraded":"2024-09-21T09:13:45.468323+0000","last_fullsized":"2024-09-21T09:13:45.468323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'8","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528416+0000","last_change":"2024-09-21T09:10:58.840976+0000","last_active":"2024-09-21T09:13:35.528416+0000","last_peered":"2024-09-21T09:13:35.528416+0000","last_clean":"2024-09-21T09:13:35.528416+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:13:35.528416+0000","last_undegraded":"2024-09-21T09:13:35.528416+0000","last_fullsized":"2024-09-21T09:13:35.528416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"91'18","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.491519+0000","last_change":"2024-09-21T09:10:56.853888+0000","last_active":"2024-09-21T09:13:45.491519+0000","last_peered":"2024-09-21T09:13:45.491519+0000","last_clean":"2024-09-21T09:13:45.491519+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:13:45.491519+0000","last_undegraded":"2024-09-21T09:13:45.491519+0000","last_fullsized":"2024-09-21T09:13:45.491519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294562+0000","last_change":"2024-09-21T09:10:58.838132+0000","last_active":"2024-09-21T09:13:34.294562+0000","last_peered":"2024-09-21T09:13:34.294562+0000","last_clean":"2024-09-21T09:13:34.294562+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:13:34.294562+0000","last_undegraded":"2024-09-21T09:13:34.294562+0000","last_fullsized":"2024-09-21T09:13:34.294562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'20","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.501422+0000","last_change":"2024-09-21T09:10:56.845923+0000","last_active":"2024-09-21T09:13:45.501422+0000","last_peered":"2024-09-21T09:13:45.501422+0000","last_clean":"2024-09-21T09:13:45.501422+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:13:45.501422+0000","last_undegraded":"2024-09-21T09:13:45.501422+0000","last_fullsized":"2024-09-21T09:13:45.501422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.868550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'8","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956761+0000","last_change":"2024-09-21T09:10:58.848326+0000","last_active":"2024-09-21T09:13:34.956761+0000","last_peered":"2024-09-21T09:13:34.956761+0000","last_clean":"2024-09-21T09:13:34.956761+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:13:34.956761+0000","last_undegraded":"2024-09-21T09:13:34.956761+0000","last_fullsized":"2024-09-21T09:13:34.956761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:44.318321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"91'22","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.524120+0000","last_change":"2024-09-21T09:10:56.859019+0000","last_active":"2024-09-21T09:13:45.524120+0000","last_peered":"2024-09-21T09:13:45.524120+0000","last_clean":"2024-09-21T09:13:45.524120+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:13:45.524120+0000","last_undegraded":"2024-09-21T09:13:45.524120+0000","last_fullsized":"2024-09-21T09:13:45.524120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:32.676423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529197+0000","last_change":"2024-09-21T09:10:58.830335+0000","last_active":"2024-09-21T09:13:35.529197+0000","last_peered":"2024-09-21T09:13:35.529197+0000","last_clean":"2024-09-21T09:13:35.529197+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:13:35.529197+0000","last_undegraded":"2024-09-21T09:13:35.529197+0000","last_fullsized":"2024-09-21T09:13:35.529197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"91'14","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.476591+0000","last_change":"2024-09-21T09:10:56.862662+0000","last_active":"2024-09-21T09:13:45.476591+0000","last_peered":"2024-09-21T09:13:45.476591+0000","last_clean":"2024-09-21T09:13:45.476591+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:13:45.476591+0000","last_undegraded":"2024-09-21T09:13:45.476591+0000","last_fullsized":"2024-09-21T09:13:45.476591+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295061+0000","last_change":"2024-09-21T09:11:06.898983+0000","last_active":"2024-09-21T09:13:34.295061+0000","last_peered":"2024-09-21T09:13:34.295061+0000","last_clean":"2024-09-21T09:13:34.295061+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:13:34.295061+0000","last_undegraded":"2024-09-21T09:13:34.295061+0000","last_fullsized":"2024-09-21T09:13:34.295061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'4","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294904+0000","last_change":"2024-09-21T09:10:58.876069+0000","last_active":"2024-09-21T09:13:34.294904+0000","last_peered":"2024-09-21T09:13:34.294904+0000","last_clean":"2024-09-21T09:13:34.294904+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:13:34.294904+0000","last_undegraded":"2024-09-21T09:13:34.294904+0000","last_fullsized":"2024-09-21T09:13:34.294904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"91'8","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.462712+0000","last_change":"2024-09-21T09:10:56.848523+0000","last_active":"2024-09-21T09:13:45.462712+0000","last_peered":"2024-09-21T09:13:45.462712+0000","last_clean":"2024-09-21T09:13:45.462712+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:13:45.462712+0000","last_undegraded":"2024-09-21T09:13:45.462712+0000","last_fullsized":"2024-09-21T09:13:45.462712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:19.819608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483302+0000","last_change":"2024-09-21T09:11:00.842168+0000","last_active":"2024-09-21T09:13:34.483302+0000","last_peered":"2024-09-21T09:13:34.483302+0000","last_clean":"2024-09-21T09:13:34.483302+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:13:34.483302+0000","last_undegraded":"2024-09-21T09:13:34.483302+0000","last_fullsized":"2024-09-21T09:13:34.483302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:33.920548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"91'18","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.555049+0000","last_change":"2024-09-21T09:11:02.866403+0000","last_active":"2024-09-21T09:13:45.555049+0000","last_peered":"2024-09-21T09:13:45.555049+0000","last_clean":"2024-09-21T09:13:45.555049+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:13:45.555049+0000","last_undegraded":"2024-09-21T09:13:45.555049+0000","last_fullsized":"2024-09-21T09:13:45.555049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:12.124539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527948+0000","last_change":"2024-09-21T09:11:04.894715+0000","last_active":"2024-09-21T09:13:35.527948+0000","last_peered":"2024-09-21T09:13:35.527948+0000","last_clean":"2024-09-21T09:13:35.527948+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:13:35.527948+0000","last_undegraded":"2024-09-21T09:13:35.527948+0000","last_fullsized":"2024-09-21T09:13:35.527948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:59.579572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"58'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527415+0000","last_change":"2024-09-21T09:11:06.885484+0000","last_active":"2024-09-21T09:13:35.527415+0000","last_peered":"2024-09-21T09:13:35.527415+0000","last_clean":"2024-09-21T09:13:35.527415+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:13:35.527415+0000","last_undegraded":"2024-09-21T09:13:35.527415+0000","last_fullsized":"2024-09-21T09:13:35.527415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:13.165470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"61'6","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483104+0000","last_change":"2024-09-21T09:10:58.842832+0000","last_active":"2024-09-21T09:13:34.483104+0000","last_peered":"2024-09-21T09:13:34.483104+0000","last_clean":"2024-09-21T09:13:34.483104+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:13:34.483104+0000","last_undegraded":"2024-09-21T09:13:34.483104+0000","last_fullsized":"2024-09-21T09:13:34.483104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:12.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"91'18","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.496829+0000","last_change":"2024-09-21T09:10:56.849428+0000","last_active":"2024-09-21T09:13:45.496829+0000","last_peered":"2024-09-21T09:13:45.496829+0000","last_clean":"2024-09-21T09:13:45.496829+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:13:45.496829+0000","last_undegraded":"2024-09-21T09:13:45.496829+0000","last_fullsized":"2024-09-21T09:13:45.496829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375922+0000","last_change":"2024-09-21T09:13:19.156069+0000","last_active":"2024-09-21T09:13:35.375922+0000","last_peered":"2024-09-21T09:13:35.375922+0000","last_clean":"2024-09-21T09:13:35.375922+0000","last_became_active":"2024-09-21T09:13:19.153940+0000","last_became_peered":"2024-09-21T09:13:19.153940+0000","last_unstale":"2024-09-21T09:13:35.375922+0000","last_undegraded":"2024-09-21T09:13:35.375922+0000","last_fullsized":"2024-09-21T09:13:35.375922+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:57.795849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526564+0000","last_change":"2024-09-21T09:11:02.866594+0000","last_active":"2024-09-21T09:13:35.526564+0000","last_peered":"2024-09-21T09:13:35.526564+0000","last_clean":"2024-09-21T09:13:35.526564+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:13:35.526564+0000","last_undegraded":"2024-09-21T09:13:35.526564+0000","last_fullsized":"2024-09-21T09:13:35.526564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526934+0000","last_change":"2024-09-21T09:11:04.887299+0000","last_active":"2024-09-21T09:13:35.526934+0000","last_peered":"2024-09-21T09:13:35.526934+0000","last_clean":"2024-09-21T09:13:35.526934+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:13:35.526934+0000","last_undegraded":"2024-09-21T09:13:35.526934+0000","last_fullsized":"2024-09-21T09:13:35.526934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:08.490686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":129,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294124+0000","last_change":"2024-09-21T09:13:19.145016+0000","last_active":"2024-09-21T09:13:34.294124+0000","last_peered":"2024-09-21T09:13:34.294124+0000","last_clean":"2024-09-21T09:13:34.294124+0000","last_became_active":"2024-09-21T09:13:19.144143+0000","last_became_peered":"2024-09-21T09:13:19.144143+0000","last_unstale":"2024-09-21T09:13:34.294124+0000","last_undegraded":"2024-09-21T09:13:34.294124+0000","last_fullsized":"2024-09-21T09:13:34.294124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957751+0000","last_change":"2024-09-21T09:10:58.851370+0000","last_active":"2024-09-21T09:13:34.957751+0000","last_peered":"2024-09-21T09:13:34.957751+0000","last_clean":"2024-09-21T09:13:34.957751+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:13:34.957751+0000","last_undegraded":"2024-09-21T09:13:34.957751+0000","last_fullsized":"2024-09-21T09:13:34.957751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:05.984687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'8","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.507182+0000","last_change":"2024-09-21T09:13:21.119832+0000","last_active":"2024-09-21T09:13:45.507182+0000","last_peered":"2024-09-21T09:13:45.507182+0000","last_clean":"2024-09-21T09:13:45.507182+0000","last_became_active":"2024-09-21T09:13:19.159398+0000","last_became_peered":"2024-09-21T09:13:19.159398+0000","last_unstale":"2024-09-21T09:13:45.507182+0000","last_undegraded":"2024-09-21T09:13:45.507182+0000","last_fullsized":"2024-09-21T09:13:45.507182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:40.942331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377709+0000","last_change":"2024-09-21T09:11:00.845836+0000","last_active":"2024-09-21T09:13:35.377709+0000","last_peered":"2024-09-21T09:13:35.377709+0000","last_clean":"2024-09-21T09:13:35.377709+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:13:35.377709+0000","last_undegraded":"2024-09-21T09:13:35.377709+0000","last_fullsized":"2024-09-21T09:13:35.377709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:06.353993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376373+0000","last_change":"2024-09-21T09:11:02.852500+0000","last_active":"2024-09-21T09:13:35.376373+0000","last_peered":"2024-09-21T09:13:35.376373+0000","last_clean":"2024-09-21T09:13:35.376373+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:13:35.376373+0000","last_undegraded":"2024-09-21T09:13:35.376373+0000","last_fullsized":"2024-09-21T09:13:35.376373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:19.073540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"91'105","reported_seq":332,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.053637+0000","last_change":"2024-09-21T09:11:04.895087+0000","last_active":"2024-09-21T09:13:45.053637+0000","last_peered":"2024-09-21T09:13:45.053637+0000","last_clean":"2024-09-21T09:13:45.053637+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:13:45.053637+0000","last_undegraded":"2024-09-21T09:13:45.053637+0000","last_fullsized":"2024-09-21T09:13:45.053637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:11.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295621+0000","last_change":"2024-09-21T09:13:19.162437+0000","last_active":"2024-09-21T09:13:34.295621+0000","last_peered":"2024-09-21T09:13:34.295621+0000","last_clean":"2024-09-21T09:13:34.295621+0000","last_became_active":"2024-09-21T09:13:19.161659+0000","last_became_peered":"2024-09-21T09:13:19.161659+0000","last_unstale":"2024-09-21T09:13:34.295621+0000","last_undegraded":"2024-09-21T09:13:34.295621+0000","last_fullsized":"2024-09-21T09:13:34.295621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:59.822101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.958090+0000","last_change":"2024-09-21T09:10:58.837602+0000","last_active":"2024-09-21T09:13:34.958090+0000","last_peered":"2024-09-21T09:13:34.958090+0000","last_clean":"2024-09-21T09:13:34.958090+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:13:34.958090+0000","last_undegraded":"2024-09-21T09:13:34.958090+0000","last_fullsized":"2024-09-21T09:13:34.958090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:36.269116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"91'34","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.541175+0000","last_change":"2024-09-21T09:10:56.844292+0000","last_active":"2024-09-21T09:13:45.541175+0000","last_peered":"2024-09-21T09:13:45.541175+0000","last_clean":"2024-09-21T09:13:45.541175+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:13:45.541175+0000","last_undegraded":"2024-09-21T09:13:45.541175+0000","last_fullsized":"2024-09-21T09:13:45.541175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:21.921201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482929+0000","last_change":"2024-09-21T09:11:00.852984+0000","last_active":"2024-09-21T09:13:34.482929+0000","last_peered":"2024-09-21T09:13:34.482929+0000","last_clean":"2024-09-21T09:13:34.482929+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:13:34.482929+0000","last_undegraded":"2024-09-21T09:13:34.482929+0000","last_fullsized":"2024-09-21T09:13:34.482929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:33.175145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"91'18","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.416633+0000","last_change":"2024-09-21T09:13:19.543924+0000","last_active":"2024-09-21T09:13:45.416633+0000","last_peered":"2024-09-21T09:13:45.416633+0000","last_clean":"2024-09-21T09:13:45.416633+0000","last_became_active":"2024-09-21T09:13:19.160798+0000","last_became_peered":"2024-09-21T09:13:19.160798+0000","last_unstale":"2024-09-21T09:13:45.416633+0000","last_undegraded":"2024-09-21T09:13:45.416633+0000","last_fullsized":"2024-09-21T09:13:45.416633+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"91'105","reported_seq":306,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.063307+0000","last_change":"2024-09-21T09:11:04.894947+0000","last_active":"2024-09-21T09:13:45.063307+0000","last_peered":"2024-09-21T09:13:45.063307+0000","last_clean":"2024-09-21T09:13:45.063307+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:13:45.063307+0000","last_undegraded":"2024-09-21T09:13:45.063307+0000","last_fullsized":"2024-09-21T09:13:45.063307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:21.481386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482063+0000","last_change":"2024-09-21T09:10:58.841384+0000","last_active":"2024-09-21T09:13:34.482063+0000","last_peered":"2024-09-21T09:13:34.482063+0000","last_clean":"2024-09-21T09:13:34.482063+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:13:34.482063+0000","last_undegraded":"2024-09-21T09:13:34.482063+0000","last_fullsized":"2024-09-21T09:13:34.482063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:08.308265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"91'22","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.580801+0000","last_change":"2024-09-21T09:10:56.846710+0000","last_active":"2024-09-21T09:13:45.580801+0000","last_peered":"2024-09-21T09:13:45.580801+0000","last_clean":"2024-09-21T09:13:45.580801+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:13:45.580801+0000","last_undegraded":"2024-09-21T09:13:45.580801+0000","last_fullsized":"2024-09-21T09:13:45.580801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527660+0000","last_change":"2024-09-21T09:11:00.839560+0000","last_active":"2024-09-21T09:13:35.527660+0000","last_peered":"2024-09-21T09:13:35.527660+0000","last_clean":"2024-09-21T09:13:35.527660+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:13:35.527660+0000","last_undegraded":"2024-09-21T09:13:35.527660+0000","last_fullsized":"2024-09-21T09:13:35.527660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:41.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"91'30","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.585674+0000","last_change":"2024-09-21T09:11:02.872323+0000","last_active":"2024-09-21T09:13:45.585674+0000","last_peered":"2024-09-21T09:13:45.585674+0000","last_clean":"2024-09-21T09:13:45.585674+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:13:45.585674+0000","last_undegraded":"2024-09-21T09:13:45.585674+0000","last_fullsized":"2024-09-21T09:13:45.585674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":48,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294211+0000","last_change":"2024-09-21T09:13:19.150862+0000","last_active":"2024-09-21T09:13:34.294211+0000","last_peered":"2024-09-21T09:13:34.294211+0000","last_clean":"2024-09-21T09:13:34.294211+0000","last_became_active":"2024-09-21T09:13:19.149936+0000","last_became_peered":"2024-09-21T09:13:19.149936+0000","last_unstale":"2024-09-21T09:13:34.294211+0000","last_undegraded":"2024-09-21T09:13:34.294211+0000","last_fullsized":"2024-09-21T09:13:34.294211+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.535171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"62'12","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298350+0000","last_change":"2024-09-21T09:13:20.340381+0000","last_active":"2024-09-21T09:13:34.298350+0000","last_peered":"2024-09-21T09:13:34.298350+0000","last_clean":"2024-09-21T09:13:34.298350+0000","last_became_active":"2024-09-21T09:13:19.165108+0000","last_became_peered":"2024-09-21T09:13:19.165108+0000","last_unstale":"2024-09-21T09:13:34.298350+0000","last_undegraded":"2024-09-21T09:13:34.298350+0000","last_fullsized":"2024-09-21T09:13:34.298350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:41.830217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527807+0000","last_change":"2024-09-21T09:10:58.839960+0000","last_active":"2024-09-21T09:13:35.527807+0000","last_peered":"2024-09-21T09:13:35.527807+0000","last_clean":"2024-09-21T09:13:35.527807+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:13:35.527807+0000","last_undegraded":"2024-09-21T09:13:35.527807+0000","last_fullsized":"2024-09-21T09:13:35.527807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'14","reported_seq":63,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.531591+0000","last_change":"2024-09-21T09:13:20.333955+0000","last_active":"2024-09-21T09:13:45.531591+0000","last_peered":"2024-09-21T09:13:45.531591+0000","last_clean":"2024-09-21T09:13:45.531591+0000","last_became_active":"2024-09-21T09:13:19.162605+0000","last_became_peered":"2024-09-21T09:13:19.162605+0000","last_unstale":"2024-09-21T09:13:45.531591+0000","last_undegraded":"2024-09-21T09:13:45.531591+0000","last_fullsized":"2024-09-21T09:13:45.531591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:21.030407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293432+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.293432+0000","last_peered":"2024-09-21T09:13:34.293432+0000","last_clean":"2024-09-21T09:13:34.293432+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:13:34.293432+0000","last_undegraded":"2024-09-21T09:13:34.293432+0000","last_fullsized":"2024-09-21T09:13:34.293432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:48.669684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"91'19","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.378018+0000","last_change":"2024-09-21T09:11:02.866165+0000","last_active":"2024-09-21T09:13:45.378018+0000","last_peered":"2024-09-21T09:13:45.378018+0000","last_clean":"2024-09-21T09:13:45.378018+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:13:45.378018+0000","last_undegraded":"2024-09-21T09:13:45.378018+0000","last_fullsized":"2024-09-21T09:13:45.378018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:54:48.566550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376278+0000","last_change":"2024-09-21T09:11:04.871999+0000","last_active":"2024-09-21T09:13:35.376278+0000","last_peered":"2024-09-21T09:13:35.376278+0000","last_clean":"2024-09-21T09:13:35.376278+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:13:35.376278+0000","last_undegraded":"2024-09-21T09:13:35.376278+0000","last_fullsized":"2024-09-21T09:13:35.376278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:03.218684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"58'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528795+0000","last_change":"2024-09-21T09:13:19.709890+0000","last_active":"2024-09-21T09:13:35.528795+0000","last_peered":"2024-09-21T09:13:35.528795+0000","last_clean":"2024-09-21T09:13:35.528795+0000","last_became_active":"2024-09-21T09:13:19.167145+0000","last_became_peered":"2024-09-21T09:13:19.167145+0000","last_unstale":"2024-09-21T09:13:35.528795+0000","last_undegraded":"2024-09-21T09:13:35.528795+0000","last_fullsized":"2024-09-21T09:13:35.528795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294491+0000","last_change":"2024-09-21T09:13:19.528866+0000","last_active":"2024-09-21T09:13:34.294491+0000","last_peered":"2024-09-21T09:13:34.294491+0000","last_clean":"2024-09-21T09:13:34.294491+0000","last_became_active":"2024-09-21T09:13:19.158113+0000","last_became_peered":"2024-09-21T09:13:19.158113+0000","last_unstale":"2024-09-21T09:13:34.294491+0000","last_undegraded":"2024-09-21T09:13:34.294491+0000","last_fullsized":"2024-09-21T09:13:34.294491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:48.503141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'36","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.515321+0000","last_change":"2024-09-21T09:10:56.842697+0000","last_active":"2024-09-21T09:13:45.515321+0000","last_peered":"2024-09-21T09:13:45.515321+0000","last_clean":"2024-09-21T09:13:45.515321+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:13:45.515321+0000","last_undegraded":"2024-09-21T09:13:45.515321+0000","last_fullsized":"2024-09-21T09:13:45.515321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:42.311166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957018+0000","last_change":"2024-09-21T09:11:00.852970+0000","last_active":"2024-09-21T09:13:34.957018+0000","last_peered":"2024-09-21T09:13:34.957018+0000","last_clean":"2024-09-21T09:13:34.957018+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:13:34.957018+0000","last_undegraded":"2024-09-21T09:13:34.957018+0000","last_fullsized":"2024-09-21T09:13:34.957018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:35.201984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"91'24","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.605509+0000","last_change":"2024-09-21T09:11:02.859081+0000","last_active":"2024-09-21T09:13:45.605509+0000","last_peered":"2024-09-21T09:13:45.605509+0000","last_clean":"2024-09-21T09:13:45.605509+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:13:45.605509+0000","last_undegraded":"2024-09-21T09:13:45.605509+0000","last_fullsized":"2024-09-21T09:13:45.605509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:19.576627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"91'105","reported_seq":261,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.066278+0000","last_change":"2024-09-21T09:11:04.895980+0000","last_active":"2024-09-21T09:13:45.066278+0000","last_peered":"2024-09-21T09:13:45.066278+0000","last_clean":"2024-09-21T09:13:45.066278+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:13:45.066278+0000","last_undegraded":"2024-09-21T09:13:45.066278+0000","last_fullsized":"2024-09-21T09:13:45.066278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:57.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295156+0000","last_change":"2024-09-21T09:13:20.635132+0000","last_active":"2024-09-21T09:13:34.295156+0000","last_peered":"2024-09-21T09:13:34.295156+0000","last_clean":"2024-09-21T09:13:34.295156+0000","last_became_active":"2024-09-21T09:13:19.159646+0000","last_became_peered":"2024-09-21T09:13:19.159646+0000","last_unstale":"2024-09-21T09:13:34.295156+0000","last_undegraded":"2024-09-21T09:13:34.295156+0000","last_fullsized":"2024-09-21T09:13:34.295156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:21:10.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"71'10","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956296+0000","last_change":"2024-09-21T09:10:58.871951+0000","last_active":"2024-09-21T09:13:34.956296+0000","last_peered":"2024-09-21T09:13:34.956296+0000","last_clean":"2024-09-21T09:13:34.956296+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:13:34.956296+0000","last_undegraded":"2024-09-21T09:13:34.956296+0000","last_fullsized":"2024-09-21T09:13:34.956296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:16.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'14","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.457833+0000","last_change":"2024-09-21T09:10:56.855073+0000","last_active":"2024-09-21T09:13:45.457833+0000","last_peered":"2024-09-21T09:13:45.457833+0000","last_clean":"2024-09-21T09:13:45.457833+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:13:45.457833+0000","last_undegraded":"2024-09-21T09:13:45.457833+0000","last_fullsized":"2024-09-21T09:13:45.457833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:43.818365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294089+0000","last_change":"2024-09-21T09:11:00.845552+0000","last_active":"2024-09-21T09:13:34.294089+0000","last_peered":"2024-09-21T09:13:34.294089+0000","last_clean":"2024-09-21T09:13:34.294089+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:13:34.294089+0000","last_undegraded":"2024-09-21T09:13:34.294089+0000","last_fullsized":"2024-09-21T09:13:34.294089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:44.841947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"91'30","reported_seq":180,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.389155+0000","last_change":"2024-09-21T09:11:02.868260+0000","last_active":"2024-09-21T09:13:45.389155+0000","last_peered":"2024-09-21T09:13:45.389155+0000","last_clean":"2024-09-21T09:13:45.389155+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:13:45.389155+0000","last_undegraded":"2024-09-21T09:13:45.389155+0000","last_fullsized":"2024-09-21T09:13:45.389155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:38.299285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955882+0000","last_change":"2024-09-21T09:11:04.890815+0000","last_active":"2024-09-21T09:13:34.955882+0000","last_peered":"2024-09-21T09:13:34.955882+0000","last_clean":"2024-09-21T09:13:34.955882+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:13:34.955882+0000","last_undegraded":"2024-09-21T09:13:34.955882+0000","last_fullsized":"2024-09-21T09:13:34.955882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:26.655856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527522+0000","last_change":"2024-09-21T09:11:06.888148+0000","last_active":"2024-09-21T09:13:34.527522+0000","last_peered":"2024-09-21T09:13:34.527522+0000","last_clean":"2024-09-21T09:13:34.527522+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:13:34.527522+0000","last_undegraded":"2024-09-21T09:13:34.527522+0000","last_fullsized":"2024-09-21T09:13:34.527522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"62'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296971+0000","last_change":"2024-09-21T09:10:58.871840+0000","last_active":"2024-09-21T09:13:34.296971+0000","last_peered":"2024-09-21T09:13:34.296971+0000","last_clean":"2024-09-21T09:13:34.296971+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:13:34.296971+0000","last_undegraded":"2024-09-21T09:13:34.296971+0000","last_fullsized":"2024-09-21T09:13:34.296971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:24.130644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"91'14","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.495878+0000","last_change":"2024-09-21T09:10:56.855886+0000","last_active":"2024-09-21T09:13:45.495878+0000","last_peered":"2024-09-21T09:13:45.495878+0000","last_clean":"2024-09-21T09:13:45.495878+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:13:45.495878+0000","last_undegraded":"2024-09-21T09:13:45.495878+0000","last_fullsized":"2024-09-21T09:13:45.495878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:27.161717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526968+0000","last_change":"2024-09-21T09:11:00.850308+0000","last_active":"2024-09-21T09:13:34.526968+0000","last_peered":"2024-09-21T09:13:34.526968+0000","last_clean":"2024-09-21T09:13:34.526968+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:13:34.526968+0000","last_undegraded":"2024-09-21T09:13:34.526968+0000","last_fullsized":"2024-09-21T09:13:34.526968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:13.608546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"91'20","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.392588+0000","last_change":"2024-09-21T09:11:02.866122+0000","last_active":"2024-09-21T09:13:45.392588+0000","last_peered":"2024-09-21T09:13:45.392588+0000","last_clean":"2024-09-21T09:13:45.392588+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:13:45.392588+0000","last_undegraded":"2024-09-21T09:13:45.392588+0000","last_fullsized":"2024-09-21T09:13:45.392588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527462+0000","last_change":"2024-09-21T09:11:04.880608+0000","last_active":"2024-09-21T09:13:34.527462+0000","last_peered":"2024-09-21T09:13:34.527462+0000","last_clean":"2024-09-21T09:13:34.527462+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:13:34.527462+0000","last_undegraded":"2024-09-21T09:13:34.527462+0000","last_fullsized":"2024-09-21T09:13:34.527462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:39.226968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955061+0000","last_change":"2024-09-21T09:11:06.892201+0000","last_active":"2024-09-21T09:13:34.955061+0000","last_peered":"2024-09-21T09:13:34.955061+0000","last_clean":"2024-09-21T09:13:34.955061+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:13:34.955061+0000","last_undegraded":"2024-09-21T09:13:34.955061+0000","last_fullsized":"2024-09-21T09:13:34.955061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:32.463353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483248+0000","last_change":"2024-09-21T09:10:58.838223+0000","last_active":"2024-09-21T09:13:34.483248+0000","last_peered":"2024-09-21T09:13:34.483248+0000","last_clean":"2024-09-21T09:13:34.483248+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:13:34.483248+0000","last_undegraded":"2024-09-21T09:13:34.483248+0000","last_fullsized":"2024-09-21T09:13:34.483248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:01.253234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"91'12","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.291398+0000","last_change":"2024-09-21T09:10:56.841106+0000","last_active":"2024-09-21T09:13:45.291398+0000","last_peered":"2024-09-21T09:13:45.291398+0000","last_clean":"2024-09-21T09:13:45.291398+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:13:45.291398+0000","last_undegraded":"2024-09-21T09:13:45.291398+0000","last_fullsized":"2024-09-21T09:13:45.291398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:40.827746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956508+0000","last_change":"2024-09-21T09:11:00.841164+0000","last_active":"2024-09-21T09:13:34.956508+0000","last_peered":"2024-09-21T09:13:34.956508+0000","last_clean":"2024-09-21T09:13:34.956508+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:13:34.956508+0000","last_undegraded":"2024-09-21T09:13:34.956508+0000","last_fullsized":"2024-09-21T09:13:34.956508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:05.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"91'26","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.367864+0000","last_change":"2024-09-21T09:11:02.852292+0000","last_active":"2024-09-21T09:13:45.367864+0000","last_peered":"2024-09-21T09:13:45.367864+0000","last_clean":"2024-09-21T09:13:45.367864+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:13:45.367864+0000","last_undegraded":"2024-09-21T09:13:45.367864+0000","last_fullsized":"2024-09-21T09:13:45.367864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:33:12.322229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"91'105","reported_seq":300,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.056076+0000","last_change":"2024-09-21T09:11:04.892391+0000","last_active":"2024-09-21T09:13:45.056076+0000","last_peered":"2024-09-21T09:13:45.056076+0000","last_clean":"2024-09-21T09:13:45.056076+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:13:45.056076+0000","last_undegraded":"2024-09-21T09:13:45.056076+0000","last_fullsized":"2024-09-21T09:13:45.056076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:52.736335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293567+0000","last_change":"2024-09-21T09:11:06.883898+0000","last_active":"2024-09-21T09:13:34.293567+0000","last_peered":"2024-09-21T09:13:34.293567+0000","last_clean":"2024-09-21T09:13:34.293567+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:13:34.293567+0000","last_undegraded":"2024-09-21T09:13:34.293567+0000","last_fullsized":"2024-09-21T09:13:34.293567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:02.144868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"71'8","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298809+0000","last_change":"2024-09-21T09:13:20.217794+0000","last_active":"2024-09-21T09:13:34.298809+0000","last_peered":"2024-09-21T09:13:34.298809+0000","last_clean":"2024-09-21T09:13:34.298809+0000","last_became_active":"2024-09-21T09:13:19.161819+0000","last_became_peered":"2024-09-21T09:13:19.161819+0000","last_unstale":"2024-09-21T09:13:34.298809+0000","last_undegraded":"2024-09-21T09:13:34.298809+0000","last_fullsized":"2024-09-21T09:13:34.298809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:41.176970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"91'22","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.512040+0000","last_change":"2024-09-21T09:10:56.844590+0000","last_active":"2024-09-21T09:13:45.512040+0000","last_peered":"2024-09-21T09:13:45.512040+0000","last_clean":"2024-09-21T09:13:45.512040+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:13:45.512040+0000","last_undegraded":"2024-09-21T09:13:45.512040+0000","last_fullsized":"2024-09-21T09:13:45.512040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:20.839825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":272,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.019678+0000","last_change":"2024-09-21T09:11:00.839056+0000","last_active":"2024-09-21T09:13:45.019678+0000","last_peered":"2024-09-21T09:13:45.019678+0000","last_clean":"2024-09-21T09:13:45.019678+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:13:45.019678+0000","last_undegraded":"2024-09-21T09:13:45.019678+0000","last_fullsized":"2024-09-21T09:13:45.019678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:07.991734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"65'11","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294566+0000","last_change":"2024-09-21T09:11:02.876439+0000","last_active":"2024-09-21T09:13:34.294566+0000","last_peered":"2024-09-21T09:13:34.294566+0000","last_clean":"2024-09-21T09:13:34.294566+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:13:34.294566+0000","last_undegraded":"2024-09-21T09:13:34.294566+0000","last_fullsized":"2024-09-21T09:13:34.294566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"91'105","reported_seq":314,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.057846+0000","last_change":"2024-09-21T09:11:04.884790+0000","last_active":"2024-09-21T09:13:45.057846+0000","last_peered":"2024-09-21T09:13:45.057846+0000","last_clean":"2024-09-21T09:13:45.057846+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:13:45.057846+0000","last_undegraded":"2024-09-21T09:13:45.057846+0000","last_fullsized":"2024-09-21T09:13:45.057846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:00.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294059+0000","last_change":"2024-09-21T09:13:19.158996+0000","last_active":"2024-09-21T09:13:34.294059+0000","last_peered":"2024-09-21T09:13:34.294059+0000","last_clean":"2024-09-21T09:13:34.294059+0000","last_became_active":"2024-09-21T09:13:19.139533+0000","last_became_peered":"2024-09-21T09:13:19.139533+0000","last_unstale":"2024-09-21T09:13:34.294059+0000","last_undegraded":"2024-09-21T09:13:34.294059+0000","last_fullsized":"2024-09-21T09:13:34.294059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:03.695046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527899+0000","last_change":"2024-09-21T09:10:58.873730+0000","last_active":"2024-09-21T09:13:34.527899+0000","last_peered":"2024-09-21T09:13:34.527899+0000","last_clean":"2024-09-21T09:13:34.527899+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:13:34.527899+0000","last_undegraded":"2024-09-21T09:13:34.527899+0000","last_fullsized":"2024-09-21T09:13:34.527899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"91'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.522566+0000","last_change":"2024-09-21T09:10:56.849104+0000","last_active":"2024-09-21T09:13:45.522566+0000","last_peered":"2024-09-21T09:13:45.522566+0000","last_clean":"2024-09-21T09:13:45.522566+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:13:45.522566+0000","last_undegraded":"2024-09-21T09:13:45.522566+0000","last_fullsized":"2024-09-21T09:13:45.522566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:34.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483039+0000","last_change":"2024-09-21T09:11:00.841893+0000","last_active":"2024-09-21T09:13:34.483039+0000","last_peered":"2024-09-21T09:13:34.483039+0000","last_clean":"2024-09-21T09:13:34.483039+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:13:34.483039+0000","last_undegraded":"2024-09-21T09:13:34.483039+0000","last_fullsized":"2024-09-21T09:13:34.483039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:55.253483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"91'26","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.558150+0000","last_change":"2024-09-21T09:11:02.867833+0000","last_active":"2024-09-21T09:13:45.558150+0000","last_peered":"2024-09-21T09:13:45.558150+0000","last_clean":"2024-09-21T09:13:45.558150+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:13:45.558150+0000","last_undegraded":"2024-09-21T09:13:45.558150+0000","last_fullsized":"2024-09-21T09:13:45.558150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:56.898720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298750+0000","last_change":"2024-09-21T09:13:19.166139+0000","last_active":"2024-09-21T09:13:34.298750+0000","last_peered":"2024-09-21T09:13:34.298750+0000","last_clean":"2024-09-21T09:13:34.298750+0000","last_became_active":"2024-09-21T09:13:19.164969+0000","last_became_peered":"2024-09-21T09:13:19.164969+0000","last_unstale":"2024-09-21T09:13:34.298750+0000","last_undegraded":"2024-09-21T09:13:34.298750+0000","last_fullsized":"2024-09-21T09:13:34.298750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:05.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"62'12","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526114+0000","last_change":"2024-09-21T09:11:06.883751+0000","last_active":"2024-09-21T09:13:34.526114+0000","last_peered":"2024-09-21T09:13:34.526114+0000","last_clean":"2024-09-21T09:13:34.526114+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:13:34.526114+0000","last_undegraded":"2024-09-21T09:13:34.526114+0000","last_fullsized":"2024-09-21T09:13:34.526114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:09.296705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482855+0000","last_change":"2024-09-21T09:10:58.838888+0000","last_active":"2024-09-21T09:13:34.482855+0000","last_peered":"2024-09-21T09:13:34.482855+0000","last_clean":"2024-09-21T09:13:34.482855+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:13:34.482855+0000","last_undegraded":"2024-09-21T09:13:34.482855+0000","last_fullsized":"2024-09-21T09:13:34.482855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:53.547541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":304,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527650+0000","last_change":"2024-09-21T09:10:44.726458+0000","last_active":"2024-09-21T09:13:35.527650+0000","last_peered":"2024-09-21T09:13:35.527650+0000","last_clean":"2024-09-21T09:13:35.527650+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:13:35.527650+0000","last_undegraded":"2024-09-21T09:13:35.527650+0000","last_fullsized":"2024-09-21T09:13:35.527650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:43.702491+0000","last_clean_scrub_stamp":"2024-09-21T09:10:43.702491+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:07.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482574+0000","last_change":"2024-09-21T09:13:20.381044+0000","last_active":"2024-09-21T09:13:34.482574+0000","last_peered":"2024-09-21T09:13:34.482574+0000","last_clean":"2024-09-21T09:13:34.482574+0000","last_became_active":"2024-09-21T09:13:19.155065+0000","last_became_peered":"2024-09-21T09:13:19.155065+0000","last_unstale":"2024-09-21T09:13:34.482574+0000","last_undegraded":"2024-09-21T09:13:34.482574+0000","last_fullsized":"2024-09-21T09:13:34.482574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:51.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"91'18","reported_seq":212,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.518353+0000","last_change":"2024-09-21T09:13:19.483993+0000","last_active":"2024-09-21T09:13:45.518353+0000","last_peered":"2024-09-21T09:13:45.518353+0000","last_clean":"2024-09-21T09:13:45.518353+0000","last_became_active":"2024-09-21T09:13:19.152677+0000","last_became_peered":"2024-09-21T09:13:19.152677+0000","last_unstale":"2024-09-21T09:13:45.518353+0000","last_undegraded":"2024-09-21T09:13:45.518353+0000","last_fullsized":"2024-09-21T09:13:45.518353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:26.411630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:11:00.845448+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"91'43","reported_seq":197,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.568381+0000","last_change":"2024-09-21T09:11:02.863275+0000","last_active":"2024-09-21T09:13:45.568381+0000","last_peered":"2024-09-21T09:13:45.568381+0000","last_clean":"2024-09-21T09:13:45.568381+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:13:45.568381+0000","last_undegraded":"2024-09-21T09:13:45.568381+0000","last_fullsized":"2024-09-21T09:13:45.568381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:39.968749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":48,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957584+0000","last_change":"2024-09-21T09:11:04.894538+0000","last_active":"2024-09-21T09:13:34.957584+0000","last_peered":"2024-09-21T09:13:34.957584+0000","last_clean":"2024-09-21T09:13:34.957584+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:13:34.957584+0000","last_undegraded":"2024-09-21T09:13:34.957584+0000","last_fullsized":"2024-09-21T09:13:34.957584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:11.154030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"71'6","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294223+0000","last_change":"2024-09-21T09:13:19.487021+0000","last_active":"2024-09-21T09:13:34.294223+0000","last_peered":"2024-09-21T09:13:34.294223+0000","last_clean":"2024-09-21T09:13:34.294223+0000","last_became_active":"2024-09-21T09:13:19.153438+0000","last_became_peered":"2024-09-21T09:13:19.153438+0000","last_unstale":"2024-09-21T09:13:34.294223+0000","last_undegraded":"2024-09-21T09:13:34.294223+0000","last_fullsized":"2024-09-21T09:13:34.294223+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:22.759172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":422,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957786+0000","last_change":"2024-09-21T09:10:58.855489+0000","last_active":"2024-09-21T09:13:34.957786+0000","last_peered":"2024-09-21T09:13:34.957786+0000","last_clean":"2024-09-21T09:13:34.957786+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:13:34.957786+0000","last_undegraded":"2024-09-21T09:13:34.957786+0000","last_fullsized":"2024-09-21T09:13:34.957786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:04.859633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482280+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:13:34.482280+0000","last_peered":"2024-09-21T09:13:34.482280+0000","last_clean":"2024-09-21T09:13:34.482280+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:13:34.482280+0000","last_undegraded":"2024-09-21T09:13:34.482280+0000","last_fullsized":"2024-09-21T09:13:34.482280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:09.405380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"91'14","reported_seq":195,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.575382+0000","last_change":"2024-09-21T09:13:19.304956+0000","last_active":"2024-09-21T09:13:45.575382+0000","last_peered":"2024-09-21T09:13:45.575382+0000","last_clean":"2024-09-21T09:13:45.575382+0000","last_became_active":"2024-09-21T09:13:19.142666+0000","last_became_peered":"2024-09-21T09:13:19.142666+0000","last_unstale":"2024-09-21T09:13:45.575382+0000","last_undegraded":"2024-09-21T09:13:45.575382+0000","last_fullsized":"2024-09-21T09:13:45.575382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:08.103741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483007+0000","last_change":"2024-09-21T09:11:00.845917+0000","last_active":"2024-09-21T09:13:34.483007+0000","last_peered":"2024-09-21T09:13:34.483007+0000","last_clean":"2024-09-21T09:13:34.483007+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:13:34.483007+0000","last_undegraded":"2024-09-21T09:13:34.483007+0000","last_fullsized":"2024-09-21T09:13:34.483007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:59.152254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"91'121","reported_seq":345,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.562429+0000","last_change":"2024-09-21T09:11:02.871422+0000","last_active":"2024-09-21T09:13:45.562429+0000","last_peered":"2024-09-21T09:13:45.562429+0000","last_clean":"2024-09-21T09:13:45.562429+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:13:45.562429+0000","last_undegraded":"2024-09-21T09:13:45.562429+0000","last_fullsized":"2024-09-21T09:13:45.562429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:57.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":167,"num_read_kb":270,"num_write":36,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483210+0000","last_change":"2024-09-21T09:11:04.893734+0000","last_active":"2024-09-21T09:13:34.483210+0000","last_peered":"2024-09-21T09:13:34.483210+0000","last_clean":"2024-09-21T09:13:34.483210+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:34.483210+0000","last_undegraded":"2024-09-21T09:13:34.483210+0000","last_fullsized":"2024-09-21T09:13:34.483210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.709917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"58'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955754+0000","last_change":"2024-09-21T09:11:06.895362+0000","last_active":"2024-09-21T09:13:34.955754+0000","last_peered":"2024-09-21T09:13:34.955754+0000","last_clean":"2024-09-21T09:13:34.955754+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:13:34.955754+0000","last_undegraded":"2024-09-21T09:13:34.955754+0000","last_fullsized":"2024-09-21T09:13:34.955754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:23.606134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295953+0000","last_change":"2024-09-21T09:10:58.831552+0000","last_active":"2024-09-21T09:13:34.295953+0000","last_peered":"2024-09-21T09:13:34.295953+0000","last_clean":"2024-09-21T09:13:34.295953+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:13:34.295953+0000","last_undegraded":"2024-09-21T09:13:34.295953+0000","last_fullsized":"2024-09-21T09:13:34.295953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:47.853176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526089+0000","last_change":"2024-09-21T09:10:51.587265+0000","last_active":"2024-09-21T09:13:34.526089+0000","last_peered":"2024-09-21T09:13:34.526089+0000","last_clean":"2024-09-21T09:13:34.526089+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:13:34.526089+0000","last_undegraded":"2024-09-21T09:13:34.526089+0000","last_fullsized":"2024-09-21T09:13:34.526089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"91'22","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.522334+0000","last_change":"2024-09-21T09:10:56.866005+0000","last_active":"2024-09-21T09:13:45.522334+0000","last_peered":"2024-09-21T09:13:45.522334+0000","last_clean":"2024-09-21T09:13:45.522334+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:13:45.522334+0000","last_undegraded":"2024-09-21T09:13:45.522334+0000","last_fullsized":"2024-09-21T09:13:45.522334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.228409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":204,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.004047+0000","last_change":"2024-09-21T09:11:00.850206+0000","last_active":"2024-09-21T09:13:45.004047+0000","last_peered":"2024-09-21T09:13:45.004047+0000","last_clean":"2024-09-21T09:13:45.004047+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:13:45.004047+0000","last_undegraded":"2024-09-21T09:13:45.004047+0000","last_fullsized":"2024-09-21T09:13:45.004047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:26.137691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"91'16","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:36.042418+0000","last_change":"2024-09-21T09:11:02.873117+0000","last_active":"2024-09-21T09:13:36.042418+0000","last_peered":"2024-09-21T09:13:36.042418+0000","last_clean":"2024-09-21T09:13:36.042418+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:13:36.042418+0000","last_undegraded":"2024-09-21T09:13:36.042418+0000","last_fullsized":"2024-09-21T09:13:36.042418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376851+0000","last_change":"2024-09-21T09:11:04.873369+0000","last_active":"2024-09-21T09:13:35.376851+0000","last_peered":"2024-09-21T09:13:35.376851+0000","last_clean":"2024-09-21T09:13:35.376851+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:13:35.376851+0000","last_undegraded":"2024-09-21T09:13:35.376851+0000","last_fullsized":"2024-09-21T09:13:35.376851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:02.868816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375992+0000","last_change":"2024-09-21T09:11:06.896298+0000","last_active":"2024-09-21T09:13:35.375992+0000","last_peered":"2024-09-21T09:13:35.375992+0000","last_clean":"2024-09-21T09:13:35.375992+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:13:35.375992+0000","last_undegraded":"2024-09-21T09:13:35.375992+0000","last_fullsized":"2024-09-21T09:13:35.375992+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:42.784843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"58'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294918+0000","last_change":"2024-09-21T09:10:58.838558+0000","last_active":"2024-09-21T09:13:34.294918+0000","last_peered":"2024-09-21T09:13:34.294918+0000","last_clean":"2024-09-21T09:13:34.294918+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:13:34.294918+0000","last_undegraded":"2024-09-21T09:13:34.294918+0000","last_fullsized":"2024-09-21T09:13:34.294918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482642+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:13:34.482642+0000","last_peered":"2024-09-21T09:13:34.482642+0000","last_clean":"2024-09-21T09:13:34.482642+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:13:34.482642+0000","last_undegraded":"2024-09-21T09:13:34.482642+0000","last_fullsized":"2024-09-21T09:13:34.482642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:07.894252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"91'14","reported_seq":198,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.523331+0000","last_change":"2024-09-21T09:13:20.378657+0000","last_active":"2024-09-21T09:13:45.523331+0000","last_peered":"2024-09-21T09:13:45.523331+0000","last_clean":"2024-09-21T09:13:45.523331+0000","last_became_active":"2024-09-21T09:13:19.153710+0000","last_became_peered":"2024-09-21T09:13:19.153710+0000","last_unstale":"2024-09-21T09:13:45.523331+0000","last_undegraded":"2024-09-21T09:13:45.523331+0000","last_fullsized":"2024-09-21T09:13:45.523331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526975+0000","last_change":"2024-09-21T09:11:00.852944+0000","last_active":"2024-09-21T09:13:34.526975+0000","last_peered":"2024-09-21T09:13:34.526975+0000","last_clean":"2024-09-21T09:13:34.526975+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:13:34.526975+0000","last_undegraded":"2024-09-21T09:13:34.526975+0000","last_fullsized":"2024-09-21T09:13:34.526975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:24.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.954874+0000","last_change":"2024-09-21T09:11:02.856485+0000","last_active":"2024-09-21T09:13:34.954874+0000","last_peered":"2024-09-21T09:13:34.954874+0000","last_clean":"2024-09-21T09:13:34.954874+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:13:34.954874+0000","last_undegraded":"2024-09-21T09:13:34.954874+0000","last_fullsized":"2024-09-21T09:13:34.954874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:05.267197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483296+0000","last_change":"2024-09-21T09:11:04.880602+0000","last_active":"2024-09-21T09:13:34.483296+0000","last_peered":"2024-09-21T09:13:34.483296+0000","last_clean":"2024-09-21T09:13:34.483296+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:13:34.483296+0000","last_undegraded":"2024-09-21T09:13:34.483296+0000","last_fullsized":"2024-09-21T09:13:34.483296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:12:56.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"62'4","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526697+0000","last_change":"2024-09-21T09:11:06.869065+0000","last_active":"2024-09-21T09:13:35.526697+0000","last_peered":"2024-09-21T09:13:35.526697+0000","last_clean":"2024-09-21T09:13:35.526697+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:13:35.526697+0000","last_undegraded":"2024-09-21T09:13:35.526697+0000","last_fullsized":"2024-09-21T09:13:35.526697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:28.667296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"71'12","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294295+0000","last_change":"2024-09-21T09:10:58.846835+0000","last_active":"2024-09-21T09:13:34.294295+0000","last_peered":"2024-09-21T09:13:34.294295+0000","last_clean":"2024-09-21T09:13:34.294295+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:13:34.294295+0000","last_undegraded":"2024-09-21T09:13:34.294295+0000","last_fullsized":"2024-09-21T09:13:34.294295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:43.039672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"91'20","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.487666+0000","last_change":"2024-09-21T09:13:19.380704+0000","last_active":"2024-09-21T09:13:45.487666+0000","last_peered":"2024-09-21T09:13:45.487666+0000","last_clean":"2024-09-21T09:13:45.487666+0000","last_became_active":"2024-09-21T09:13:19.142534+0000","last_became_peered":"2024-09-21T09:13:19.142534+0000","last_unstale":"2024-09-21T09:13:45.487666+0000","last_undegraded":"2024-09-21T09:13:45.487666+0000","last_fullsized":"2024-09-21T09:13:45.487666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:29.949351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957216+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:13:34.957216+0000","last_peered":"2024-09-21T09:13:34.957216+0000","last_clean":"2024-09-21T09:13:34.957216+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:13:34.957216+0000","last_undegraded":"2024-09-21T09:13:34.957216+0000","last_fullsized":"2024-09-21T09:13:34.957216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:39.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377768+0000","last_change":"2024-09-21T09:11:00.855241+0000","last_active":"2024-09-21T09:13:35.377768+0000","last_peered":"2024-09-21T09:13:35.377768+0000","last_clean":"2024-09-21T09:13:35.377768+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:13:35.377768+0000","last_undegraded":"2024-09-21T09:13:35.377768+0000","last_fullsized":"2024-09-21T09:13:35.377768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:56:14.401301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"91'36","reported_seq":187,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.420917+0000","last_change":"2024-09-21T09:11:02.864623+0000","last_active":"2024-09-21T09:13:45.420917+0000","last_peered":"2024-09-21T09:13:45.420917+0000","last_clean":"2024-09-21T09:13:45.420917+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:13:45.420917+0000","last_undegraded":"2024-09-21T09:13:45.420917+0000","last_fullsized":"2024-09-21T09:13:45.420917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:12.141735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297500+0000","last_change":"2024-09-21T09:13:19.146039+0000","last_active":"2024-09-21T09:13:34.297500+0000","last_peered":"2024-09-21T09:13:34.297500+0000","last_clean":"2024-09-21T09:13:34.297500+0000","last_became_active":"2024-09-21T09:13:19.145677+0000","last_became_peered":"2024-09-21T09:13:19.145677+0000","last_unstale":"2024-09-21T09:13:34.297500+0000","last_undegraded":"2024-09-21T09:13:34.297500+0000","last_fullsized":"2024-09-21T09:13:34.297500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:04.909499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"62'4","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957412+0000","last_change":"2024-09-21T09:11:06.896833+0000","last_active":"2024-09-21T09:13:34.957412+0000","last_peered":"2024-09-21T09:13:34.957412+0000","last_clean":"2024-09-21T09:13:34.957412+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:13:34.957412+0000","last_undegraded":"2024-09-21T09:13:34.957412+0000","last_fullsized":"2024-09-21T09:13:34.957412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:38.828027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"61'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294846+0000","last_change":"2024-09-21T09:10:58.825808+0000","last_active":"2024-09-21T09:13:34.294846+0000","last_peered":"2024-09-21T09:13:34.294846+0000","last_clean":"2024-09-21T09:13:34.294846+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:13:34.294846+0000","last_undegraded":"2024-09-21T09:13:34.294846+0000","last_fullsized":"2024-09-21T09:13:34.294846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"91'20","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.527097+0000","last_change":"2024-09-21T09:10:56.851643+0000","last_active":"2024-09-21T09:13:45.527097+0000","last_peered":"2024-09-21T09:13:45.527097+0000","last_clean":"2024-09-21T09:13:45.527097+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:13:45.527097+0000","last_undegraded":"2024-09-21T09:13:45.527097+0000","last_fullsized":"2024-09-21T09:13:45.527097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482740+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:13:34.482740+0000","last_peered":"2024-09-21T09:13:34.482740+0000","last_clean":"2024-09-21T09:13:34.482740+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:13:34.482740+0000","last_undegraded":"2024-09-21T09:13:34.482740+0000","last_fullsized":"2024-09-21T09:13:34.482740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:24.356684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295776+0000","last_change":"2024-09-21T09:11:00.847115+0000","last_active":"2024-09-21T09:13:34.295776+0000","last_peered":"2024-09-21T09:13:34.295776+0000","last_clean":"2024-09-21T09:13:34.295776+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:13:34.295776+0000","last_undegraded":"2024-09-21T09:13:34.295776+0000","last_fullsized":"2024-09-21T09:13:34.295776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:55.012417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293962+0000","last_change":"2024-09-21T09:11:02.862921+0000","last_active":"2024-09-21T09:13:34.293962+0000","last_peered":"2024-09-21T09:13:34.293962+0000","last_clean":"2024-09-21T09:13:34.293962+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:13:34.293962+0000","last_undegraded":"2024-09-21T09:13:34.293962+0000","last_fullsized":"2024-09-21T09:13:34.293962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"91'105","reported_seq":266,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.051373+0000","last_change":"2024-09-21T09:11:04.894220+0000","last_active":"2024-09-21T09:13:45.051373+0000","last_peered":"2024-09-21T09:13:45.051373+0000","last_clean":"2024-09-21T09:13:45.051373+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:13:45.051373+0000","last_undegraded":"2024-09-21T09:13:45.051373+0000","last_fullsized":"2024-09-21T09:13:45.051373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:07.285264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"71'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527292+0000","last_change":"2024-09-21T09:11:06.881113+0000","last_active":"2024-09-21T09:13:34.527292+0000","last_peered":"2024-09-21T09:13:34.527292+0000","last_clean":"2024-09-21T09:13:34.527292+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:13:34.527292+0000","last_undegraded":"2024-09-21T09:13:34.527292+0000","last_fullsized":"2024-09-21T09:13:34.527292+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:49:01.591012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376991+0000","last_change":"2024-09-21T09:10:58.868894+0000","last_active":"2024-09-21T09:13:35.376991+0000","last_peered":"2024-09-21T09:13:35.376991+0000","last_clean":"2024-09-21T09:13:35.376991+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:13:35.376991+0000","last_undegraded":"2024-09-21T09:13:35.376991+0000","last_fullsized":"2024-09-21T09:13:35.376991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:41.448227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"91'8","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.519033+0000","last_change":"2024-09-21T09:10:56.853201+0000","last_active":"2024-09-21T09:13:45.519033+0000","last_peered":"2024-09-21T09:13:45.519033+0000","last_clean":"2024-09-21T09:13:45.519033+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:13:45.519033+0000","last_undegraded":"2024-09-21T09:13:45.519033+0000","last_fullsized":"2024-09-21T09:13:45.519033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:58.587669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378974+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:13:35.378974+0000","last_peered":"2024-09-21T09:13:35.378974+0000","last_clean":"2024-09-21T09:13:35.378974+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:13:35.378974+0000","last_undegraded":"2024-09-21T09:13:35.378974+0000","last_fullsized":"2024-09-21T09:13:35.378974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:03.383843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482150+0000","last_change":"2024-09-21T09:11:00.850095+0000","last_active":"2024-09-21T09:13:34.482150+0000","last_peered":"2024-09-21T09:13:34.482150+0000","last_clean":"2024-09-21T09:13:34.482150+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:13:34.482150+0000","last_undegraded":"2024-09-21T09:13:34.482150+0000","last_fullsized":"2024-09-21T09:13:34.482150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:17.456402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"62'11","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482326+0000","last_change":"2024-09-21T09:11:02.853229+0000","last_active":"2024-09-21T09:13:34.482326+0000","last_peered":"2024-09-21T09:13:34.482326+0000","last_clean":"2024-09-21T09:13:34.482326+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:13:34.482326+0000","last_undegraded":"2024-09-21T09:13:34.482326+0000","last_fullsized":"2024-09-21T09:13:34.482326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:00:25.468451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"91'109","reported_seq":290,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.059957+0000","last_change":"2024-09-21T09:13:22.165756+0000","last_active":"2024-09-21T09:13:45.059957+0000","last_peered":"2024-09-21T09:13:45.059957+0000","last_clean":"2024-09-21T09:13:45.059957+0000","last_became_active":"2024-09-21T09:13:22.164964+0000","last_became_peered":"2024-09-21T09:13:22.164964+0000","last_unstale":"2024-09-21T09:13:45.059957+0000","last_undegraded":"2024-09-21T09:13:45.059957+0000","last_fullsized":"2024-09-21T09:13:45.059957+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:18.044791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"62'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956097+0000","last_change":"2024-09-21T09:11:06.887900+0000","last_active":"2024-09-21T09:13:34.956097+0000","last_peered":"2024-09-21T09:13:34.956097+0000","last_clean":"2024-09-21T09:13:34.956097+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:13:34.956097+0000","last_undegraded":"2024-09-21T09:13:34.956097+0000","last_fullsized":"2024-09-21T09:13:34.956097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:03.433485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297268+0000","last_change":"2024-09-21T09:13:19.160539+0000","last_active":"2024-09-21T09:13:34.297268+0000","last_peered":"2024-09-21T09:13:34.297268+0000","last_clean":"2024-09-21T09:13:34.297268+0000","last_became_active":"2024-09-21T09:13:19.158513+0000","last_became_peered":"2024-09-21T09:13:19.158513+0000","last_unstale":"2024-09-21T09:13:34.297268+0000","last_undegraded":"2024-09-21T09:13:34.297268+0000","last_fullsized":"2024-09-21T09:13:34.297268+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:56.953433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"91'12","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.504276+0000","last_change":"2024-09-21T09:10:56.849803+0000","last_active":"2024-09-21T09:13:45.504276+0000","last_peered":"2024-09-21T09:13:45.504276+0000","last_clean":"2024-09-21T09:13:45.504276+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:13:45.504276+0000","last_undegraded":"2024-09-21T09:13:45.504276+0000","last_fullsized":"2024-09-21T09:13:45.504276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:47.709157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483413+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:13:34.483413+0000","last_peered":"2024-09-21T09:13:34.483413+0000","last_clean":"2024-09-21T09:13:34.483413+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:13:34.483413+0000","last_undegraded":"2024-09-21T09:13:34.483413+0000","last_fullsized":"2024-09-21T09:13:34.483413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:33.465317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.374990+0000","last_change":"2024-09-21T09:13:19.154303+0000","last_active":"2024-09-21T09:13:35.374990+0000","last_peered":"2024-09-21T09:13:35.374990+0000","last_clean":"2024-09-21T09:13:35.374990+0000","last_became_active":"2024-09-21T09:13:19.152735+0000","last_became_peered":"2024-09-21T09:13:19.152735+0000","last_unstale":"2024-09-21T09:13:35.374990+0000","last_undegraded":"2024-09-21T09:13:35.374990+0000","last_fullsized":"2024-09-21T09:13:35.374990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:24.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"91'46","reported_seq":205,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.551780+0000","last_change":"2024-09-21T09:11:02.856720+0000","last_active":"2024-09-21T09:13:45.551780+0000","last_peered":"2024-09-21T09:13:45.551780+0000","last_clean":"2024-09-21T09:13:45.551780+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:13:45.551780+0000","last_undegraded":"2024-09-21T09:13:45.551780+0000","last_fullsized":"2024-09-21T09:13:45.551780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:37:50.718268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376998+0000","last_change":"2024-09-21T09:11:04.872979+0000","last_active":"2024-09-21T09:13:35.376998+0000","last_peered":"2024-09-21T09:13:35.376998+0000","last_clean":"2024-09-21T09:13:35.376998+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:13:35.376998+0000","last_undegraded":"2024-09-21T09:13:35.376998+0000","last_fullsized":"2024-09-21T09:13:35.376998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:17.499450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"71'2","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.299731+0000","last_change":"2024-09-21T09:13:19.169497+0000","last_active":"2024-09-21T09:13:34.299731+0000","last_peered":"2024-09-21T09:13:34.299731+0000","last_clean":"2024-09-21T09:13:34.299731+0000","last_became_active":"2024-09-21T09:13:19.140926+0000","last_became_peered":"2024-09-21T09:13:19.140926+0000","last_unstale":"2024-09-21T09:13:34.299731+0000","last_undegraded":"2024-09-21T09:13:34.299731+0000","last_fullsized":"2024-09-21T09:13:34.299731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:44.853024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":426,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377317+0000","last_change":"2024-09-21T09:11:06.900571+0000","last_active":"2024-09-21T09:13:35.377317+0000","last_peered":"2024-09-21T09:13:35.377317+0000","last_clean":"2024-09-21T09:13:35.377317+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:13:35.377317+0000","last_undegraded":"2024-09-21T09:13:35.377317+0000","last_fullsized":"2024-09-21T09:13:35.377317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:59:40.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295838+0000","last_change":"2024-09-21T09:13:19.531538+0000","last_active":"2024-09-21T09:13:34.295838+0000","last_peered":"2024-09-21T09:13:34.295838+0000","last_clean":"2024-09-21T09:13:34.295838+0000","last_became_active":"2024-09-21T09:13:19.158305+0000","last_became_peered":"2024-09-21T09:13:19.158305+0000","last_unstale":"2024-09-21T09:13:34.295838+0000","last_undegraded":"2024-09-21T09:13:34.295838+0000","last_fullsized":"2024-09-21T09:13:34.295838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:10.110896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"91'16","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.493966+0000","last_change":"2024-09-21T09:13:21.278992+0000","last_active":"2024-09-21T09:13:45.493966+0000","last_peered":"2024-09-21T09:13:45.493966+0000","last_clean":"2024-09-21T09:13:45.493966+0000","last_became_active":"2024-09-21T09:13:19.168562+0000","last_became_peered":"2024-09-21T09:13:19.168562+0000","last_unstale":"2024-09-21T09:13:45.493966+0000","last_undegraded":"2024-09-21T09:13:45.493966+0000","last_fullsized":"2024-09-21T09:13:45.493966+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:29.147931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294332+0000","last_change":"2024-09-21T09:11:00.839217+0000","last_active":"2024-09-21T09:13:34.294332+0000","last_peered":"2024-09-21T09:13:34.294332+0000","last_clean":"2024-09-21T09:13:34.294332+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:13:34.294332+0000","last_undegraded":"2024-09-21T09:13:34.294332+0000","last_fullsized":"2024-09-21T09:13:34.294332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:23.833810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"91'22","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.602257+0000","last_change":"2024-09-21T09:11:02.872614+0000","last_active":"2024-09-21T09:13:45.602257+0000","last_peered":"2024-09-21T09:13:45.602257+0000","last_clean":"2024-09-21T09:13:45.602257+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:13:45.602257+0000","last_undegraded":"2024-09-21T09:13:45.602257+0000","last_fullsized":"2024-09-21T09:13:45.602257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":40,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525609+0000","last_change":"2024-09-21T09:11:04.882308+0000","last_active":"2024-09-21T09:13:34.525609+0000","last_peered":"2024-09-21T09:13:34.525609+0000","last_clean":"2024-09-21T09:13:34.525609+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:13:34.525609+0000","last_undegraded":"2024-09-21T09:13:34.525609+0000","last_fullsized":"2024-09-21T09:13:34.525609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:42.301147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"61'16","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527236+0000","last_change":"2024-09-21T09:11:06.892382+0000","last_active":"2024-09-21T09:13:34.527236+0000","last_peered":"2024-09-21T09:13:34.527236+0000","last_clean":"2024-09-21T09:13:34.527236+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:13:34.527236+0000","last_undegraded":"2024-09-21T09:13:34.527236+0000","last_fullsized":"2024-09-21T09:13:34.527236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:20.449346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"62'6","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376845+0000","last_change":"2024-09-21T09:10:58.869150+0000","last_active":"2024-09-21T09:13:35.376845+0000","last_peered":"2024-09-21T09:13:35.376845+0000","last_clean":"2024-09-21T09:13:35.376845+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:13:35.376845+0000","last_undegraded":"2024-09-21T09:13:35.376845+0000","last_fullsized":"2024-09-21T09:13:35.376845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:58.386210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"91'16","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.513037+0000","last_change":"2024-09-21T09:10:56.854764+0000","last_active":"2024-09-21T09:13:45.513037+0000","last_peered":"2024-09-21T09:13:45.513037+0000","last_clean":"2024-09-21T09:13:45.513037+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:13:45.513037+0000","last_undegraded":"2024-09-21T09:13:45.513037+0000","last_fullsized":"2024-09-21T09:13:45.513037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:25.568969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376855+0000","last_change":"2024-09-21T09:11:00.839265+0000","last_active":"2024-09-21T09:13:35.376855+0000","last_peered":"2024-09-21T09:13:35.376855+0000","last_clean":"2024-09-21T09:13:35.376855+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:13:35.376855+0000","last_undegraded":"2024-09-21T09:13:35.376855+0000","last_fullsized":"2024-09-21T09:13:35.376855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:14.524942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"45'5","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375333+0000","last_change":"2024-09-21T09:13:20.848665+0000","last_active":"2024-09-21T09:13:35.375333+0000","last_peered":"2024-09-21T09:13:35.375333+0000","last_clean":"2024-09-21T09:13:35.375333+0000","last_became_active":"2024-09-21T09:13:19.154000+0000","last_became_peered":"2024-09-21T09:13:19.154000+0000","last_unstale":"2024-09-21T09:13:35.375333+0000","last_undegraded":"2024-09-21T09:13:35.375333+0000","last_fullsized":"2024-09-21T09:13:35.375333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:40.242838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297539+0000","last_change":"2024-09-21T09:13:19.160157+0000","last_active":"2024-09-21T09:13:34.297539+0000","last_peered":"2024-09-21T09:13:34.297539+0000","last_clean":"2024-09-21T09:13:34.297539+0000","last_became_active":"2024-09-21T09:13:19.157523+0000","last_became_peered":"2024-09-21T09:13:19.157523+0000","last_unstale":"2024-09-21T09:13:34.297539+0000","last_undegraded":"2024-09-21T09:13:34.297539+0000","last_fullsized":"2024-09-21T09:13:34.297539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:07.414777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294790+0000","last_change":"2024-09-21T09:11:06.879042+0000","last_active":"2024-09-21T09:13:34.294790+0000","last_peered":"2024-09-21T09:13:34.294790+0000","last_clean":"2024-09-21T09:13:34.294790+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:13:34.294790+0000","last_undegraded":"2024-09-21T09:13:34.294790+0000","last_fullsized":"2024-09-21T09:13:34.294790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:34.670949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377778+0000","last_change":"2024-09-21T09:10:58.864481+0000","last_active":"2024-09-21T09:13:35.377778+0000","last_peered":"2024-09-21T09:13:35.377778+0000","last_clean":"2024-09-21T09:13:35.377778+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:13:35.377778+0000","last_undegraded":"2024-09-21T09:13:35.377778+0000","last_fullsized":"2024-09-21T09:13:35.377778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:33.405020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"91'24","reported_seq":78,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.523412+0000","last_change":"2024-09-21T09:13:20.071816+0000","last_active":"2024-09-21T09:13:45.523412+0000","last_peered":"2024-09-21T09:13:45.523412+0000","last_clean":"2024-09-21T09:13:45.523412+0000","last_became_active":"2024-09-21T09:13:19.160370+0000","last_became_peered":"2024-09-21T09:13:19.160370+0000","last_unstale":"2024-09-21T09:13:45.523412+0000","last_undegraded":"2024-09-21T09:13:45.523412+0000","last_fullsized":"2024-09-21T09:13:45.523412+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:13.089799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292818+0000","last_change":"2024-09-21T09:13:19.145601+0000","last_active":"2024-09-21T09:13:34.292818+0000","last_peered":"2024-09-21T09:13:34.292818+0000","last_clean":"2024-09-21T09:13:34.292818+0000","last_became_active":"2024-09-21T09:13:19.142672+0000","last_became_peered":"2024-09-21T09:13:19.142672+0000","last_unstale":"2024-09-21T09:13:34.292818+0000","last_undegraded":"2024-09-21T09:13:34.292818+0000","last_fullsized":"2024-09-21T09:13:34.292818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.000309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"91'20","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.412513+0000","last_change":"2024-09-21T09:11:02.869796+0000","last_active":"2024-09-21T09:13:45.412513+0000","last_peered":"2024-09-21T09:13:45.412513+0000","last_clean":"2024-09-21T09:13:45.412513+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:13:45.412513+0000","last_undegraded":"2024-09-21T09:13:45.412513+0000","last_fullsized":"2024-09-21T09:13:45.412513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:48.332284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528134+0000","last_change":"2024-09-21T09:11:04.893727+0000","last_active":"2024-09-21T09:13:35.528134+0000","last_peered":"2024-09-21T09:13:35.528134+0000","last_clean":"2024-09-21T09:13:35.528134+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:35.528134+0000","last_undegraded":"2024-09-21T09:13:35.528134+0000","last_fullsized":"2024-09-21T09:13:35.528134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:18.437905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"71'7","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482678+0000","last_change":"2024-09-21T09:13:21.128242+0000","last_active":"2024-09-21T09:13:34.482678+0000","last_peered":"2024-09-21T09:13:34.482678+0000","last_clean":"2024-09-21T09:13:34.482678+0000","last_became_active":"2024-09-21T09:13:19.167169+0000","last_became_peered":"2024-09-21T09:13:19.167169+0000","last_unstale":"2024-09-21T09:13:34.482678+0000","last_undegraded":"2024-09-21T09:13:34.482678+0000","last_fullsized":"2024-09-21T09:13:34.482678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:46.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526036+0000","last_change":"2024-09-21T09:10:58.859005+0000","last_active":"2024-09-21T09:13:34.526036+0000","last_peered":"2024-09-21T09:13:34.526036+0000","last_clean":"2024-09-21T09:13:34.526036+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:13:34.526036+0000","last_undegraded":"2024-09-21T09:13:34.526036+0000","last_fullsized":"2024-09-21T09:13:34.526036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:38.110596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'18","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.575027+0000","last_change":"2024-09-21T09:10:56.860416+0000","last_active":"2024-09-21T09:13:45.575027+0000","last_peered":"2024-09-21T09:13:45.575027+0000","last_clean":"2024-09-21T09:13:45.575027+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:13:45.575027+0000","last_undegraded":"2024-09-21T09:13:45.575027+0000","last_fullsized":"2024-09-21T09:13:45.575027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:48.641425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482021+0000","last_change":"2024-09-21T09:13:19.153082+0000","last_active":"2024-09-21T09:13:34.482021+0000","last_peered":"2024-09-21T09:13:34.482021+0000","last_clean":"2024-09-21T09:13:34.482021+0000","last_became_active":"2024-09-21T09:13:19.152722+0000","last_became_peered":"2024-09-21T09:13:19.152722+0000","last_unstale":"2024-09-21T09:13:34.482021+0000","last_undegraded":"2024-09-21T09:13:34.482021+0000","last_fullsized":"2024-09-21T09:13:34.482021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:26.550403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"91'19","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.399781+0000","last_change":"2024-09-21T09:11:02.872950+0000","last_active":"2024-09-21T09:13:45.399781+0000","last_peered":"2024-09-21T09:13:45.399781+0000","last_clean":"2024-09-21T09:13:45.399781+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:13:45.399781+0000","last_undegraded":"2024-09-21T09:13:45.399781+0000","last_fullsized":"2024-09-21T09:13:45.399781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:46.881852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526197+0000","last_change":"2024-09-21T09:13:19.144593+0000","last_active":"2024-09-21T09:13:34.526197+0000","last_peered":"2024-09-21T09:13:34.526197+0000","last_clean":"2024-09-21T09:13:34.526197+0000","last_became_active":"2024-09-21T09:13:19.143577+0000","last_became_peered":"2024-09-21T09:13:19.143577+0000","last_unstale":"2024-09-21T09:13:34.526197+0000","last_undegraded":"2024-09-21T09:13:34.526197+0000","last_fullsized":"2024-09-21T09:13:34.526197+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:02.985464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483155+0000","last_change":"2024-09-21T09:10:58.839092+0000","last_active":"2024-09-21T09:13:34.483155+0000","last_peered":"2024-09-21T09:13:34.483155+0000","last_clean":"2024-09-21T09:13:34.483155+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:13:34.483155+0000","last_undegraded":"2024-09-21T09:13:34.483155+0000","last_fullsized":"2024-09-21T09:13:34.483155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:02.458655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"91'18","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.490383+0000","last_change":"2024-09-21T09:10:56.865435+0000","last_active":"2024-09-21T09:13:45.490383+0000","last_peered":"2024-09-21T09:13:45.490383+0000","last_clean":"2024-09-21T09:13:45.490383+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:13:45.490383+0000","last_undegraded":"2024-09-21T09:13:45.490383+0000","last_fullsized":"2024-09-21T09:13:45.490383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:10.542283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295267+0000","last_change":"2024-09-21T09:11:00.853152+0000","last_active":"2024-09-21T09:13:34.295267+0000","last_peered":"2024-09-21T09:13:34.295267+0000","last_clean":"2024-09-21T09:13:34.295267+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:13:34.295267+0000","last_undegraded":"2024-09-21T09:13:34.295267+0000","last_fullsized":"2024-09-21T09:13:34.295267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:10.134818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"91'30","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.396450+0000","last_change":"2024-09-21T09:11:02.879895+0000","last_active":"2024-09-21T09:13:45.396450+0000","last_peered":"2024-09-21T09:13:45.396450+0000","last_clean":"2024-09-21T09:13:45.396450+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:13:45.396450+0000","last_undegraded":"2024-09-21T09:13:45.396450+0000","last_fullsized":"2024-09-21T09:13:45.396450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:52.957141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298886+0000","last_change":"2024-09-21T09:13:19.166381+0000","last_active":"2024-09-21T09:13:34.298886+0000","last_peered":"2024-09-21T09:13:34.298886+0000","last_clean":"2024-09-21T09:13:34.298886+0000","last_became_active":"2024-09-21T09:13:19.165859+0000","last_became_peered":"2024-09-21T09:13:19.165859+0000","last_unstale":"2024-09-21T09:13:34.298886+0000","last_undegraded":"2024-09-21T09:13:34.298886+0000","last_fullsized":"2024-09-21T09:13:34.298886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:20.747731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957270+0000","last_change":"2024-09-21T09:11:06.896002+0000","last_active":"2024-09-21T09:13:34.957270+0000","last_peered":"2024-09-21T09:13:34.957270+0000","last_clean":"2024-09-21T09:13:34.957270+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:13:34.957270+0000","last_undegraded":"2024-09-21T09:13:34.957270+0000","last_fullsized":"2024-09-21T09:13:34.957270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:01.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"71'10","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378657+0000","last_change":"2024-09-21T09:10:58.868892+0000","last_active":"2024-09-21T09:13:35.378657+0000","last_peered":"2024-09-21T09:13:35.378657+0000","last_clean":"2024-09-21T09:13:35.378657+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:13:35.378657+0000","last_undegraded":"2024-09-21T09:13:35.378657+0000","last_fullsized":"2024-09-21T09:13:35.378657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:54.332686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"91'10","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.518813+0000","last_change":"2024-09-21T09:10:56.827351+0000","last_active":"2024-09-21T09:13:45.518813+0000","last_peered":"2024-09-21T09:13:45.518813+0000","last_clean":"2024-09-21T09:13:45.518813+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:13:45.518813+0000","last_undegraded":"2024-09-21T09:13:45.518813+0000","last_fullsized":"2024-09-21T09:13:45.518813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:49.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298002+0000","last_change":"2024-09-21T09:13:19.159092+0000","last_active":"2024-09-21T09:13:34.298002+0000","last_peered":"2024-09-21T09:13:34.298002+0000","last_clean":"2024-09-21T09:13:34.298002+0000","last_became_active":"2024-09-21T09:13:19.158652+0000","last_became_peered":"2024-09-21T09:13:19.158652+0000","last_unstale":"2024-09-21T09:13:34.298002+0000","last_undegraded":"2024-09-21T09:13:34.298002+0000","last_fullsized":"2024-09-21T09:13:34.298002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:32.340994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"91'25","reported_seq":209,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.404072+0000","last_change":"2024-09-21T09:13:21.165572+0000","last_active":"2024-09-21T09:13:45.404072+0000","last_peered":"2024-09-21T09:13:45.404072+0000","last_clean":"2024-09-21T09:13:45.404072+0000","last_became_active":"2024-09-21T09:13:19.167344+0000","last_became_peered":"2024-09-21T09:13:19.167344+0000","last_unstale":"2024-09-21T09:13:45.404072+0000","last_undegraded":"2024-09-21T09:13:45.404072+0000","last_fullsized":"2024-09-21T09:13:45.404072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:05.930094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956457+0000","last_change":"2024-09-21T09:11:04.890782+0000","last_active":"2024-09-21T09:13:34.956457+0000","last_peered":"2024-09-21T09:13:34.956457+0000","last_clean":"2024-09-21T09:13:34.956457+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:13:34.956457+0000","last_undegraded":"2024-09-21T09:13:34.956457+0000","last_fullsized":"2024-09-21T09:13:34.956457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:42.740558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"71'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482532+0000","last_change":"2024-09-21T09:11:06.889510+0000","last_active":"2024-09-21T09:13:34.482532+0000","last_peered":"2024-09-21T09:13:34.482532+0000","last_clean":"2024-09-21T09:13:34.482532+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:13:34.482532+0000","last_undegraded":"2024-09-21T09:13:34.482532+0000","last_fullsized":"2024-09-21T09:13:34.482532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:38.377418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"62'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527248+0000","last_change":"2024-09-21T09:10:58.854750+0000","last_active":"2024-09-21T09:13:34.527248+0000","last_peered":"2024-09-21T09:13:34.527248+0000","last_clean":"2024-09-21T09:13:34.527248+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:13:34.527248+0000","last_undegraded":"2024-09-21T09:13:34.527248+0000","last_fullsized":"2024-09-21T09:13:34.527248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:35.559151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"91'20","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.530993+0000","last_change":"2024-09-21T09:10:56.863198+0000","last_active":"2024-09-21T09:13:45.530993+0000","last_peered":"2024-09-21T09:13:45.530993+0000","last_clean":"2024-09-21T09:13:45.530993+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:13:45.530993+0000","last_undegraded":"2024-09-21T09:13:45.530993+0000","last_fullsized":"2024-09-21T09:13:45.530993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.005564+0000","last_change":"2024-09-21T09:13:20.592162+0000","last_active":"2024-09-21T09:13:45.005564+0000","last_peered":"2024-09-21T09:13:45.005564+0000","last_clean":"2024-09-21T09:13:45.005564+0000","last_became_active":"2024-09-21T09:13:19.165929+0000","last_became_peered":"2024-09-21T09:13:19.165929+0000","last_unstale":"2024-09-21T09:13:45.005564+0000","last_undegraded":"2024-09-21T09:13:45.005564+0000","last_fullsized":"2024-09-21T09:13:45.005564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:26:41.372526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"91'20","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.171814+0000","last_change":"2024-09-21T09:11:02.879188+0000","last_active":"2024-09-21T09:13:45.171814+0000","last_peered":"2024-09-21T09:13:45.171814+0000","last_clean":"2024-09-21T09:13:45.171814+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:13:45.171814+0000","last_undegraded":"2024-09-21T09:13:45.171814+0000","last_fullsized":"2024-09-21T09:13:45.171814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:37.208901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527107+0000","last_change":"2024-09-21T09:11:04.880786+0000","last_active":"2024-09-21T09:13:34.527107+0000","last_peered":"2024-09-21T09:13:34.527107+0000","last_clean":"2024-09-21T09:13:34.527107+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:13:34.527107+0000","last_undegraded":"2024-09-21T09:13:34.527107+0000","last_fullsized":"2024-09-21T09:13:34.527107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:54.975208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"62'10","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481914+0000","last_change":"2024-09-21T09:11:06.898517+0000","last_active":"2024-09-21T09:13:34.481914+0000","last_peered":"2024-09-21T09:13:34.481914+0000","last_clean":"2024-09-21T09:13:34.481914+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:13:34.481914+0000","last_undegraded":"2024-09-21T09:13:34.481914+0000","last_fullsized":"2024-09-21T09:13:34.481914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:46.036732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":39,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377669+0000","last_change":"2024-09-21T09:10:58.868807+0000","last_active":"2024-09-21T09:13:35.377669+0000","last_peered":"2024-09-21T09:13:35.377669+0000","last_clean":"2024-09-21T09:13:35.377669+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:13:35.377669+0000","last_undegraded":"2024-09-21T09:13:35.377669+0000","last_fullsized":"2024-09-21T09:13:35.377669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.574650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"91'24","reported_seq":167,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.542191+0000","last_change":"2024-09-21T09:10:56.851205+0000","last_active":"2024-09-21T09:13:45.542191+0000","last_peered":"2024-09-21T09:13:45.542191+0000","last_clean":"2024-09-21T09:13:45.542191+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:13:45.542191+0000","last_undegraded":"2024-09-21T09:13:45.542191+0000","last_fullsized":"2024-09-21T09:13:45.542191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:52.423650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377224+0000","last_change":"2024-09-21T09:11:00.856830+0000","last_active":"2024-09-21T09:13:35.377224+0000","last_peered":"2024-09-21T09:13:35.377224+0000","last_clean":"2024-09-21T09:13:35.377224+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:13:35.377224+0000","last_undegraded":"2024-09-21T09:13:35.377224+0000","last_fullsized":"2024-09-21T09:13:35.377224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:24:45.947857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"74'14","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483000+0000","last_change":"2024-09-21T09:13:21.153990+0000","last_active":"2024-09-21T09:13:34.483000+0000","last_peered":"2024-09-21T09:13:34.483000+0000","last_clean":"2024-09-21T09:13:34.483000+0000","last_became_active":"2024-09-21T09:13:19.167321+0000","last_became_peered":"2024-09-21T09:13:19.167321+0000","last_unstale":"2024-09-21T09:13:34.483000+0000","last_undegraded":"2024-09-21T09:13:34.483000+0000","last_fullsized":"2024-09-21T09:13:34.483000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:34.649177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"91'105","reported_seq":274,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.048759+0000","last_change":"2024-09-21T09:11:04.870463+0000","last_active":"2024-09-21T09:13:45.048759+0000","last_peered":"2024-09-21T09:13:45.048759+0000","last_clean":"2024-09-21T09:13:45.048759+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:13:45.048759+0000","last_undegraded":"2024-09-21T09:13:45.048759+0000","last_fullsized":"2024-09-21T09:13:45.048759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:47:30.495090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"58'2","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.481854+0000","last_change":"2024-09-21T09:11:06.883550+0000","last_active":"2024-09-21T09:13:34.481854+0000","last_peered":"2024-09-21T09:13:34.481854+0000","last_clean":"2024-09-21T09:13:34.481854+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:13:34.481854+0000","last_undegraded":"2024-09-21T09:13:34.481854+0000","last_fullsized":"2024-09-21T09:13:34.481854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:56.825424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"71'10","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296041+0000","last_change":"2024-09-21T09:13:19.537524+0000","last_active":"2024-09-21T09:13:34.296041+0000","last_peered":"2024-09-21T09:13:34.296041+0000","last_clean":"2024-09-21T09:13:34.296041+0000","last_became_active":"2024-09-21T09:13:19.159904+0000","last_became_peered":"2024-09-21T09:13:19.159904+0000","last_unstale":"2024-09-21T09:13:34.296041+0000","last_undegraded":"2024-09-21T09:13:34.296041+0000","last_fullsized":"2024-09-21T09:13:34.296041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:12.531734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"91'22","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.537531+0000","last_change":"2024-09-21T09:10:56.852586+0000","last_active":"2024-09-21T09:13:45.537531+0000","last_peered":"2024-09-21T09:13:45.537531+0000","last_clean":"2024-09-21T09:13:45.537531+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:13:45.537531+0000","last_undegraded":"2024-09-21T09:13:45.537531+0000","last_fullsized":"2024-09-21T09:13:45.537531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:41.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528271+0000","last_change":"2024-09-21T09:11:00.839800+0000","last_active":"2024-09-21T09:13:35.528271+0000","last_peered":"2024-09-21T09:13:35.528271+0000","last_clean":"2024-09-21T09:13:35.528271+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:13:35.528271+0000","last_undegraded":"2024-09-21T09:13:35.528271+0000","last_fullsized":"2024-09-21T09:13:35.528271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:21.140377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"91'25","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.370960+0000","last_change":"2024-09-21T09:11:02.857087+0000","last_active":"2024-09-21T09:13:45.370960+0000","last_peered":"2024-09-21T09:13:45.370960+0000","last_clean":"2024-09-21T09:13:45.370960+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:13:45.370960+0000","last_undegraded":"2024-09-21T09:13:45.370960+0000","last_fullsized":"2024-09-21T09:13:45.370960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:40.283080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376271+0000","last_change":"2024-09-21T09:11:04.872303+0000","last_active":"2024-09-21T09:13:35.376271+0000","last_peered":"2024-09-21T09:13:35.376271+0000","last_clean":"2024-09-21T09:13:35.376271+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:13:35.376271+0000","last_undegraded":"2024-09-21T09:13:35.376271+0000","last_fullsized":"2024-09-21T09:13:35.376271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:28.517451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"71'10","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527841+0000","last_change":"2024-09-21T09:11:06.873636+0000","last_active":"2024-09-21T09:13:35.527841+0000","last_peered":"2024-09-21T09:13:35.527841+0000","last_clean":"2024-09-21T09:13:35.527841+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:13:35.527841+0000","last_undegraded":"2024-09-21T09:13:35.527841+0000","last_fullsized":"2024-09-21T09:13:35.527841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:52.693664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293210+0000","last_change":"2024-09-21T09:13:19.144377+0000","last_active":"2024-09-21T09:13:34.293210+0000","last_peered":"2024-09-21T09:13:34.293210+0000","last_clean":"2024-09-21T09:13:34.293210+0000","last_became_active":"2024-09-21T09:13:19.143746+0000","last_became_peered":"2024-09-21T09:13:19.143746+0000","last_unstale":"2024-09-21T09:13:34.293210+0000","last_undegraded":"2024-09-21T09:13:34.293210+0000","last_fullsized":"2024-09-21T09:13:34.293210+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:48.781954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"91'30","reported_seq":175,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.530838+0000","last_change":"2024-09-21T09:11:34.170912+0000","last_active":"2024-09-21T09:13:45.530838+0000","last_peered":"2024-09-21T09:13:45.530838+0000","last_clean":"2024-09-21T09:13:45.530838+0000","last_became_active":"2024-09-21T09:11:34.170599+0000","last_became_peered":"2024-09-21T09:11:34.170599+0000","last_unstale":"2024-09-21T09:13:45.530838+0000","last_undegraded":"2024-09-21T09:13:45.530838+0000","last_fullsized":"2024-09-21T09:13:45.530838+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:46.495986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296362+0000","last_change":"2024-09-21T09:13:19.144365+0000","last_active":"2024-09-21T09:13:34.296362+0000","last_peered":"2024-09-21T09:13:34.296362+0000","last_clean":"2024-09-21T09:13:34.296362+0000","last_became_active":"2024-09-21T09:13:19.141404+0000","last_became_peered":"2024-09-21T09:13:19.141404+0000","last_unstale":"2024-09-21T09:13:34.296362+0000","last_undegraded":"2024-09-21T09:13:34.296362+0000","last_fullsized":"2024-09-21T09:13:34.296362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:05.438476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"91'19","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.374362+0000","last_change":"2024-09-21T09:11:02.847926+0000","last_active":"2024-09-21T09:13:45.374362+0000","last_peered":"2024-09-21T09:13:45.374362+0000","last_clean":"2024-09-21T09:13:45.374362+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:13:45.374362+0000","last_undegraded":"2024-09-21T09:13:45.374362+0000","last_fullsized":"2024-09-21T09:13:45.374362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:15.592269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482045+0000","last_change":"2024-09-21T09:11:04.880866+0000","last_active":"2024-09-21T09:13:34.482045+0000","last_peered":"2024-09-21T09:13:34.482045+0000","last_clean":"2024-09-21T09:13:34.482045+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:13:34.482045+0000","last_undegraded":"2024-09-21T09:13:34.482045+0000","last_fullsized":"2024-09-21T09:13:34.482045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:02.568576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":121,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957411+0000","last_change":"2024-09-21T09:11:06.899493+0000","last_active":"2024-09-21T09:13:34.957411+0000","last_peered":"2024-09-21T09:13:34.957411+0000","last_clean":"2024-09-21T09:13:34.957411+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:13:34.957411+0000","last_undegraded":"2024-09-21T09:13:34.957411+0000","last_fullsized":"2024-09-21T09:13:34.957411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:50.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525954+0000","last_change":"2024-09-21T09:10:58.856310+0000","last_active":"2024-09-21T09:13:34.525954+0000","last_peered":"2024-09-21T09:13:34.525954+0000","last_clean":"2024-09-21T09:13:34.525954+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:13:34.525954+0000","last_undegraded":"2024-09-21T09:13:34.525954+0000","last_fullsized":"2024-09-21T09:13:34.525954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:12.549438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"91'22","reported_seq":221,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.600482+0000","last_change":"2024-09-21T09:13:20.628384+0000","last_active":"2024-09-21T09:13:45.600482+0000","last_peered":"2024-09-21T09:13:45.600482+0000","last_clean":"2024-09-21T09:13:45.600482+0000","last_became_active":"2024-09-21T09:13:19.169569+0000","last_became_peered":"2024-09-21T09:13:19.169569+0000","last_unstale":"2024-09-21T09:13:45.600482+0000","last_undegraded":"2024-09-21T09:13:45.600482+0000","last_fullsized":"2024-09-21T09:13:45.600482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:00.389819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526949+0000","last_change":"2024-09-21T09:11:00.837141+0000","last_active":"2024-09-21T09:13:35.526949+0000","last_peered":"2024-09-21T09:13:35.526949+0000","last_clean":"2024-09-21T09:13:35.526949+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:13:35.526949+0000","last_undegraded":"2024-09-21T09:13:35.526949+0000","last_fullsized":"2024-09-21T09:13:35.526949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:09:46.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"91'14","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.155507+0000","last_change":"2024-09-21T09:13:20.076515+0000","last_active":"2024-09-21T09:13:45.155507+0000","last_peered":"2024-09-21T09:13:45.155507+0000","last_clean":"2024-09-21T09:13:45.155507+0000","last_became_active":"2024-09-21T09:13:19.150207+0000","last_became_peered":"2024-09-21T09:13:19.150207+0000","last_unstale":"2024-09-21T09:13:45.155507+0000","last_undegraded":"2024-09-21T09:13:45.155507+0000","last_fullsized":"2024-09-21T09:13:45.155507+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:07.663510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482052+0000","last_change":"2024-09-21T09:11:04.887172+0000","last_active":"2024-09-21T09:13:34.482052+0000","last_peered":"2024-09-21T09:13:34.482052+0000","last_clean":"2024-09-21T09:13:34.482052+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:13:34.482052+0000","last_undegraded":"2024-09-21T09:13:34.482052+0000","last_fullsized":"2024-09-21T09:13:34.482052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:01.250555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482536+0000","last_change":"2024-09-21T09:13:19.157682+0000","last_active":"2024-09-21T09:13:34.482536+0000","last_peered":"2024-09-21T09:13:34.482536+0000","last_clean":"2024-09-21T09:13:34.482536+0000","last_became_active":"2024-09-21T09:13:19.157306+0000","last_became_peered":"2024-09-21T09:13:19.157306+0000","last_unstale":"2024-09-21T09:13:34.482536+0000","last_undegraded":"2024-09-21T09:13:34.482536+0000","last_fullsized":"2024-09-21T09:13:34.482536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.786122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"71'4","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.292810+0000","last_change":"2024-09-21T09:13:19.713138+0000","last_active":"2024-09-21T09:13:34.292810+0000","last_peered":"2024-09-21T09:13:34.292810+0000","last_clean":"2024-09-21T09:13:34.292810+0000","last_became_active":"2024-09-21T09:13:19.161496+0000","last_became_peered":"2024-09-21T09:13:19.161496+0000","last_unstale":"2024-09-21T09:13:34.292810+0000","last_undegraded":"2024-09-21T09:13:34.292810+0000","last_fullsized":"2024-09-21T09:13:34.292810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:42.440821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"91'8","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.336897+0000","last_change":"2024-09-21T09:10:56.861373+0000","last_active":"2024-09-21T09:13:45.336897+0000","last_peered":"2024-09-21T09:13:45.336897+0000","last_clean":"2024-09-21T09:13:45.336897+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:13:45.336897+0000","last_undegraded":"2024-09-21T09:13:45.336897+0000","last_fullsized":"2024-09-21T09:13:45.336897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:45.846021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376270+0000","last_change":"2024-09-21T09:11:00.838647+0000","last_active":"2024-09-21T09:13:35.376270+0000","last_peered":"2024-09-21T09:13:35.376270+0000","last_clean":"2024-09-21T09:13:35.376270+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:13:35.376270+0000","last_undegraded":"2024-09-21T09:13:35.376270+0000","last_fullsized":"2024-09-21T09:13:35.376270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:16.279789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"91'21","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.353747+0000","last_change":"2024-09-21T09:11:02.877357+0000","last_active":"2024-09-21T09:13:45.353747+0000","last_peered":"2024-09-21T09:13:45.353747+0000","last_clean":"2024-09-21T09:13:45.353747+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:13:45.353747+0000","last_undegraded":"2024-09-21T09:13:45.353747+0000","last_fullsized":"2024-09-21T09:13:45.353747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:46.845302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":155,"num_write":18,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378889+0000","last_change":"2024-09-21T09:11:04.896698+0000","last_active":"2024-09-21T09:13:35.378889+0000","last_peered":"2024-09-21T09:13:35.378889+0000","last_clean":"2024-09-21T09:13:35.378889+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:13:35.378889+0000","last_undegraded":"2024-09-21T09:13:35.378889+0000","last_fullsized":"2024-09-21T09:13:35.378889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:59.924890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297318+0000","last_change":"2024-09-21T09:13:20.646926+0000","last_active":"2024-09-21T09:13:34.297318+0000","last_peered":"2024-09-21T09:13:34.297318+0000","last_clean":"2024-09-21T09:13:34.297318+0000","last_became_active":"2024-09-21T09:13:19.153765+0000","last_became_peered":"2024-09-21T09:13:19.153765+0000","last_unstale":"2024-09-21T09:13:34.297318+0000","last_undegraded":"2024-09-21T09:13:34.297318+0000","last_fullsized":"2024-09-21T09:13:34.297318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:46.413243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'6","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378620+0000","last_change":"2024-09-21T09:10:58.865842+0000","last_active":"2024-09-21T09:13:35.378620+0000","last_peered":"2024-09-21T09:13:35.378620+0000","last_clean":"2024-09-21T09:13:35.378620+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:13:35.378620+0000","last_undegraded":"2024-09-21T09:13:35.378620+0000","last_fullsized":"2024-09-21T09:13:35.378620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:10.069785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"91'14","reported_seq":63,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.351383+0000","last_change":"2024-09-21T09:13:19.522324+0000","last_active":"2024-09-21T09:13:45.351383+0000","last_peered":"2024-09-21T09:13:45.351383+0000","last_clean":"2024-09-21T09:13:45.351383+0000","last_became_active":"2024-09-21T09:13:19.143052+0000","last_became_peered":"2024-09-21T09:13:19.143052+0000","last_unstale":"2024-09-21T09:13:45.351383+0000","last_undegraded":"2024-09-21T09:13:45.351383+0000","last_fullsized":"2024-09-21T09:13:45.351383+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:36.362618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"71'8","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527890+0000","last_change":"2024-09-21T09:10:58.871267+0000","last_active":"2024-09-21T09:13:34.527890+0000","last_peered":"2024-09-21T09:13:34.527890+0000","last_clean":"2024-09-21T09:13:34.527890+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:13:34.527890+0000","last_undegraded":"2024-09-21T09:13:34.527890+0000","last_fullsized":"2024-09-21T09:13:34.527890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:02.416422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"91'16","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.575297+0000","last_change":"2024-09-21T09:10:56.847914+0000","last_active":"2024-09-21T09:13:45.575297+0000","last_peered":"2024-09-21T09:13:45.575297+0000","last_clean":"2024-09-21T09:13:45.575297+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:13:45.575297+0000","last_undegraded":"2024-09-21T09:13:45.575297+0000","last_fullsized":"2024-09-21T09:13:45.575297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:18.284819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482765+0000","last_change":"2024-09-21T09:10:58.837841+0000","last_active":"2024-09-21T09:13:34.482765+0000","last_peered":"2024-09-21T09:13:34.482765+0000","last_clean":"2024-09-21T09:13:34.482765+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:13:34.482765+0000","last_undegraded":"2024-09-21T09:13:34.482765+0000","last_fullsized":"2024-09-21T09:13:34.482765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:54.101397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"91'22","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.580693+0000","last_change":"2024-09-21T09:10:56.861995+0000","last_active":"2024-09-21T09:13:45.580693+0000","last_peered":"2024-09-21T09:13:45.580693+0000","last_clean":"2024-09-21T09:13:45.580693+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:13:45.580693+0000","last_undegraded":"2024-09-21T09:13:45.580693+0000","last_fullsized":"2024-09-21T09:13:45.580693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:44.655482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"58'4","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957038+0000","last_change":"2024-09-21T09:13:20.835461+0000","last_active":"2024-09-21T09:13:34.957038+0000","last_peered":"2024-09-21T09:13:34.957038+0000","last_clean":"2024-09-21T09:13:34.957038+0000","last_became_active":"2024-09-21T09:13:19.169698+0000","last_became_peered":"2024-09-21T09:13:19.169698+0000","last_unstale":"2024-09-21T09:13:34.957038+0000","last_undegraded":"2024-09-21T09:13:34.957038+0000","last_fullsized":"2024-09-21T09:13:34.957038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:00.406380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"91'12","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.351315+0000","last_change":"2024-09-21T09:10:56.866139+0000","last_active":"2024-09-21T09:13:45.351315+0000","last_peered":"2024-09-21T09:13:45.351315+0000","last_clean":"2024-09-21T09:13:45.351315+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:13:45.351315+0000","last_undegraded":"2024-09-21T09:13:45.351315+0000","last_fullsized":"2024-09-21T09:13:45.351315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:33.551996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"58'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956535+0000","last_change":"2024-09-21T09:10:58.840408+0000","last_active":"2024-09-21T09:13:34.956535+0000","last_peered":"2024-09-21T09:13:34.956535+0000","last_clean":"2024-09-21T09:13:34.956535+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:13:34.956535+0000","last_undegraded":"2024-09-21T09:13:34.956535+0000","last_fullsized":"2024-09-21T09:13:34.956535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:42.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"91'16","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.518570+0000","last_change":"2024-09-21T09:10:56.860054+0000","last_active":"2024-09-21T09:13:45.518570+0000","last_peered":"2024-09-21T09:13:45.518570+0000","last_clean":"2024-09-21T09:13:45.518570+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:13:45.518570+0000","last_undegraded":"2024-09-21T09:13:45.518570+0000","last_fullsized":"2024-09-21T09:13:45.518570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:17.459607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"71'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.296113+0000","last_change":"2024-09-21T09:10:58.836500+0000","last_active":"2024-09-21T09:13:34.296113+0000","last_peered":"2024-09-21T09:13:34.296113+0000","last_clean":"2024-09-21T09:13:34.296113+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:13:34.296113+0000","last_undegraded":"2024-09-21T09:13:34.296113+0000","last_fullsized":"2024-09-21T09:13:34.296113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"91'16","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.517272+0000","last_change":"2024-09-21T09:10:56.862765+0000","last_active":"2024-09-21T09:13:45.517272+0000","last_peered":"2024-09-21T09:13:45.517272+0000","last_clean":"2024-09-21T09:13:45.517272+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:13:45.517272+0000","last_undegraded":"2024-09-21T09:13:45.517272+0000","last_fullsized":"2024-09-21T09:13:45.517272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"62'2","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294186+0000","last_change":"2024-09-21T09:10:58.826466+0000","last_active":"2024-09-21T09:13:34.294186+0000","last_peered":"2024-09-21T09:13:34.294186+0000","last_clean":"2024-09-21T09:13:34.294186+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:13:34.294186+0000","last_undegraded":"2024-09-21T09:13:34.294186+0000","last_fullsized":"2024-09-21T09:13:34.294186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"91'18","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.457464+0000","last_change":"2024-09-21T09:13:20.211974+0000","last_active":"2024-09-21T09:13:45.457464+0000","last_peered":"2024-09-21T09:13:45.457464+0000","last_clean":"2024-09-21T09:13:45.457464+0000","last_became_active":"2024-09-21T09:13:19.161214+0000","last_became_peered":"2024-09-21T09:13:19.161214+0000","last_unstale":"2024-09-21T09:13:45.457464+0000","last_undegraded":"2024-09-21T09:13:45.457464+0000","last_fullsized":"2024-09-21T09:13:45.457464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:40:58.281738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"62'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527446+0000","last_change":"2024-09-21T09:10:58.872072+0000","last_active":"2024-09-21T09:13:35.527446+0000","last_peered":"2024-09-21T09:13:35.527446+0000","last_clean":"2024-09-21T09:13:35.527446+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:13:35.527446+0000","last_undegraded":"2024-09-21T09:13:35.527446+0000","last_fullsized":"2024-09-21T09:13:35.527446+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:11.601499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"91'18","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.513515+0000","last_change":"2024-09-21T09:10:56.861072+0000","last_active":"2024-09-21T09:13:45.513515+0000","last_peered":"2024-09-21T09:13:45.513515+0000","last_clean":"2024-09-21T09:13:45.513515+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:13:45.513515+0000","last_undegraded":"2024-09-21T09:13:45.513515+0000","last_fullsized":"2024-09-21T09:13:45.513515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:05.228490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"71'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527799+0000","last_change":"2024-09-21T09:10:58.856982+0000","last_active":"2024-09-21T09:13:34.527799+0000","last_peered":"2024-09-21T09:13:34.527799+0000","last_clean":"2024-09-21T09:13:34.527799+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:13:34.527799+0000","last_undegraded":"2024-09-21T09:13:34.527799+0000","last_fullsized":"2024-09-21T09:13:34.527799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:34.590590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"91'14","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.526942+0000","last_change":"2024-09-21T09:10:56.847793+0000","last_active":"2024-09-21T09:13:45.526942+0000","last_peered":"2024-09-21T09:13:45.526942+0000","last_clean":"2024-09-21T09:13:45.526942+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:13:45.526942+0000","last_undegraded":"2024-09-21T09:13:45.526942+0000","last_fullsized":"2024-09-21T09:13:45.526942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:46:22.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"62'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298133+0000","last_change":"2024-09-21T09:10:58.851481+0000","last_active":"2024-09-21T09:13:34.298133+0000","last_peered":"2024-09-21T09:13:34.298133+0000","last_clean":"2024-09-21T09:13:34.298133+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:13:34.298133+0000","last_undegraded":"2024-09-21T09:13:34.298133+0000","last_fullsized":"2024-09-21T09:13:34.298133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:42.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"91'24","reported_seq":227,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.575866+0000","last_change":"2024-09-21T09:13:20.068227+0000","last_active":"2024-09-21T09:13:45.575866+0000","last_peered":"2024-09-21T09:13:45.575866+0000","last_clean":"2024-09-21T09:13:45.575866+0000","last_became_active":"2024-09-21T09:13:19.169480+0000","last_became_peered":"2024-09-21T09:13:19.169480+0000","last_unstale":"2024-09-21T09:13:45.575866+0000","last_undegraded":"2024-09-21T09:13:45.575866+0000","last_fullsized":"2024-09-21T09:13:45.575866+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:08.928533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957005+0000","last_change":"2024-09-21T09:10:58.843673+0000","last_active":"2024-09-21T09:13:34.957005+0000","last_peered":"2024-09-21T09:13:34.957005+0000","last_clean":"2024-09-21T09:13:34.957005+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:13:34.957005+0000","last_undegraded":"2024-09-21T09:13:34.957005+0000","last_fullsized":"2024-09-21T09:13:34.957005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:19.133330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.538901+0000","last_change":"2024-09-21T09:10:56.838835+0000","last_active":"2024-09-21T09:13:45.538901+0000","last_peered":"2024-09-21T09:13:45.538901+0000","last_clean":"2024-09-21T09:13:45.538901+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:13:45.538901+0000","last_undegraded":"2024-09-21T09:13:45.538901+0000","last_fullsized":"2024-09-21T09:13:45.538901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:32.410911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529034+0000","last_change":"2024-09-21T09:10:58.869168+0000","last_active":"2024-09-21T09:13:35.529034+0000","last_peered":"2024-09-21T09:13:35.529034+0000","last_clean":"2024-09-21T09:13:35.529034+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:13:35.529034+0000","last_undegraded":"2024-09-21T09:13:35.529034+0000","last_fullsized":"2024-09-21T09:13:35.529034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:22.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'26","reported_seq":235,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.594032+0000","last_change":"2024-09-21T09:13:20.275872+0000","last_active":"2024-09-21T09:13:45.594032+0000","last_peered":"2024-09-21T09:13:45.594032+0000","last_clean":"2024-09-21T09:13:45.594032+0000","last_became_active":"2024-09-21T09:13:19.153073+0000","last_became_peered":"2024-09-21T09:13:19.153073+0000","last_unstale":"2024-09-21T09:13:45.594032+0000","last_undegraded":"2024-09-21T09:13:45.594032+0000","last_fullsized":"2024-09-21T09:13:45.594032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:03:51.699749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526744+0000","last_change":"2024-09-21T09:10:58.840930+0000","last_active":"2024-09-21T09:13:35.526744+0000","last_peered":"2024-09-21T09:13:35.526744+0000","last_clean":"2024-09-21T09:13:35.526744+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:13:35.526744+0000","last_undegraded":"2024-09-21T09:13:35.526744+0000","last_fullsized":"2024-09-21T09:13:35.526744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:07.235645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"91'26","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.536626+0000","last_change":"2024-09-21T09:10:56.841366+0000","last_active":"2024-09-21T09:13:45.536626+0000","last_peered":"2024-09-21T09:13:45.536626+0000","last_clean":"2024-09-21T09:13:45.536626+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:13:45.536626+0000","last_undegraded":"2024-09-21T09:13:45.536626+0000","last_fullsized":"2024-09-21T09:13:45.536626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:36:15.948479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526167+0000","last_change":"2024-09-21T09:10:58.873865+0000","last_active":"2024-09-21T09:13:34.526167+0000","last_peered":"2024-09-21T09:13:34.526167+0000","last_clean":"2024-09-21T09:13:34.526167+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:13:34.526167+0000","last_undegraded":"2024-09-21T09:13:34.526167+0000","last_fullsized":"2024-09-21T09:13:34.526167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:57:27.576124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"91'10","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.430454+0000","last_change":"2024-09-21T09:10:56.843359+0000","last_active":"2024-09-21T09:13:45.430454+0000","last_peered":"2024-09-21T09:13:45.430454+0000","last_clean":"2024-09-21T09:13:45.430454+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:13:45.430454+0000","last_undegraded":"2024-09-21T09:13:45.430454+0000","last_fullsized":"2024-09-21T09:13:45.430454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:17.126175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"71'4","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377059+0000","last_change":"2024-09-21T09:10:58.864268+0000","last_active":"2024-09-21T09:13:35.377059+0000","last_peered":"2024-09-21T09:13:35.377059+0000","last_clean":"2024-09-21T09:13:35.377059+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:13:35.377059+0000","last_undegraded":"2024-09-21T09:13:35.377059+0000","last_fullsized":"2024-09-21T09:13:35.377059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:22.929821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"91'18","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.347445+0000","last_change":"2024-09-21T09:13:19.704634+0000","last_active":"2024-09-21T09:13:45.347445+0000","last_peered":"2024-09-21T09:13:45.347445+0000","last_clean":"2024-09-21T09:13:45.347445+0000","last_became_active":"2024-09-21T09:13:19.159408+0000","last_became_peered":"2024-09-21T09:13:19.159408+0000","last_unstale":"2024-09-21T09:13:45.347445+0000","last_undegraded":"2024-09-21T09:13:45.347445+0000","last_fullsized":"2024-09-21T09:13:45.347445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:49.771475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527340+0000","last_change":"2024-09-21T09:10:58.840040+0000","last_active":"2024-09-21T09:13:35.527340+0000","last_peered":"2024-09-21T09:13:35.527340+0000","last_clean":"2024-09-21T09:13:35.527340+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:13:35.527340+0000","last_undegraded":"2024-09-21T09:13:35.527340+0000","last_fullsized":"2024-09-21T09:13:35.527340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:57.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'22","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.514743+0000","last_change":"2024-09-21T09:10:56.845828+0000","last_active":"2024-09-21T09:13:45.514743+0000","last_peered":"2024-09-21T09:13:45.514743+0000","last_clean":"2024-09-21T09:13:45.514743+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:13:45.514743+0000","last_undegraded":"2024-09-21T09:13:45.514743+0000","last_fullsized":"2024-09-21T09:13:45.514743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:37.489093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"91'16","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.541182+0000","last_change":"2024-09-21T09:13:20.828458+0000","last_active":"2024-09-21T09:13:45.541182+0000","last_peered":"2024-09-21T09:13:45.541182+0000","last_clean":"2024-09-21T09:13:45.541182+0000","last_became_active":"2024-09-21T09:13:19.155182+0000","last_became_peered":"2024-09-21T09:13:19.155182+0000","last_unstale":"2024-09-21T09:13:45.541182+0000","last_undegraded":"2024-09-21T09:13:45.541182+0000","last_fullsized":"2024-09-21T09:13:45.541182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:34.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378422+0000","last_change":"2024-09-21T09:10:58.871879+0000","last_active":"2024-09-21T09:13:35.378422+0000","last_peered":"2024-09-21T09:13:35.378422+0000","last_clean":"2024-09-21T09:13:35.378422+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:13:35.378422+0000","last_undegraded":"2024-09-21T09:13:35.378422+0000","last_fullsized":"2024-09-21T09:13:35.378422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:28.117298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"91'20","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.484672+0000","last_change":"2024-09-21T09:10:56.862439+0000","last_active":"2024-09-21T09:13:45.484672+0000","last_peered":"2024-09-21T09:13:45.484672+0000","last_clean":"2024-09-21T09:13:45.484672+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:13:45.484672+0000","last_undegraded":"2024-09-21T09:13:45.484672+0000","last_fullsized":"2024-09-21T09:13:45.484672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:26:36.103441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"62'4","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527158+0000","last_change":"2024-09-21T09:10:58.828974+0000","last_active":"2024-09-21T09:13:35.527158+0000","last_peered":"2024-09-21T09:13:35.527158+0000","last_clean":"2024-09-21T09:13:35.527158+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:13:35.527158+0000","last_undegraded":"2024-09-21T09:13:35.527158+0000","last_fullsized":"2024-09-21T09:13:35.527158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:41:50.648579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":233,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":848,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":844,"ondisk_log_size":844,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1023,"num_read_kb":1069,"num_write":533,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":660,"num_keys_recovered":24,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":771,"ondisk_log_size":771,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":250,"num_read_kb":250,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":545,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":23,"num_write":1216,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":1149239296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36488,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335352,"statfs":{"total":96636764160,"available":96599400448,"internally_reserved":0,"allocated":1110016,"data_stored":600664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36432,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335408,"statfs":{"total":96636764160,"available":96599457792,"internally_reserved":0,"allocated":1105920,"data_stored":599726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41168,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330672,"statfs":{"total":96636764160,"available":96594608128,"internally_reserved":0,"allocated":1699840,"data_stored":1190185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36488,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335352,"statfs":{"total":96636764160,"available":96599400448,"internally_reserved":0,"allocated":1101824,"data_stored":599552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40564,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331276,"statfs":{"total":96636764160,"available":96595226624,"internally_reserved":0,"allocated":1085440,"data_stored":599593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37104,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":1724416,"data_stored":1190679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36524,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335316,"statfs":{"total":96636764160,"available":96599363584,"internally_reserved":0,"allocated":1134592,"data_stored":601322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40592,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331248,"statfs":{"total":96636764160,"available":96595197952,"internally_reserved":0,"allocated":1114112,"data_stored":600299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:13:52.424 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.424 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.424 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.424 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.424 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.424 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.424 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.424 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.424 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.425 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.425 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.425 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.425 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.425 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.425 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.425 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.425 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.425 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.426 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.426 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.426 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.426 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.426 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.426 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.426 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.426 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.426 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.427 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.427 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.427 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.427 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.427 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.427 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.427 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.427 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.427 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.428 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.428 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.428 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.428 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.428 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.428 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.428 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.428 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.428 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.428 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.429 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.429 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.429 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.429 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.429 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.429 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.429 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.429 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.429 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.430 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.430 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.430 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.430 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.430 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.430 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.430 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.430 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.430 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.431 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.431 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.431 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.431 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.431 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.431 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.431 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.431 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.431 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.432 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.432 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.432 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.432 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.432 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.432 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.432 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.432 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.432 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.432 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.433 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.433 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.433 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.433 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.433 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.433 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.433 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.433 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.433 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.434 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.434 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.434 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.434 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.434 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.434 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.434 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.434 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.434 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.434 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T09:10:43.702491+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=43, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.435 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.435 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.435 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.435 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.435 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.435 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.435 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.435 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.435 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.436 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.436 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.436 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.436 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.436 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.436 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.436 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.436 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.436 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.436 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.437 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.437 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.437 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.437 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.437 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.437 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.437 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.437 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.437 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.437 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.438 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.438 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.438 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.438 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.438 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.438 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.438 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.438 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.438 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.439 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.439 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.439 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.439 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.439 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.439 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.439 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.439 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.440 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.440 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.440 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.440 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.440 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.440 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.440 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.440 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.440 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.441 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.441 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.441 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.441 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.441 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.441 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.441 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.441 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.441 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.442 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.442 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.442 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.442 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.442 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.442 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.442 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.442 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.442 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.443 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.443 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.443 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.443 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.443 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.443 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.443 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.443 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.443 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.443 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.444 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.444 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.444 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.444 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.444 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.444 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.444 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.444 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.444 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.445 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.445 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.445 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.445 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.445 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.445 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.445 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.445 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.445 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.445 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.446 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.446 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.446 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.446 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.446 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.446 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.446 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.446 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.446 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.447 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.447 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.447 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.447 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.447 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.447 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.447 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.447 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.447 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.448 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.448 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.448 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.448 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.448 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.448 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.448 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.448 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.448 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.449 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.449 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.449 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.449 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.449 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.449 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.449 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.449 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.449 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.449 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.450 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.450 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.450 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.450 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.450 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.450 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.450 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.450 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.450 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.450 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.451 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.451 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.451 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.451 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.451 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.451 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.451 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.451 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.451 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.451 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.452 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.452 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.452 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.452 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:13:52.452 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T09:14:12.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:14:12.814 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:14:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:14:12.833 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-21T09:14:11.039193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615632,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":2792,"num_read_kb":2220,"num_write":2385,"num_write_kb":2368156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":1149241676,"num_keys_recovered":26,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1596,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3340,"ondisk_log_size":3340,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309232,"kb_used_data":9840,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754665488,"statfs":{"total":773094113280,"available":772777459712,"internally_reserved":0,"allocated":10076160,"data_stored":5982020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1596,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006973"},"pg_stats":[{"pgid":"3.3f","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.061384+0000","last_change":"2024-09-21T09:14:03.061447+0000","last_active":"2024-09-21T09:14:03.061384+0000","last_peered":"2024-09-21T09:14:03.061384+0000","last_clean":"2024-09-21T09:14:03.061384+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:14:03.061384+0000","last_undegraded":"2024-09-21T09:14:03.061384+0000","last_fullsized":"2024-09-21T09:14:03.061384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:03.061173+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:03.061173+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.061173+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:11.592534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"58'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.847654+0000","last_change":"2024-09-21T09:14:03.847717+0000","last_active":"2024-09-21T09:14:03.847654+0000","last_peered":"2024-09-21T09:14:03.847654+0000","last_clean":"2024-09-21T09:14:03.847654+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:14:03.847654+0000","last_undegraded":"2024-09-21T09:14:03.847654+0000","last_fullsized":"2024-09-21T09:14:03.847654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:03.847431+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:03.847431+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.847431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:12.378793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"91'26","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.540921+0000","last_change":"2024-09-21T09:10:56.865056+0000","last_active":"2024-09-21T09:13:45.540921+0000","last_peered":"2024-09-21T09:13:45.540921+0000","last_clean":"2024-09-21T09:13:45.540921+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:13:45.540921+0000","last_undegraded":"2024-09-21T09:13:45.540921+0000","last_fullsized":"2024-09-21T09:13:45.540921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"58'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482341+0000","last_change":"2024-09-21T09:10:58.835355+0000","last_active":"2024-09-21T09:13:34.482341+0000","last_peered":"2024-09-21T09:13:34.482341+0000","last_clean":"2024-09-21T09:13:34.482341+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:13:34.482341+0000","last_undegraded":"2024-09-21T09:13:34.482341+0000","last_fullsized":"2024-09-21T09:13:34.482341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"91'26","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.593911+0000","last_change":"2024-09-21T09:10:56.861504+0000","last_active":"2024-09-21T09:13:45.593911+0000","last_peered":"2024-09-21T09:13:45.593911+0000","last_clean":"2024-09-21T09:13:45.593911+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:13:45.593911+0000","last_undegraded":"2024-09-21T09:13:45.593911+0000","last_fullsized":"2024-09-21T09:13:45.593911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.267569+0000","last_change":"2024-09-21T09:14:05.267629+0000","last_active":"2024-09-21T09:14:05.267569+0000","last_peered":"2024-09-21T09:14:05.267569+0000","last_clean":"2024-09-21T09:14:05.267569+0000","last_became_active":"2024-09-21T09:13:19.153424+0000","last_became_peered":"2024-09-21T09:13:19.153424+0000","last_unstale":"2024-09-21T09:14:05.267569+0000","last_undegraded":"2024-09-21T09:14:05.267569+0000","last_fullsized":"2024-09-21T09:14:05.267569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:05.267355+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:05.267355+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.267355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:37.100982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"91'26","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.594149+0000","last_change":"2024-09-21T09:13:20.586732+0000","last_active":"2024-09-21T09:13:45.594149+0000","last_peered":"2024-09-21T09:13:45.594149+0000","last_clean":"2024-09-21T09:13:45.594149+0000","last_became_active":"2024-09-21T09:13:19.165441+0000","last_became_peered":"2024-09-21T09:13:19.165441+0000","last_unstale":"2024-09-21T09:13:45.594149+0000","last_undegraded":"2024-09-21T09:13:45.594149+0000","last_fullsized":"2024-09-21T09:13:45.594149+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"58'4","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375358+0000","last_change":"2024-09-21T09:13:20.643217+0000","last_active":"2024-09-21T09:13:35.375358+0000","last_peered":"2024-09-21T09:13:35.375358+0000","last_clean":"2024-09-21T09:13:35.375358+0000","last_became_active":"2024-09-21T09:13:19.153875+0000","last_became_peered":"2024-09-21T09:13:19.153875+0000","last_unstale":"2024-09-21T09:13:35.375358+0000","last_undegraded":"2024-09-21T09:13:35.375358+0000","last_fullsized":"2024-09-21T09:13:35.375358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.138277+0000","last_change":"2024-09-21T09:14:00.138467+0000","last_active":"2024-09-21T09:14:00.138277+0000","last_peered":"2024-09-21T09:14:00.138277+0000","last_clean":"2024-09-21T09:14:00.138277+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:14:00.138277+0000","last_undegraded":"2024-09-21T09:14:00.138277+0000","last_fullsized":"2024-09-21T09:14:00.138277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:00.138047+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:00.138047+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.138047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:33.277620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.152966+0000","last_change":"2024-09-21T09:13:54.153056+0000","last_active":"2024-09-21T09:13:54.152966+0000","last_peered":"2024-09-21T09:13:54.152966+0000","last_clean":"2024-09-21T09:13:54.152966+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:13:54.152966+0000","last_undegraded":"2024-09-21T09:13:54.152966+0000","last_fullsized":"2024-09-21T09:13:54.152966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:13:54.152764+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:13:54.152764+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.152764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:11.947460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"91'12","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.677538+0000","last_change":"2024-09-21T09:13:57.677688+0000","last_active":"2024-09-21T09:13:57.677538+0000","last_peered":"2024-09-21T09:13:57.677538+0000","last_clean":"2024-09-21T09:13:57.677538+0000","last_became_active":"2024-09-21T09:13:19.160915+0000","last_became_peered":"2024-09-21T09:13:19.160915+0000","last_unstale":"2024-09-21T09:13:57.677538+0000","last_undegraded":"2024-09-21T09:13:57.677538+0000","last_fullsized":"2024-09-21T09:13:57.677538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-21T09:13:57.677253+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-21T09:13:57.677253+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.677253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:29.035343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'2","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.096228+0000","last_change":"2024-09-21T09:13:58.096313+0000","last_active":"2024-09-21T09:13:58.096228+0000","last_peered":"2024-09-21T09:13:58.096228+0000","last_clean":"2024-09-21T09:13:58.096228+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:13:58.096228+0000","last_undegraded":"2024-09-21T09:13:58.096228+0000","last_fullsized":"2024-09-21T09:13:58.096228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:58.095982+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:58.095982+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.095982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:22.243263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"91'10","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.974433+0000","last_change":"2024-09-21T09:14:04.974493+0000","last_active":"2024-09-21T09:14:04.974433+0000","last_peered":"2024-09-21T09:14:04.974433+0000","last_clean":"2024-09-21T09:14:04.974433+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:14:04.974433+0000","last_undegraded":"2024-09-21T09:14:04.974433+0000","last_fullsized":"2024-09-21T09:14:04.974433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-21T09:14:04.974240+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-21T09:14:04.974240+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.974240+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:18.116269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"62'4","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298707+0000","last_change":"2024-09-21T09:13:20.336460+0000","last_active":"2024-09-21T09:13:34.298707+0000","last_peered":"2024-09-21T09:13:34.298707+0000","last_clean":"2024-09-21T09:13:34.298707+0000","last_became_active":"2024-09-21T09:13:19.164775+0000","last_became_peered":"2024-09-21T09:13:19.164775+0000","last_unstale":"2024-09-21T09:13:34.298707+0000","last_undegraded":"2024-09-21T09:13:34.298707+0000","last_fullsized":"2024-09-21T09:13:34.298707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"91'22","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.537489+0000","last_change":"2024-09-21T09:10:56.864409+0000","last_active":"2024-09-21T09:13:45.537489+0000","last_peered":"2024-09-21T09:13:45.537489+0000","last_clean":"2024-09-21T09:13:45.537489+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:13:45.537489+0000","last_undegraded":"2024-09-21T09:13:45.537489+0000","last_fullsized":"2024-09-21T09:13:45.537489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"62'4","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.981636+0000","last_change":"2024-09-21T09:14:06.981706+0000","last_active":"2024-09-21T09:14:06.981636+0000","last_peered":"2024-09-21T09:14:06.981636+0000","last_clean":"2024-09-21T09:14:06.981636+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:14:06.981636+0000","last_undegraded":"2024-09-21T09:14:06.981636+0000","last_fullsized":"2024-09-21T09:14:06.981636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:06.981436+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:06.981436+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.981436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:09.653181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"61'2","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482083+0000","last_change":"2024-09-21T09:10:58.853249+0000","last_active":"2024-09-21T09:13:34.482083+0000","last_peered":"2024-09-21T09:13:34.482083+0000","last_clean":"2024-09-21T09:13:34.482083+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:13:34.482083+0000","last_undegraded":"2024-09-21T09:13:34.482083+0000","last_fullsized":"2024-09-21T09:13:34.482083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.878513+0000","last_change":"2024-09-21T09:14:06.878576+0000","last_active":"2024-09-21T09:14:06.878513+0000","last_peered":"2024-09-21T09:14:06.878513+0000","last_clean":"2024-09-21T09:14:06.878513+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:14:06.878513+0000","last_undegraded":"2024-09-21T09:14:06.878513+0000","last_fullsized":"2024-09-21T09:14:06.878513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:06.878320+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:06.878320+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.878320+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:44.820576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:50.084198+0000","last_change":"2024-09-21T09:13:50.084263+0000","last_active":"2024-09-21T09:13:50.084198+0000","last_peered":"2024-09-21T09:13:50.084198+0000","last_clean":"2024-09-21T09:13:50.084198+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:13:50.084198+0000","last_undegraded":"2024-09-21T09:13:50.084198+0000","last_fullsized":"2024-09-21T09:13:50.084198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:50.083977+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:50.083977+0000","last_clean_scrub_stamp":"2024-09-21T09:13:50.083977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:57.588236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"91'14","reported_seq":199,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.531579+0000","last_change":"2024-09-21T09:13:21.021044+0000","last_active":"2024-09-21T09:13:45.531579+0000","last_peered":"2024-09-21T09:13:45.531579+0000","last_clean":"2024-09-21T09:13:45.531579+0000","last_became_active":"2024-09-21T09:13:19.154413+0000","last_became_peered":"2024-09-21T09:13:19.154413+0000","last_unstale":"2024-09-21T09:13:45.531579+0000","last_undegraded":"2024-09-21T09:13:45.531579+0000","last_fullsized":"2024-09-21T09:13:45.531579+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'8","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.796959+0000","last_change":"2024-09-21T09:13:57.797029+0000","last_active":"2024-09-21T09:13:57.796959+0000","last_peered":"2024-09-21T09:13:57.796959+0000","last_clean":"2024-09-21T09:13:57.796959+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:13:57.796959+0000","last_undegraded":"2024-09-21T09:13:57.796959+0000","last_fullsized":"2024-09-21T09:13:57.796959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'8","last_scrub_stamp":"2024-09-21T09:13:57.796750+0000","last_deep_scrub":"71'8","last_deep_scrub_stamp":"2024-09-21T09:13:57.796750+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.796750+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:50.919506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"91'18","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.990012+0000","last_change":"2024-09-21T09:14:05.990075+0000","last_active":"2024-09-21T09:14:05.990012+0000","last_peered":"2024-09-21T09:14:05.990012+0000","last_clean":"2024-09-21T09:14:05.990012+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:14:05.990012+0000","last_undegraded":"2024-09-21T09:14:05.990012+0000","last_fullsized":"2024-09-21T09:14:05.990012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:05.989826+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:05.989826+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.989826+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:43.932082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.744391+0000","last_change":"2024-09-21T09:14:01.744445+0000","last_active":"2024-09-21T09:14:01.744391+0000","last_peered":"2024-09-21T09:14:01.744391+0000","last_clean":"2024-09-21T09:14:01.744391+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:14:01.744391+0000","last_undegraded":"2024-09-21T09:14:01.744391+0000","last_fullsized":"2024-09-21T09:14:01.744391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.744166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.744166+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.744166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:14.274322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'20","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.046344+0000","last_change":"2024-09-21T09:14:02.046475+0000","last_active":"2024-09-21T09:14:02.046344+0000","last_peered":"2024-09-21T09:14:02.046344+0000","last_clean":"2024-09-21T09:14:02.046344+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:14:02.046344+0000","last_undegraded":"2024-09-21T09:14:02.046344+0000","last_fullsized":"2024-09-21T09:14:02.046344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:14:02.046101+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:14:02.046101+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.046101+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:33.404191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'8","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.974708+0000","last_change":"2024-09-21T09:13:58.974768+0000","last_active":"2024-09-21T09:13:58.974708+0000","last_peered":"2024-09-21T09:13:58.974708+0000","last_clean":"2024-09-21T09:13:58.974708+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:13:58.974708+0000","last_undegraded":"2024-09-21T09:13:58.974708+0000","last_fullsized":"2024-09-21T09:13:58.974708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-09-21T09:13:58.974520+0000","last_deep_scrub":"62'8","last_deep_scrub_stamp":"2024-09-21T09:13:58.974520+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.974520+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.120923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.800436+0000","last_change":"2024-09-21T09:14:06.800570+0000","last_active":"2024-09-21T09:14:06.800436+0000","last_peered":"2024-09-21T09:14:06.800436+0000","last_clean":"2024-09-21T09:14:06.800436+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:14:06.800436+0000","last_undegraded":"2024-09-21T09:14:06.800436+0000","last_fullsized":"2024-09-21T09:14:06.800436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:06.800170+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:06.800170+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.800170+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:10.673261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"62'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.529244+0000","last_change":"2024-09-21T09:10:58.830335+0000","last_active":"2024-09-21T09:13:35.529244+0000","last_peered":"2024-09-21T09:13:35.529244+0000","last_clean":"2024-09-21T09:13:35.529244+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:13:35.529244+0000","last_undegraded":"2024-09-21T09:13:35.529244+0000","last_fullsized":"2024-09-21T09:13:35.529244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"91'14","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.533417+0000","last_change":"2024-09-21T09:10:56.862662+0000","last_active":"2024-09-21T09:13:45.533417+0000","last_peered":"2024-09-21T09:13:45.533417+0000","last_clean":"2024-09-21T09:13:45.533417+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:13:45.533417+0000","last_undegraded":"2024-09-21T09:13:45.533417+0000","last_fullsized":"2024-09-21T09:13:45.533417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":123,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295130+0000","last_change":"2024-09-21T09:11:06.898983+0000","last_active":"2024-09-21T09:13:34.295130+0000","last_peered":"2024-09-21T09:13:34.295130+0000","last_clean":"2024-09-21T09:13:34.295130+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:13:34.295130+0000","last_undegraded":"2024-09-21T09:13:34.295130+0000","last_fullsized":"2024-09-21T09:13:34.295130+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'4","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.614063+0000","last_change":"2024-09-21T09:13:55.614128+0000","last_active":"2024-09-21T09:13:55.614063+0000","last_peered":"2024-09-21T09:13:55.614063+0000","last_clean":"2024-09-21T09:13:55.614063+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:13:55.614063+0000","last_undegraded":"2024-09-21T09:13:55.614063+0000","last_fullsized":"2024-09-21T09:13:55.614063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:13:55.613858+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:13:55.613858+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.613858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:08:14.580524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"91'8","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.592776+0000","last_change":"2024-09-21T09:10:56.848523+0000","last_active":"2024-09-21T09:13:45.592776+0000","last_peered":"2024-09-21T09:13:45.592776+0000","last_clean":"2024-09-21T09:13:45.592776+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:13:45.592776+0000","last_undegraded":"2024-09-21T09:13:45.592776+0000","last_fullsized":"2024-09-21T09:13:45.592776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483353+0000","last_change":"2024-09-21T09:11:00.842168+0000","last_active":"2024-09-21T09:13:34.483353+0000","last_peered":"2024-09-21T09:13:34.483353+0000","last_clean":"2024-09-21T09:13:34.483353+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:13:34.483353+0000","last_undegraded":"2024-09-21T09:13:34.483353+0000","last_fullsized":"2024-09-21T09:13:34.483353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"91'21","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.583587+0000","last_change":"2024-09-21T09:14:08.583773+0000","last_active":"2024-09-21T09:14:08.583587+0000","last_peered":"2024-09-21T09:14:08.583587+0000","last_clean":"2024-09-21T09:14:08.583587+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:14:08.583587+0000","last_undegraded":"2024-09-21T09:14:08.583587+0000","last_fullsized":"2024-09-21T09:14:08.583587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'21","last_scrub_stamp":"2024-09-21T09:14:08.583349+0000","last_deep_scrub":"91'21","last_deep_scrub_stamp":"2024-09-21T09:14:08.583349+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.583349+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:15.068598+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527991+0000","last_change":"2024-09-21T09:11:04.894715+0000","last_active":"2024-09-21T09:13:35.527991+0000","last_peered":"2024-09-21T09:13:35.527991+0000","last_clean":"2024-09-21T09:13:35.527991+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:13:35.527991+0000","last_undegraded":"2024-09-21T09:13:35.527991+0000","last_fullsized":"2024-09-21T09:13:35.527991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"58'2","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527465+0000","last_change":"2024-09-21T09:11:06.885484+0000","last_active":"2024-09-21T09:13:35.527465+0000","last_peered":"2024-09-21T09:13:35.527465+0000","last_clean":"2024-09-21T09:13:35.527465+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:13:35.527465+0000","last_undegraded":"2024-09-21T09:13:35.527465+0000","last_fullsized":"2024-09-21T09:13:35.527465+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"61'6","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483152+0000","last_change":"2024-09-21T09:10:58.842832+0000","last_active":"2024-09-21T09:13:34.483152+0000","last_peered":"2024-09-21T09:13:34.483152+0000","last_clean":"2024-09-21T09:13:34.483152+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:13:34.483152+0000","last_undegraded":"2024-09-21T09:13:34.483152+0000","last_fullsized":"2024-09-21T09:13:34.483152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"91'18","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.759573+0000","last_change":"2024-09-21T09:14:04.759638+0000","last_active":"2024-09-21T09:14:04.759573+0000","last_peered":"2024-09-21T09:14:04.759573+0000","last_clean":"2024-09-21T09:14:04.759573+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:14:04.759573+0000","last_undegraded":"2024-09-21T09:14:04.759573+0000","last_fullsized":"2024-09-21T09:14:04.759573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:04.759348+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:04.759348+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.759348+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.905751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376112+0000","last_change":"2024-09-21T09:13:19.156069+0000","last_active":"2024-09-21T09:13:35.376112+0000","last_peered":"2024-09-21T09:13:35.376112+0000","last_clean":"2024-09-21T09:13:35.376112+0000","last_became_active":"2024-09-21T09:13:19.153940+0000","last_became_peered":"2024-09-21T09:13:19.153940+0000","last_unstale":"2024-09-21T09:13:35.376112+0000","last_undegraded":"2024-09-21T09:13:35.376112+0000","last_fullsized":"2024-09-21T09:13:35.376112+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"91'9","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.843790+0000","last_change":"2024-09-21T09:13:58.843868+0000","last_active":"2024-09-21T09:13:58.843790+0000","last_peered":"2024-09-21T09:13:58.843790+0000","last_clean":"2024-09-21T09:13:58.843790+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:13:58.843790+0000","last_undegraded":"2024-09-21T09:13:58.843790+0000","last_fullsized":"2024-09-21T09:13:58.843790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2024-09-21T09:13:58.843552+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2024-09-21T09:13:58.843552+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.843552+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:22.990833+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526974+0000","last_change":"2024-09-21T09:11:04.887299+0000","last_active":"2024-09-21T09:13:35.526974+0000","last_peered":"2024-09-21T09:13:35.526974+0000","last_clean":"2024-09-21T09:13:35.526974+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:13:35.526974+0000","last_undegraded":"2024-09-21T09:13:35.526974+0000","last_fullsized":"2024-09-21T09:13:35.526974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.229802+0000","last_change":"2024-09-21T09:13:19.145016+0000","last_active":"2024-09-21T09:13:35.229802+0000","last_peered":"2024-09-21T09:13:35.229802+0000","last_clean":"2024-09-21T09:13:35.229802+0000","last_became_active":"2024-09-21T09:13:19.144143+0000","last_became_peered":"2024-09-21T09:13:19.144143+0000","last_unstale":"2024-09-21T09:13:35.229802+0000","last_undegraded":"2024-09-21T09:13:35.229802+0000","last_fullsized":"2024-09-21T09:13:35.229802+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"71'10","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.956231+0000","last_change":"2024-09-21T09:13:57.956292+0000","last_active":"2024-09-21T09:13:57.956231+0000","last_peered":"2024-09-21T09:13:57.956231+0000","last_clean":"2024-09-21T09:13:57.956231+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:13:57.956231+0000","last_undegraded":"2024-09-21T09:13:57.956231+0000","last_fullsized":"2024-09-21T09:13:57.956231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:13:57.956033+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:13:57.956033+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.956033+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:06.487395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'8","reported_seq":179,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.584320+0000","last_change":"2024-09-21T09:13:21.119832+0000","last_active":"2024-09-21T09:13:45.584320+0000","last_peered":"2024-09-21T09:13:45.584320+0000","last_clean":"2024-09-21T09:13:45.584320+0000","last_became_active":"2024-09-21T09:13:19.159398+0000","last_became_peered":"2024-09-21T09:13:19.159398+0000","last_unstale":"2024-09-21T09:13:45.584320+0000","last_undegraded":"2024-09-21T09:13:45.584320+0000","last_fullsized":"2024-09-21T09:13:45.584320+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.400845+0000","last_change":"2024-09-21T09:13:56.400898+0000","last_active":"2024-09-21T09:13:56.400845+0000","last_peered":"2024-09-21T09:13:56.400845+0000","last_clean":"2024-09-21T09:13:56.400845+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:13:56.400845+0000","last_undegraded":"2024-09-21T09:13:56.400845+0000","last_fullsized":"2024-09-21T09:13:56.400845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.400601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.400601+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.400601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:48.207738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"91'15","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.552383+0000","last_change":"2024-09-21T09:14:04.552575+0000","last_active":"2024-09-21T09:14:04.552383+0000","last_peered":"2024-09-21T09:14:04.552383+0000","last_clean":"2024-09-21T09:14:04.552383+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:14:04.552383+0000","last_undegraded":"2024-09-21T09:14:04.552383+0000","last_fullsized":"2024-09-21T09:14:04.552383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'15","last_scrub_stamp":"2024-09-21T09:14:04.552134+0000","last_deep_scrub":"91'15","last_deep_scrub_stamp":"2024-09-21T09:14:04.552134+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.552134+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:24.444742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"91'105","reported_seq":341,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.150427+0000","last_change":"2024-09-21T09:13:55.150488+0000","last_active":"2024-09-21T09:13:55.150427+0000","last_peered":"2024-09-21T09:13:55.150427+0000","last_clean":"2024-09-21T09:13:55.150427+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:13:55.150427+0000","last_undegraded":"2024-09-21T09:13:55.150427+0000","last_fullsized":"2024-09-21T09:13:55.150427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:13:55.150231+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:13:55.150231+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.150231+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:26.074188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.671622+0000","last_change":"2024-09-21T09:14:00.671677+0000","last_active":"2024-09-21T09:14:00.671622+0000","last_peered":"2024-09-21T09:14:00.671622+0000","last_clean":"2024-09-21T09:14:00.671622+0000","last_became_active":"2024-09-21T09:13:19.161659+0000","last_became_peered":"2024-09-21T09:13:19.161659+0000","last_unstale":"2024-09-21T09:14:00.671622+0000","last_undegraded":"2024-09-21T09:14:00.671622+0000","last_fullsized":"2024-09-21T09:14:00.671622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.671424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.671424+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.671424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:13.813452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"71'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.962824+0000","last_change":"2024-09-21T09:14:04.962963+0000","last_active":"2024-09-21T09:14:04.962824+0000","last_peered":"2024-09-21T09:14:04.962824+0000","last_clean":"2024-09-21T09:14:04.962824+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:14:04.962824+0000","last_undegraded":"2024-09-21T09:14:04.962824+0000","last_fullsized":"2024-09-21T09:14:04.962824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:14:04.962501+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:14:04.962501+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.962501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:11.241875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"91'34","reported_seq":175,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.593065+0000","last_change":"2024-09-21T09:10:56.844292+0000","last_active":"2024-09-21T09:13:45.593065+0000","last_peered":"2024-09-21T09:13:45.593065+0000","last_clean":"2024-09-21T09:13:45.593065+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:13:45.593065+0000","last_undegraded":"2024-09-21T09:13:45.593065+0000","last_fullsized":"2024-09-21T09:13:45.593065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482976+0000","last_change":"2024-09-21T09:11:00.852984+0000","last_active":"2024-09-21T09:13:34.482976+0000","last_peered":"2024-09-21T09:13:34.482976+0000","last_clean":"2024-09-21T09:13:34.482976+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:13:34.482976+0000","last_undegraded":"2024-09-21T09:13:34.482976+0000","last_fullsized":"2024-09-21T09:13:34.482976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"91'21","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.718293+0000","last_change":"2024-09-21T09:13:55.718374+0000","last_active":"2024-09-21T09:13:55.718293+0000","last_peered":"2024-09-21T09:13:55.718293+0000","last_clean":"2024-09-21T09:13:55.718293+0000","last_became_active":"2024-09-21T09:13:19.160798+0000","last_became_peered":"2024-09-21T09:13:19.160798+0000","last_unstale":"2024-09-21T09:13:55.718293+0000","last_undegraded":"2024-09-21T09:13:55.718293+0000","last_fullsized":"2024-09-21T09:13:55.718293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'21","last_scrub_stamp":"2024-09-21T09:13:55.718093+0000","last_deep_scrub":"91'21","last_deep_scrub_stamp":"2024-09-21T09:13:55.718093+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.718093+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:28.857666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"91'105","reported_seq":315,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.953756+0000","last_change":"2024-09-21T09:13:54.953820+0000","last_active":"2024-09-21T09:13:54.953756+0000","last_peered":"2024-09-21T09:13:54.953756+0000","last_clean":"2024-09-21T09:13:54.953756+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:13:54.953756+0000","last_undegraded":"2024-09-21T09:13:54.953756+0000","last_fullsized":"2024-09-21T09:13:54.953756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:13:54.953528+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:13:54.953528+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.953528+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:28.093101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"62'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482111+0000","last_change":"2024-09-21T09:10:58.841384+0000","last_active":"2024-09-21T09:13:34.482111+0000","last_peered":"2024-09-21T09:13:34.482111+0000","last_clean":"2024-09-21T09:13:34.482111+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:13:34.482111+0000","last_undegraded":"2024-09-21T09:13:34.482111+0000","last_fullsized":"2024-09-21T09:13:34.482111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.015880+0000","last_change":"2024-09-21T09:14:04.015943+0000","last_active":"2024-09-21T09:14:04.015880+0000","last_peered":"2024-09-21T09:14:04.015880+0000","last_clean":"2024-09-21T09:14:04.015880+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:14:04.015880+0000","last_undegraded":"2024-09-21T09:14:04.015880+0000","last_fullsized":"2024-09-21T09:14:04.015880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:04.015654+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:04.015654+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.015654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.162056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.740425+0000","last_change":"2024-09-21T09:13:52.740536+0000","last_active":"2024-09-21T09:13:52.740425+0000","last_peered":"2024-09-21T09:13:52.740425+0000","last_clean":"2024-09-21T09:13:52.740425+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:13:52.740425+0000","last_undegraded":"2024-09-21T09:13:52.740425+0000","last_fullsized":"2024-09-21T09:13:52.740425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:52.740196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:52.740196+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.740196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:57.336774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"91'38","reported_seq":193,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.149459+0000","last_change":"2024-09-21T09:13:59.149554+0000","last_active":"2024-09-21T09:13:59.149459+0000","last_peered":"2024-09-21T09:13:59.149459+0000","last_clean":"2024-09-21T09:13:59.149459+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:13:59.149459+0000","last_undegraded":"2024-09-21T09:13:59.149459+0000","last_fullsized":"2024-09-21T09:13:59.149459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'38","last_scrub_stamp":"2024-09-21T09:13:59.149230+0000","last_deep_scrub":"91'38","last_deep_scrub_stamp":"2024-09-21T09:13:59.149230+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.149230+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:47.648398+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":48,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294328+0000","last_change":"2024-09-21T09:13:19.150862+0000","last_active":"2024-09-21T09:13:34.294328+0000","last_peered":"2024-09-21T09:13:34.294328+0000","last_clean":"2024-09-21T09:13:34.294328+0000","last_became_active":"2024-09-21T09:13:19.149936+0000","last_became_peered":"2024-09-21T09:13:19.149936+0000","last_unstale":"2024-09-21T09:13:34.294328+0000","last_undegraded":"2024-09-21T09:13:34.294328+0000","last_fullsized":"2024-09-21T09:13:34.294328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"62'12","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298449+0000","last_change":"2024-09-21T09:13:20.340381+0000","last_active":"2024-09-21T09:13:34.298449+0000","last_peered":"2024-09-21T09:13:34.298449+0000","last_clean":"2024-09-21T09:13:34.298449+0000","last_became_active":"2024-09-21T09:13:19.165108+0000","last_became_peered":"2024-09-21T09:13:19.165108+0000","last_unstale":"2024-09-21T09:13:34.298449+0000","last_undegraded":"2024-09-21T09:13:34.298449+0000","last_fullsized":"2024-09-21T09:13:34.298449+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.798739+0000","last_change":"2024-09-21T09:14:01.798806+0000","last_active":"2024-09-21T09:14:01.798739+0000","last_peered":"2024-09-21T09:14:01.798739+0000","last_clean":"2024-09-21T09:14:01.798739+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:14:01.798739+0000","last_undegraded":"2024-09-21T09:14:01.798739+0000","last_fullsized":"2024-09-21T09:14:01.798739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:01.798538+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:01.798538+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.798538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:18.314665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'14","reported_seq":64,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.539420+0000","last_change":"2024-09-21T09:13:20.333955+0000","last_active":"2024-09-21T09:13:45.539420+0000","last_peered":"2024-09-21T09:13:45.539420+0000","last_clean":"2024-09-21T09:13:45.539420+0000","last_became_active":"2024-09-21T09:13:19.162605+0000","last_became_peered":"2024-09-21T09:13:19.162605+0000","last_unstale":"2024-09-21T09:13:45.539420+0000","last_undegraded":"2024-09-21T09:13:45.539420+0000","last_fullsized":"2024-09-21T09:13:45.539420+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.649750+0000","last_change":"2024-09-21T09:13:54.649802+0000","last_active":"2024-09-21T09:13:54.649750+0000","last_peered":"2024-09-21T09:13:54.649750+0000","last_clean":"2024-09-21T09:13:54.649750+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:13:54.649750+0000","last_undegraded":"2024-09-21T09:13:54.649750+0000","last_fullsized":"2024-09-21T09:13:54.649750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:54.649547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:54.649547+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.649547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:30.932694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.596444+0000","last_change":"2024-09-21T09:14:06.596521+0000","last_active":"2024-09-21T09:14:06.596444+0000","last_peered":"2024-09-21T09:14:06.596444+0000","last_clean":"2024-09-21T09:14:06.596444+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:14:06.596444+0000","last_undegraded":"2024-09-21T09:14:06.596444+0000","last_fullsized":"2024-09-21T09:14:06.596444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:06.596240+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:06.596240+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.596240+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:33.779255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.376425+0000","last_change":"2024-09-21T09:11:04.871999+0000","last_active":"2024-09-21T09:13:35.376425+0000","last_peered":"2024-09-21T09:13:35.376425+0000","last_clean":"2024-09-21T09:13:35.376425+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:13:35.376425+0000","last_undegraded":"2024-09-21T09:13:35.376425+0000","last_fullsized":"2024-09-21T09:13:35.376425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"58'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528851+0000","last_change":"2024-09-21T09:13:19.709890+0000","last_active":"2024-09-21T09:13:35.528851+0000","last_peered":"2024-09-21T09:13:35.528851+0000","last_clean":"2024-09-21T09:13:35.528851+0000","last_became_active":"2024-09-21T09:13:19.167145+0000","last_became_peered":"2024-09-21T09:13:19.167145+0000","last_unstale":"2024-09-21T09:13:35.528851+0000","last_undegraded":"2024-09-21T09:13:35.528851+0000","last_fullsized":"2024-09-21T09:13:35.528851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'8","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:49.706810+0000","last_change":"2024-09-21T09:13:49.706837+0000","last_active":"2024-09-21T09:13:49.706810+0000","last_peered":"2024-09-21T09:13:49.706810+0000","last_clean":"2024-09-21T09:13:49.706810+0000","last_became_active":"2024-09-21T09:13:19.158113+0000","last_became_peered":"2024-09-21T09:13:19.158113+0000","last_unstale":"2024-09-21T09:13:49.706810+0000","last_undegraded":"2024-09-21T09:13:49.706810+0000","last_fullsized":"2024-09-21T09:13:49.706810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'8","last_scrub_stamp":"2024-09-21T09:13:49.706708+0000","last_deep_scrub":"71'8","last_deep_scrub_stamp":"2024-09-21T09:13:49.706708+0000","last_clean_scrub_stamp":"2024-09-21T09:13:49.706708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:07.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'36","reported_seq":177,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.517630+0000","last_change":"2024-09-21T09:10:56.842697+0000","last_active":"2024-09-21T09:13:45.517630+0000","last_peered":"2024-09-21T09:13:45.517630+0000","last_clean":"2024-09-21T09:13:45.517630+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:13:45.517630+0000","last_undegraded":"2024-09-21T09:13:45.517630+0000","last_fullsized":"2024-09-21T09:13:45.517630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.986112+0000","last_change":"2024-09-21T09:14:05.986218+0000","last_active":"2024-09-21T09:14:05.986112+0000","last_peered":"2024-09-21T09:14:05.986112+0000","last_clean":"2024-09-21T09:14:05.986112+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:14:05.986112+0000","last_undegraded":"2024-09-21T09:14:05.986112+0000","last_fullsized":"2024-09-21T09:14:05.986112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:05.985892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:05.985892+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.985892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:13.108411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"91'30","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.260791+0000","last_change":"2024-09-21T09:14:04.260872+0000","last_active":"2024-09-21T09:14:04.260791+0000","last_peered":"2024-09-21T09:14:04.260791+0000","last_clean":"2024-09-21T09:14:04.260791+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:14:04.260791+0000","last_undegraded":"2024-09-21T09:14:04.260791+0000","last_fullsized":"2024-09-21T09:14:04.260791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'30","last_scrub_stamp":"2024-09-21T09:14:04.260605+0000","last_deep_scrub":"91'30","last_deep_scrub_stamp":"2024-09-21T09:14:04.260605+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.260605+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:04.067219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"91'105","reported_seq":270,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.981810+0000","last_change":"2024-09-21T09:13:53.981879+0000","last_active":"2024-09-21T09:13:53.981810+0000","last_peered":"2024-09-21T09:13:53.981810+0000","last_clean":"2024-09-21T09:13:53.981810+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:13:53.981810+0000","last_undegraded":"2024-09-21T09:13:53.981810+0000","last_fullsized":"2024-09-21T09:13:53.981810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:13:53.981621+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:13:53.981621+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.981621+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:42.480788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.295314+0000","last_change":"2024-09-21T09:13:20.635132+0000","last_active":"2024-09-21T09:13:34.295314+0000","last_peered":"2024-09-21T09:13:34.295314+0000","last_clean":"2024-09-21T09:13:34.295314+0000","last_became_active":"2024-09-21T09:13:19.159646+0000","last_became_peered":"2024-09-21T09:13:19.159646+0000","last_unstale":"2024-09-21T09:13:34.295314+0000","last_undegraded":"2024-09-21T09:13:34.295314+0000","last_fullsized":"2024-09-21T09:13:34.295314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"71'10","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.980919+0000","last_change":"2024-09-21T09:14:01.980982+0000","last_active":"2024-09-21T09:14:01.980919+0000","last_peered":"2024-09-21T09:14:01.980919+0000","last_clean":"2024-09-21T09:14:01.980919+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:14:01.980919+0000","last_undegraded":"2024-09-21T09:14:01.980919+0000","last_fullsized":"2024-09-21T09:14:01.980919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:14:01.980698+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:14:01.980698+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.980698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:05.853788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'14","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.992416+0000","last_change":"2024-09-21T09:14:06.992477+0000","last_active":"2024-09-21T09:14:06.992416+0000","last_peered":"2024-09-21T09:14:06.992416+0000","last_clean":"2024-09-21T09:14:06.992416+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:14:06.992416+0000","last_undegraded":"2024-09-21T09:14:06.992416+0000","last_fullsized":"2024-09-21T09:14:06.992416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:06.992229+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:06.992229+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.992229+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:10.865320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.658528+0000","last_change":"2024-09-21T09:13:51.658637+0000","last_active":"2024-09-21T09:13:51.658528+0000","last_peered":"2024-09-21T09:13:51.658528+0000","last_clean":"2024-09-21T09:13:51.658528+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:13:51.658528+0000","last_undegraded":"2024-09-21T09:13:51.658528+0000","last_fullsized":"2024-09-21T09:13:51.658528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:51.658295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:51.658295+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.658295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:56.254874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"91'30","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.390310+0000","last_change":"2024-09-21T09:11:02.868260+0000","last_active":"2024-09-21T09:13:45.390310+0000","last_peered":"2024-09-21T09:13:45.390310+0000","last_clean":"2024-09-21T09:13:45.390310+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:13:45.390310+0000","last_undegraded":"2024-09-21T09:13:45.390310+0000","last_fullsized":"2024-09-21T09:13:45.390310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.956005+0000","last_change":"2024-09-21T09:11:04.890815+0000","last_active":"2024-09-21T09:13:34.956005+0000","last_peered":"2024-09-21T09:13:34.956005+0000","last_clean":"2024-09-21T09:13:34.956005+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:13:34.956005+0000","last_undegraded":"2024-09-21T09:13:34.956005+0000","last_fullsized":"2024-09-21T09:13:34.956005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527586+0000","last_change":"2024-09-21T09:11:06.888148+0000","last_active":"2024-09-21T09:13:34.527586+0000","last_peered":"2024-09-21T09:13:34.527586+0000","last_clean":"2024-09-21T09:13:34.527586+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:13:34.527586+0000","last_undegraded":"2024-09-21T09:13:34.527586+0000","last_fullsized":"2024-09-21T09:13:34.527586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"62'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:49.085649+0000","last_change":"2024-09-21T09:13:49.085691+0000","last_active":"2024-09-21T09:13:49.085649+0000","last_peered":"2024-09-21T09:13:49.085649+0000","last_clean":"2024-09-21T09:13:49.085649+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:13:49.085649+0000","last_undegraded":"2024-09-21T09:13:49.085649+0000","last_fullsized":"2024-09-21T09:13:49.085649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:13:49.085518+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:13:49.085518+0000","last_clean_scrub_stamp":"2024-09-21T09:13:49.085518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:07.451486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"91'14","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.876281+0000","last_change":"2024-09-21T09:14:04.876339+0000","last_active":"2024-09-21T09:14:04.876281+0000","last_peered":"2024-09-21T09:14:04.876281+0000","last_clean":"2024-09-21T09:14:04.876281+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:14:04.876281+0000","last_undegraded":"2024-09-21T09:14:04.876281+0000","last_fullsized":"2024-09-21T09:14:04.876281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:04.876085+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:04.876085+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.876085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:53.375253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.829115+0000","last_change":"2024-09-21T09:13:55.829174+0000","last_active":"2024-09-21T09:13:55.829115+0000","last_peered":"2024-09-21T09:13:55.829115+0000","last_clean":"2024-09-21T09:13:55.829115+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:13:55.829115+0000","last_undegraded":"2024-09-21T09:13:55.829115+0000","last_fullsized":"2024-09-21T09:13:55.829115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:55.828855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:55.828855+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.828855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:37.393939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"91'24","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.842420+0000","last_change":"2024-09-21T09:13:56.842511+0000","last_active":"2024-09-21T09:13:56.842420+0000","last_peered":"2024-09-21T09:13:56.842420+0000","last_clean":"2024-09-21T09:13:56.842420+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:13:56.842420+0000","last_undegraded":"2024-09-21T09:13:56.842420+0000","last_fullsized":"2024-09-21T09:13:56.842420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:13:56.842206+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:13:56.842206+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.842206+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:50.040639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.853826+0000","last_change":"2024-09-21T09:13:58.853895+0000","last_active":"2024-09-21T09:13:58.853826+0000","last_peered":"2024-09-21T09:13:58.853826+0000","last_clean":"2024-09-21T09:13:58.853826+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:13:58.853826+0000","last_undegraded":"2024-09-21T09:13:58.853826+0000","last_fullsized":"2024-09-21T09:13:58.853826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.853632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.853632+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.853632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:13.065998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"71'4","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.924041+0000","last_change":"2024-09-21T09:13:51.924102+0000","last_active":"2024-09-21T09:13:51.924041+0000","last_peered":"2024-09-21T09:13:51.924041+0000","last_clean":"2024-09-21T09:13:51.924041+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:13:51.924041+0000","last_undegraded":"2024-09-21T09:13:51.924041+0000","last_fullsized":"2024-09-21T09:13:51.924041+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:51.923811+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:51.923811+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.923811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:45.046566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483290+0000","last_change":"2024-09-21T09:10:58.838223+0000","last_active":"2024-09-21T09:13:34.483290+0000","last_peered":"2024-09-21T09:13:34.483290+0000","last_clean":"2024-09-21T09:13:34.483290+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:13:34.483290+0000","last_undegraded":"2024-09-21T09:13:34.483290+0000","last_fullsized":"2024-09-21T09:13:34.483290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"91'12","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.531738+0000","last_change":"2024-09-21T09:10:56.841106+0000","last_active":"2024-09-21T09:13:45.531738+0000","last_peered":"2024-09-21T09:13:45.531738+0000","last_clean":"2024-09-21T09:13:45.531738+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:13:45.531738+0000","last_undegraded":"2024-09-21T09:13:45.531738+0000","last_fullsized":"2024-09-21T09:13:45.531738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.914644+0000","last_change":"2024-09-21T09:14:03.914695+0000","last_active":"2024-09-21T09:14:03.914644+0000","last_peered":"2024-09-21T09:14:03.914644+0000","last_clean":"2024-09-21T09:14:03.914644+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:14:03.914644+0000","last_undegraded":"2024-09-21T09:14:03.914644+0000","last_fullsized":"2024-09-21T09:14:03.914644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:03.914453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:03.914453+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.914453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:36.749271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"91'26","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.368933+0000","last_change":"2024-09-21T09:11:02.852292+0000","last_active":"2024-09-21T09:13:45.368933+0000","last_peered":"2024-09-21T09:13:45.368933+0000","last_clean":"2024-09-21T09:13:45.368933+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:13:45.368933+0000","last_undegraded":"2024-09-21T09:13:45.368933+0000","last_fullsized":"2024-09-21T09:13:45.368933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"91'105","reported_seq":301,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.613648+0000","last_change":"2024-09-21T09:11:04.892391+0000","last_active":"2024-09-21T09:13:45.613648+0000","last_peered":"2024-09-21T09:13:45.613648+0000","last_clean":"2024-09-21T09:13:45.613648+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:13:45.613648+0000","last_undegraded":"2024-09-21T09:13:45.613648+0000","last_fullsized":"2024-09-21T09:13:45.613648+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.293758+0000","last_change":"2024-09-21T09:11:06.883898+0000","last_active":"2024-09-21T09:13:34.293758+0000","last_peered":"2024-09-21T09:13:34.293758+0000","last_clean":"2024-09-21T09:13:34.293758+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:13:34.293758+0000","last_undegraded":"2024-09-21T09:13:34.293758+0000","last_fullsized":"2024-09-21T09:13:34.293758+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"71'8","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.298894+0000","last_change":"2024-09-21T09:13:20.217794+0000","last_active":"2024-09-21T09:13:34.298894+0000","last_peered":"2024-09-21T09:13:34.298894+0000","last_clean":"2024-09-21T09:13:34.298894+0000","last_became_active":"2024-09-21T09:13:19.161819+0000","last_became_peered":"2024-09-21T09:13:19.161819+0000","last_unstale":"2024-09-21T09:13:34.298894+0000","last_undegraded":"2024-09-21T09:13:34.298894+0000","last_fullsized":"2024-09-21T09:13:34.298894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"91'22","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.530462+0000","last_change":"2024-09-21T09:10:56.844590+0000","last_active":"2024-09-21T09:13:45.530462+0000","last_peered":"2024-09-21T09:13:45.530462+0000","last_clean":"2024-09-21T09:13:45.530462+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:13:45.530462+0000","last_undegraded":"2024-09-21T09:13:45.530462+0000","last_fullsized":"2024-09-21T09:13:45.530462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"91'4","reported_seq":283,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:50.715930+0000","last_change":"2024-09-21T09:13:50.716004+0000","last_active":"2024-09-21T09:13:50.715930+0000","last_peered":"2024-09-21T09:13:50.715930+0000","last_clean":"2024-09-21T09:13:50.715930+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:13:50.715930+0000","last_undegraded":"2024-09-21T09:13:50.715930+0000","last_fullsized":"2024-09-21T09:13:50.715930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-21T09:13:50.715772+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-21T09:13:50.715772+0000","last_clean_scrub_stamp":"2024-09-21T09:13:50.715772+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:58.220031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"91'17","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.782084+0000","last_change":"2024-09-21T09:14:00.782236+0000","last_active":"2024-09-21T09:14:00.782084+0000","last_peered":"2024-09-21T09:14:00.782084+0000","last_clean":"2024-09-21T09:14:00.782084+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:14:00.782084+0000","last_undegraded":"2024-09-21T09:14:00.782084+0000","last_fullsized":"2024-09-21T09:14:00.782084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'17","last_scrub_stamp":"2024-09-21T09:14:00.781799+0000","last_deep_scrub":"91'17","last_deep_scrub_stamp":"2024-09-21T09:14:00.781799+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.781799+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:48.074789+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1596,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"91'105","reported_seq":323,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.837424+0000","last_change":"2024-09-21T09:14:02.837562+0000","last_active":"2024-09-21T09:14:02.837424+0000","last_peered":"2024-09-21T09:14:02.837424+0000","last_clean":"2024-09-21T09:14:02.837424+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:14:02.837424+0000","last_undegraded":"2024-09-21T09:14:02.837424+0000","last_fullsized":"2024-09-21T09:14:02.837424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:14:02.837178+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:14:02.837178+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.837178+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:34.195267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'2","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.808407+0000","last_change":"2024-09-21T09:14:06.808465+0000","last_active":"2024-09-21T09:14:06.808407+0000","last_peered":"2024-09-21T09:14:06.808407+0000","last_clean":"2024-09-21T09:14:06.808407+0000","last_became_active":"2024-09-21T09:13:19.139533+0000","last_became_peered":"2024-09-21T09:13:19.139533+0000","last_unstale":"2024-09-21T09:14:06.808407+0000","last_undegraded":"2024-09-21T09:14:06.808407+0000","last_fullsized":"2024-09-21T09:14:06.808407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:06.808207+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:06.808207+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.808207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:13.930727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.824089+0000","last_change":"2024-09-21T09:14:01.824155+0000","last_active":"2024-09-21T09:14:01.824089+0000","last_peered":"2024-09-21T09:14:01.824089+0000","last_clean":"2024-09-21T09:14:01.824089+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:14:01.824089+0000","last_undegraded":"2024-09-21T09:14:01.824089+0000","last_fullsized":"2024-09-21T09:14:01.824089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:01.823894+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:01.823894+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.823894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:08:20.790560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"91'4","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.542531+0000","last_change":"2024-09-21T09:10:56.849104+0000","last_active":"2024-09-21T09:13:45.542531+0000","last_peered":"2024-09-21T09:13:45.542531+0000","last_clean":"2024-09-21T09:13:45.542531+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:13:45.542531+0000","last_undegraded":"2024-09-21T09:13:45.542531+0000","last_fullsized":"2024-09-21T09:13:45.542531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483082+0000","last_change":"2024-09-21T09:11:00.841893+0000","last_active":"2024-09-21T09:13:34.483082+0000","last_peered":"2024-09-21T09:13:34.483082+0000","last_clean":"2024-09-21T09:13:34.483082+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:13:34.483082+0000","last_undegraded":"2024-09-21T09:13:34.483082+0000","last_fullsized":"2024-09-21T09:13:34.483082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"91'33","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.758757+0000","last_change":"2024-09-21T09:14:00.758928+0000","last_active":"2024-09-21T09:14:00.758757+0000","last_peered":"2024-09-21T09:14:00.758757+0000","last_clean":"2024-09-21T09:14:00.758757+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:14:00.758757+0000","last_undegraded":"2024-09-21T09:14:00.758757+0000","last_fullsized":"2024-09-21T09:14:00.758757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33","last_scrub_stamp":"2024-09-21T09:14:00.758562+0000","last_deep_scrub":"91'33","last_deep_scrub_stamp":"2024-09-21T09:14:00.758562+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.758562+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:33.898135+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.678959+0000","last_change":"2024-09-21T09:13:58.679013+0000","last_active":"2024-09-21T09:13:58.678959+0000","last_peered":"2024-09-21T09:13:58.678959+0000","last_clean":"2024-09-21T09:13:58.678959+0000","last_became_active":"2024-09-21T09:13:19.164969+0000","last_became_peered":"2024-09-21T09:13:19.164969+0000","last_unstale":"2024-09-21T09:13:58.678959+0000","last_undegraded":"2024-09-21T09:13:58.678959+0000","last_fullsized":"2024-09-21T09:13:58.678959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.678760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.678760+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.678760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:07.210122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"62'12","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526266+0000","last_change":"2024-09-21T09:11:06.883751+0000","last_active":"2024-09-21T09:13:34.526266+0000","last_peered":"2024-09-21T09:13:34.526266+0000","last_clean":"2024-09-21T09:13:34.526266+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:13:34.526266+0000","last_undegraded":"2024-09-21T09:13:34.526266+0000","last_fullsized":"2024-09-21T09:13:34.526266+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482894+0000","last_change":"2024-09-21T09:10:58.838888+0000","last_active":"2024-09-21T09:13:34.482894+0000","last_peered":"2024-09-21T09:13:34.482894+0000","last_clean":"2024-09-21T09:13:34.482894+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:13:34.482894+0000","last_undegraded":"2024-09-21T09:13:34.482894+0000","last_fullsized":"2024-09-21T09:13:34.482894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"91'119","reported_seq":315,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.840778+0000","last_change":"2024-09-21T09:14:04.840858+0000","last_active":"2024-09-21T09:14:04.840778+0000","last_peered":"2024-09-21T09:14:04.840778+0000","last_clean":"2024-09-21T09:14:04.840778+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:14:04.840778+0000","last_undegraded":"2024-09-21T09:14:04.840778+0000","last_fullsized":"2024-09-21T09:14:04.840778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'119","last_scrub_stamp":"2024-09-21T09:14:04.840584+0000","last_deep_scrub":"91'119","last_deep_scrub_stamp":"2024-09-21T09:14:04.840584+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.840584+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.986986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482623+0000","last_change":"2024-09-21T09:13:20.381044+0000","last_active":"2024-09-21T09:13:34.482623+0000","last_peered":"2024-09-21T09:13:34.482623+0000","last_clean":"2024-09-21T09:13:34.482623+0000","last_became_active":"2024-09-21T09:13:19.155065+0000","last_became_peered":"2024-09-21T09:13:19.155065+0000","last_unstale":"2024-09-21T09:13:34.482623+0000","last_undegraded":"2024-09-21T09:13:34.482623+0000","last_fullsized":"2024-09-21T09:13:34.482623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"91'18","reported_seq":213,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.542917+0000","last_change":"2024-09-21T09:13:19.483993+0000","last_active":"2024-09-21T09:13:45.542917+0000","last_peered":"2024-09-21T09:13:45.542917+0000","last_clean":"2024-09-21T09:13:45.542917+0000","last_became_active":"2024-09-21T09:13:19.152677+0000","last_became_peered":"2024-09-21T09:13:19.152677+0000","last_unstale":"2024-09-21T09:13:45.542917+0000","last_undegraded":"2024-09-21T09:13:45.542917+0000","last_fullsized":"2024-09-21T09:13:45.542917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.123811+0000","last_change":"2024-09-21T09:13:51.123831+0000","last_active":"2024-09-21T09:13:51.123811+0000","last_peered":"2024-09-21T09:13:51.123811+0000","last_clean":"2024-09-21T09:13:51.123811+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:13:51.123811+0000","last_undegraded":"2024-09-21T09:13:51.123811+0000","last_fullsized":"2024-09-21T09:13:51.123811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:51.123724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:51.123724+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.123724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:13.536863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"91'45","reported_seq":208,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.211089+0000","last_change":"2024-09-21T09:14:03.211164+0000","last_active":"2024-09-21T09:14:03.211089+0000","last_peered":"2024-09-21T09:14:03.211089+0000","last_clean":"2024-09-21T09:14:03.211089+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:14:03.211089+0000","last_undegraded":"2024-09-21T09:14:03.211089+0000","last_fullsized":"2024-09-21T09:14:03.211089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'45","last_scrub_stamp":"2024-09-21T09:14:03.210893+0000","last_deep_scrub":"91'45","last_deep_scrub_stamp":"2024-09-21T09:14:03.210893+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.210893+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:23.844266+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":48,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.917866+0000","last_change":"2024-09-21T09:13:56.917919+0000","last_active":"2024-09-21T09:13:56.917866+0000","last_peered":"2024-09-21T09:13:56.917866+0000","last_clean":"2024-09-21T09:13:56.917866+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:13:56.917866+0000","last_undegraded":"2024-09-21T09:13:56.917866+0000","last_fullsized":"2024-09-21T09:13:56.917866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.917676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.917676+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.917676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:28.275766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"71'6","reported_seq":153,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294362+0000","last_change":"2024-09-21T09:13:19.487021+0000","last_active":"2024-09-21T09:13:34.294362+0000","last_peered":"2024-09-21T09:13:34.294362+0000","last_clean":"2024-09-21T09:13:34.294362+0000","last_became_active":"2024-09-21T09:13:19.153438+0000","last_became_peered":"2024-09-21T09:13:19.153438+0000","last_unstale":"2024-09-21T09:13:34.294362+0000","last_undegraded":"2024-09-21T09:13:34.294362+0000","last_fullsized":"2024-09-21T09:13:34.294362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":422,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.962302+0000","last_change":"2024-09-21T09:13:59.962359+0000","last_active":"2024-09-21T09:13:59.962302+0000","last_peered":"2024-09-21T09:13:59.962302+0000","last_clean":"2024-09-21T09:13:59.962302+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:13:59.962302+0000","last_undegraded":"2024-09-21T09:13:59.962302+0000","last_fullsized":"2024-09-21T09:13:59.962302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:59.962111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:59.962111+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.962111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:13.104139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482333+0000","last_change":"2024-09-21T09:10:50.783592+0000","last_active":"2024-09-21T09:13:34.482333+0000","last_peered":"2024-09-21T09:13:34.482333+0000","last_clean":"2024-09-21T09:13:34.482333+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:13:34.482333+0000","last_undegraded":"2024-09-21T09:13:34.482333+0000","last_fullsized":"2024-09-21T09:13:34.482333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"91'14","reported_seq":196,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.599054+0000","last_change":"2024-09-21T09:13:19.304956+0000","last_active":"2024-09-21T09:13:45.599054+0000","last_peered":"2024-09-21T09:13:45.599054+0000","last_clean":"2024-09-21T09:13:45.599054+0000","last_became_active":"2024-09-21T09:13:19.142666+0000","last_became_peered":"2024-09-21T09:13:19.142666+0000","last_unstale":"2024-09-21T09:13:45.599054+0000","last_undegraded":"2024-09-21T09:13:45.599054+0000","last_fullsized":"2024-09-21T09:13:45.599054+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483066+0000","last_change":"2024-09-21T09:11:00.845917+0000","last_active":"2024-09-21T09:13:34.483066+0000","last_peered":"2024-09-21T09:13:34.483066+0000","last_clean":"2024-09-21T09:13:34.483066+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:13:34.483066+0000","last_undegraded":"2024-09-21T09:13:34.483066+0000","last_fullsized":"2024-09-21T09:13:34.483066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"91'127","reported_seq":360,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.867422+0000","last_change":"2024-09-21T09:13:56.867596+0000","last_active":"2024-09-21T09:13:56.867422+0000","last_peered":"2024-09-21T09:13:56.867422+0000","last_clean":"2024-09-21T09:13:56.867422+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:13:56.867422+0000","last_undegraded":"2024-09-21T09:13:56.867422+0000","last_fullsized":"2024-09-21T09:13:56.867422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'127","last_scrub_stamp":"2024-09-21T09:13:56.867163+0000","last_deep_scrub":"91'127","last_deep_scrub_stamp":"2024-09-21T09:13:56.867163+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.867163+0000","objects_scrubbed":10,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:19.280301+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":167,"num_read_kb":270,"num_write":36,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.164777+0000","last_change":"2024-09-21T09:13:56.164832+0000","last_active":"2024-09-21T09:13:56.164777+0000","last_peered":"2024-09-21T09:13:56.164777+0000","last_clean":"2024-09-21T09:13:56.164777+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:56.164777+0000","last_undegraded":"2024-09-21T09:13:56.164777+0000","last_fullsized":"2024-09-21T09:13:56.164777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.164543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.164543+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.164543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:47.093093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"58'2","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.956648+0000","last_change":"2024-09-21T09:13:55.956775+0000","last_active":"2024-09-21T09:13:55.956648+0000","last_peered":"2024-09-21T09:13:55.956648+0000","last_clean":"2024-09-21T09:13:55.956648+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:13:55.956648+0000","last_undegraded":"2024-09-21T09:13:55.956648+0000","last_fullsized":"2024-09-21T09:13:55.956648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:55.956369+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:55.956369+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.956369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:12.472496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.731873+0000","last_change":"2024-09-21T09:14:03.731924+0000","last_active":"2024-09-21T09:14:03.731873+0000","last_peered":"2024-09-21T09:14:03.731873+0000","last_clean":"2024-09-21T09:14:03.731873+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:14:03.731873+0000","last_undegraded":"2024-09-21T09:14:03.731873+0000","last_fullsized":"2024-09-21T09:14:03.731873+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:03.731674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:03.731674+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.731674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:16.654827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.811619+0000","last_change":"2024-09-21T09:14:02.811680+0000","last_active":"2024-09-21T09:14:02.811619+0000","last_peered":"2024-09-21T09:14:02.811619+0000","last_clean":"2024-09-21T09:14:02.811619+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:14:02.811619+0000","last_undegraded":"2024-09-21T09:14:02.811619+0000","last_fullsized":"2024-09-21T09:14:02.811619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:02.811374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:02.811374+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.811374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:55.934130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"91'22","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.579142+0000","last_change":"2024-09-21T09:10:56.866005+0000","last_active":"2024-09-21T09:13:45.579142+0000","last_peered":"2024-09-21T09:13:45.579142+0000","last_clean":"2024-09-21T09:13:45.579142+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:13:45.579142+0000","last_undegraded":"2024-09-21T09:13:45.579142+0000","last_fullsized":"2024-09-21T09:13:45.579142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"91'4","reported_seq":215,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.858779+0000","last_change":"2024-09-21T09:13:57.858847+0000","last_active":"2024-09-21T09:13:57.858779+0000","last_peered":"2024-09-21T09:13:57.858779+0000","last_clean":"2024-09-21T09:13:57.858779+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:13:57.858779+0000","last_undegraded":"2024-09-21T09:13:57.858779+0000","last_fullsized":"2024-09-21T09:13:57.858779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-21T09:13:57.858583+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-21T09:13:57.858583+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.858583+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:02.455161+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"91'16","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:38.668945+0000","last_change":"2024-09-21T09:11:02.873117+0000","last_active":"2024-09-21T09:13:38.668945+0000","last_peered":"2024-09-21T09:13:38.668945+0000","last_clean":"2024-09-21T09:13:38.668945+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:13:38.668945+0000","last_undegraded":"2024-09-21T09:13:38.668945+0000","last_fullsized":"2024-09-21T09:13:38.668945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.348585+0000","last_change":"2024-09-21T09:13:52.348703+0000","last_active":"2024-09-21T09:13:52.348585+0000","last_peered":"2024-09-21T09:13:52.348585+0000","last_clean":"2024-09-21T09:13:52.348585+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:13:52.348585+0000","last_undegraded":"2024-09-21T09:13:52.348585+0000","last_fullsized":"2024-09-21T09:13:52.348585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:52.348233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:52.348233+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.348233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:35.531424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.417194+0000","last_change":"2024-09-21T09:13:54.417254+0000","last_active":"2024-09-21T09:13:54.417194+0000","last_peered":"2024-09-21T09:13:54.417194+0000","last_clean":"2024-09-21T09:13:54.417194+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:13:54.417194+0000","last_undegraded":"2024-09-21T09:13:54.417194+0000","last_fullsized":"2024-09-21T09:13:54.417194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:54.417003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:54.417003+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.417003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:37.375359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"58'2","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.740070+0000","last_change":"2024-09-21T09:13:59.740131+0000","last_active":"2024-09-21T09:13:59.740070+0000","last_peered":"2024-09-21T09:13:59.740070+0000","last_clean":"2024-09-21T09:13:59.740070+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:13:59.740070+0000","last_undegraded":"2024-09-21T09:13:59.740070+0000","last_fullsized":"2024-09-21T09:13:59.740070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:59.739869+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:59.739869+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.739869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:10.243493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482688+0000","last_change":"2024-09-21T09:10:50.785368+0000","last_active":"2024-09-21T09:13:34.482688+0000","last_peered":"2024-09-21T09:13:34.482688+0000","last_clean":"2024-09-21T09:13:34.482688+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:13:34.482688+0000","last_undegraded":"2024-09-21T09:13:34.482688+0000","last_fullsized":"2024-09-21T09:13:34.482688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"91'14","reported_seq":199,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.528129+0000","last_change":"2024-09-21T09:13:20.378657+0000","last_active":"2024-09-21T09:13:45.528129+0000","last_peered":"2024-09-21T09:13:45.528129+0000","last_clean":"2024-09-21T09:13:45.528129+0000","last_became_active":"2024-09-21T09:13:19.153710+0000","last_became_peered":"2024-09-21T09:13:19.153710+0000","last_unstale":"2024-09-21T09:13:45.528129+0000","last_undegraded":"2024-09-21T09:13:45.528129+0000","last_fullsized":"2024-09-21T09:13:45.528129+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.843226+0000","last_change":"2024-09-21T09:13:53.843283+0000","last_active":"2024-09-21T09:13:53.843226+0000","last_peered":"2024-09-21T09:13:53.843226+0000","last_clean":"2024-09-21T09:13:53.843226+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:13:53.843226+0000","last_undegraded":"2024-09-21T09:13:53.843226+0000","last_fullsized":"2024-09-21T09:13:53.843226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.843025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.843025+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.843025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:37.219600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.955025+0000","last_change":"2024-09-21T09:11:02.856485+0000","last_active":"2024-09-21T09:13:34.955025+0000","last_peered":"2024-09-21T09:13:34.955025+0000","last_clean":"2024-09-21T09:13:34.955025+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:13:34.955025+0000","last_undegraded":"2024-09-21T09:13:34.955025+0000","last_fullsized":"2024-09-21T09:13:34.955025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.170518+0000","last_change":"2024-09-21T09:14:00.170569+0000","last_active":"2024-09-21T09:14:00.170518+0000","last_peered":"2024-09-21T09:14:00.170518+0000","last_clean":"2024-09-21T09:14:00.170518+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:14:00.170518+0000","last_undegraded":"2024-09-21T09:14:00.170518+0000","last_fullsized":"2024-09-21T09:14:00.170518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.170286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.170286+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.170286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:57:07.718054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"62'4","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.526751+0000","last_change":"2024-09-21T09:11:06.869065+0000","last_active":"2024-09-21T09:13:35.526751+0000","last_peered":"2024-09-21T09:13:35.526751+0000","last_clean":"2024-09-21T09:13:35.526751+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:13:35.526751+0000","last_undegraded":"2024-09-21T09:13:35.526751+0000","last_fullsized":"2024-09-21T09:13:35.526751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"71'12","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.686630+0000","last_change":"2024-09-21T09:13:57.686695+0000","last_active":"2024-09-21T09:13:57.686630+0000","last_peered":"2024-09-21T09:13:57.686630+0000","last_clean":"2024-09-21T09:13:57.686630+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:13:57.686630+0000","last_undegraded":"2024-09-21T09:13:57.686630+0000","last_fullsized":"2024-09-21T09:13:57.686630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'12","last_scrub_stamp":"2024-09-21T09:13:57.686428+0000","last_deep_scrub":"71'12","last_deep_scrub_stamp":"2024-09-21T09:13:57.686428+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.686428+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:21.833709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"91'20","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.701292+0000","last_change":"2024-09-21T09:13:52.701391+0000","last_active":"2024-09-21T09:13:52.701292+0000","last_peered":"2024-09-21T09:13:52.701292+0000","last_clean":"2024-09-21T09:13:52.701292+0000","last_became_active":"2024-09-21T09:13:19.142534+0000","last_became_peered":"2024-09-21T09:13:19.142534+0000","last_unstale":"2024-09-21T09:13:52.701292+0000","last_undegraded":"2024-09-21T09:13:52.701292+0000","last_fullsized":"2024-09-21T09:13:52.701292+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:13:52.701105+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:13:52.701105+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.701105+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:45.823860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957310+0000","last_change":"2024-09-21T09:10:51.586976+0000","last_active":"2024-09-21T09:13:34.957310+0000","last_peered":"2024-09-21T09:13:34.957310+0000","last_clean":"2024-09-21T09:13:34.957310+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:13:34.957310+0000","last_undegraded":"2024-09-21T09:13:34.957310+0000","last_fullsized":"2024-09-21T09:13:34.957310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.386691+0000","last_change":"2024-09-21T09:13:58.386804+0000","last_active":"2024-09-21T09:13:58.386691+0000","last_peered":"2024-09-21T09:13:58.386691+0000","last_clean":"2024-09-21T09:13:58.386691+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:13:58.386691+0000","last_undegraded":"2024-09-21T09:13:58.386691+0000","last_fullsized":"2024-09-21T09:13:58.386691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.386389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.386389+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.386389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:18.298819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"91'42","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.859358+0000","last_change":"2024-09-21T09:13:52.859456+0000","last_active":"2024-09-21T09:13:52.859358+0000","last_peered":"2024-09-21T09:13:52.859358+0000","last_clean":"2024-09-21T09:13:52.859358+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:13:52.859358+0000","last_undegraded":"2024-09-21T09:13:52.859358+0000","last_fullsized":"2024-09-21T09:13:52.859358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'42","last_scrub_stamp":"2024-09-21T09:13:52.859171+0000","last_deep_scrub":"91'42","last_deep_scrub_stamp":"2024-09-21T09:13:52.859171+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.859171+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:10.155729+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.751230+0000","last_change":"2024-09-21T09:14:04.751361+0000","last_active":"2024-09-21T09:14:04.751230+0000","last_peered":"2024-09-21T09:14:04.751230+0000","last_clean":"2024-09-21T09:14:04.751230+0000","last_became_active":"2024-09-21T09:13:19.145677+0000","last_became_peered":"2024-09-21T09:13:19.145677+0000","last_unstale":"2024-09-21T09:14:04.751230+0000","last_undegraded":"2024-09-21T09:14:04.751230+0000","last_fullsized":"2024-09-21T09:14:04.751230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:04.750975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:04.750975+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.750975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:37.585793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"62'4","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957501+0000","last_change":"2024-09-21T09:11:06.896833+0000","last_active":"2024-09-21T09:13:34.957501+0000","last_peered":"2024-09-21T09:13:34.957501+0000","last_clean":"2024-09-21T09:13:34.957501+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:13:34.957501+0000","last_undegraded":"2024-09-21T09:13:34.957501+0000","last_fullsized":"2024-09-21T09:13:34.957501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"61'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294970+0000","last_change":"2024-09-21T09:10:58.825808+0000","last_active":"2024-09-21T09:13:34.294970+0000","last_peered":"2024-09-21T09:13:34.294970+0000","last_clean":"2024-09-21T09:13:34.294970+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:13:34.294970+0000","last_undegraded":"2024-09-21T09:13:34.294970+0000","last_fullsized":"2024-09-21T09:13:34.294970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"91'20","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.759091+0000","last_change":"2024-09-21T09:14:05.759150+0000","last_active":"2024-09-21T09:14:05.759091+0000","last_peered":"2024-09-21T09:14:05.759091+0000","last_clean":"2024-09-21T09:14:05.759091+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:14:05.759091+0000","last_undegraded":"2024-09-21T09:14:05.759091+0000","last_fullsized":"2024-09-21T09:14:05.759091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:14:05.758902+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:14:05.758902+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.758902+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:32.501862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482785+0000","last_change":"2024-09-21T09:10:50.784391+0000","last_active":"2024-09-21T09:13:34.482785+0000","last_peered":"2024-09-21T09:13:34.482785+0000","last_clean":"2024-09-21T09:13:34.482785+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:13:34.482785+0000","last_undegraded":"2024-09-21T09:13:34.482785+0000","last_fullsized":"2024-09-21T09:13:34.482785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.172169+0000","last_change":"2024-09-21T09:13:53.172223+0000","last_active":"2024-09-21T09:13:53.172169+0000","last_peered":"2024-09-21T09:13:53.172169+0000","last_clean":"2024-09-21T09:13:53.172169+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:13:53.172169+0000","last_undegraded":"2024-09-21T09:13:53.172169+0000","last_fullsized":"2024-09-21T09:13:53.172169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.171979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.171979+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.171979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:07.384344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"91'21","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.646202+0000","last_change":"2024-09-21T09:13:56.646284+0000","last_active":"2024-09-21T09:13:56.646202+0000","last_peered":"2024-09-21T09:13:56.646202+0000","last_clean":"2024-09-21T09:13:56.646202+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:13:56.646202+0000","last_undegraded":"2024-09-21T09:13:56.646202+0000","last_fullsized":"2024-09-21T09:13:56.646202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'21","last_scrub_stamp":"2024-09-21T09:13:56.646017+0000","last_deep_scrub":"91'21","last_deep_scrub_stamp":"2024-09-21T09:13:56.646017+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.646017+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:30.090553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"91'105","reported_seq":267,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.611252+0000","last_change":"2024-09-21T09:11:04.894220+0000","last_active":"2024-09-21T09:13:45.611252+0000","last_peered":"2024-09-21T09:13:45.611252+0000","last_clean":"2024-09-21T09:13:45.611252+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:13:45.611252+0000","last_undegraded":"2024-09-21T09:13:45.611252+0000","last_fullsized":"2024-09-21T09:13:45.611252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"71'4","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527416+0000","last_change":"2024-09-21T09:11:06.881113+0000","last_active":"2024-09-21T09:13:34.527416+0000","last_peered":"2024-09-21T09:13:34.527416+0000","last_clean":"2024-09-21T09:13:34.527416+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:13:34.527416+0000","last_undegraded":"2024-09-21T09:13:34.527416+0000","last_fullsized":"2024-09-21T09:13:34.527416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.566849+0000","last_change":"2024-09-21T09:14:07.566908+0000","last_active":"2024-09-21T09:14:07.566849+0000","last_peered":"2024-09-21T09:14:07.566849+0000","last_clean":"2024-09-21T09:14:07.566849+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:14:07.566849+0000","last_undegraded":"2024-09-21T09:14:07.566849+0000","last_fullsized":"2024-09-21T09:14:07.566849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:07.566625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:07.566625+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.566625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:17.707996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"91'8","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.575419+0000","last_change":"2024-09-21T09:10:56.853201+0000","last_active":"2024-09-21T09:13:45.575419+0000","last_peered":"2024-09-21T09:13:45.575419+0000","last_clean":"2024-09-21T09:13:45.575419+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:13:45.575419+0000","last_undegraded":"2024-09-21T09:13:45.575419+0000","last_fullsized":"2024-09-21T09:13:45.575419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.379072+0000","last_change":"2024-09-21T09:10:50.775963+0000","last_active":"2024-09-21T09:13:35.379072+0000","last_peered":"2024-09-21T09:13:35.379072+0000","last_clean":"2024-09-21T09:13:35.379072+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:13:35.379072+0000","last_undegraded":"2024-09-21T09:13:35.379072+0000","last_fullsized":"2024-09-21T09:13:35.379072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482219+0000","last_change":"2024-09-21T09:11:00.850095+0000","last_active":"2024-09-21T09:13:34.482219+0000","last_peered":"2024-09-21T09:13:34.482219+0000","last_clean":"2024-09-21T09:13:34.482219+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:13:34.482219+0000","last_undegraded":"2024-09-21T09:13:34.482219+0000","last_fullsized":"2024-09-21T09:13:34.482219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"91'16","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.258104+0000","last_change":"2024-09-21T09:14:06.258177+0000","last_active":"2024-09-21T09:14:06.258104+0000","last_peered":"2024-09-21T09:14:06.258104+0000","last_clean":"2024-09-21T09:14:06.258104+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:14:06.258104+0000","last_undegraded":"2024-09-21T09:14:06.258104+0000","last_fullsized":"2024-09-21T09:14:06.258104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:06.257920+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:06.257920+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.257920+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:15.871331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"91'109","reported_seq":291,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.616337+0000","last_change":"2024-09-21T09:13:22.165756+0000","last_active":"2024-09-21T09:13:45.616337+0000","last_peered":"2024-09-21T09:13:45.616337+0000","last_clean":"2024-09-21T09:13:45.616337+0000","last_became_active":"2024-09-21T09:13:22.164964+0000","last_became_peered":"2024-09-21T09:13:22.164964+0000","last_unstale":"2024-09-21T09:13:45.616337+0000","last_undegraded":"2024-09-21T09:13:45.616337+0000","last_fullsized":"2024-09-21T09:13:45.616337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"62'2","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.954714+0000","last_change":"2024-09-21T09:13:52.954779+0000","last_active":"2024-09-21T09:13:52.954714+0000","last_peered":"2024-09-21T09:13:52.954714+0000","last_clean":"2024-09-21T09:13:52.954714+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:13:52.954714+0000","last_undegraded":"2024-09-21T09:13:52.954714+0000","last_fullsized":"2024-09-21T09:13:52.954714+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:52.954481+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:52.954481+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.954481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:17.101762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297374+0000","last_change":"2024-09-21T09:13:19.160539+0000","last_active":"2024-09-21T09:13:34.297374+0000","last_peered":"2024-09-21T09:13:34.297374+0000","last_clean":"2024-09-21T09:13:34.297374+0000","last_became_active":"2024-09-21T09:13:19.158513+0000","last_became_peered":"2024-09-21T09:13:19.158513+0000","last_unstale":"2024-09-21T09:13:34.297374+0000","last_undegraded":"2024-09-21T09:13:34.297374+0000","last_fullsized":"2024-09-21T09:13:34.297374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"91'12","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.508463+0000","last_change":"2024-09-21T09:10:56.849803+0000","last_active":"2024-09-21T09:13:45.508463+0000","last_peered":"2024-09-21T09:13:45.508463+0000","last_clean":"2024-09-21T09:13:45.508463+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:13:45.508463+0000","last_undegraded":"2024-09-21T09:13:45.508463+0000","last_fullsized":"2024-09-21T09:13:45.508463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483438+0000","last_change":"2024-09-21T09:10:50.783824+0000","last_active":"2024-09-21T09:13:34.483438+0000","last_peered":"2024-09-21T09:13:34.483438+0000","last_clean":"2024-09-21T09:13:34.483438+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:13:34.483438+0000","last_undegraded":"2024-09-21T09:13:34.483438+0000","last_fullsized":"2024-09-21T09:13:34.483438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:47.739014+0000","last_clean_scrub_stamp":"2024-09-21T09:10:47.739014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375128+0000","last_change":"2024-09-21T09:13:19.154303+0000","last_active":"2024-09-21T09:13:35.375128+0000","last_peered":"2024-09-21T09:13:35.375128+0000","last_clean":"2024-09-21T09:13:35.375128+0000","last_became_active":"2024-09-21T09:13:19.152735+0000","last_became_peered":"2024-09-21T09:13:19.152735+0000","last_unstale":"2024-09-21T09:13:35.375128+0000","last_undegraded":"2024-09-21T09:13:35.375128+0000","last_fullsized":"2024-09-21T09:13:35.375128+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"91'51","reported_seq":219,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.202033+0000","last_change":"2024-09-21T09:13:55.202110+0000","last_active":"2024-09-21T09:13:55.202033+0000","last_peered":"2024-09-21T09:13:55.202033+0000","last_clean":"2024-09-21T09:13:55.202033+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:13:55.202033+0000","last_undegraded":"2024-09-21T09:13:55.202033+0000","last_fullsized":"2024-09-21T09:13:55.202033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'51","last_scrub_stamp":"2024-09-21T09:13:55.201857+0000","last_deep_scrub":"91'51","last_deep_scrub_stamp":"2024-09-21T09:13:55.201857+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.201857+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:49.637255+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.394550+0000","last_change":"2024-09-21T09:13:53.394609+0000","last_active":"2024-09-21T09:13:53.394550+0000","last_peered":"2024-09-21T09:13:53.394550+0000","last_clean":"2024-09-21T09:13:53.394550+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:13:53.394550+0000","last_undegraded":"2024-09-21T09:13:53.394550+0000","last_fullsized":"2024-09-21T09:13:53.394550+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.394338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.394338+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.394338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:38.938159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"71'2","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.703982+0000","last_change":"2024-09-21T09:13:54.704208+0000","last_active":"2024-09-21T09:13:54.703982+0000","last_peered":"2024-09-21T09:13:54.703982+0000","last_clean":"2024-09-21T09:13:54.703982+0000","last_became_active":"2024-09-21T09:13:19.140926+0000","last_became_peered":"2024-09-21T09:13:19.140926+0000","last_unstale":"2024-09-21T09:13:54.703982+0000","last_undegraded":"2024-09-21T09:13:54.703982+0000","last_fullsized":"2024-09-21T09:13:54.703982+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:13:54.703715+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:13:54.703715+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.703715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:43.202883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":426,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377444+0000","last_change":"2024-09-21T09:11:06.900571+0000","last_active":"2024-09-21T09:13:35.377444+0000","last_peered":"2024-09-21T09:13:35.377444+0000","last_clean":"2024-09-21T09:13:35.377444+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:13:35.377444+0000","last_undegraded":"2024-09-21T09:13:35.377444+0000","last_fullsized":"2024-09-21T09:13:35.377444+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"71'4","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.675739+0000","last_change":"2024-09-21T09:13:51.675798+0000","last_active":"2024-09-21T09:13:51.675739+0000","last_peered":"2024-09-21T09:13:51.675739+0000","last_clean":"2024-09-21T09:13:51.675739+0000","last_became_active":"2024-09-21T09:13:19.158305+0000","last_became_peered":"2024-09-21T09:13:19.158305+0000","last_unstale":"2024-09-21T09:13:51.675739+0000","last_undegraded":"2024-09-21T09:13:51.675739+0000","last_fullsized":"2024-09-21T09:13:51.675739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:51.675546+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:51.675546+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.675546+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:44.873979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"91'16","reported_seq":203,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.500567+0000","last_change":"2024-09-21T09:13:21.278992+0000","last_active":"2024-09-21T09:13:45.500567+0000","last_peered":"2024-09-21T09:13:45.500567+0000","last_clean":"2024-09-21T09:13:45.500567+0000","last_became_active":"2024-09-21T09:13:19.168562+0000","last_became_peered":"2024-09-21T09:13:19.168562+0000","last_unstale":"2024-09-21T09:13:45.500567+0000","last_undegraded":"2024-09-21T09:13:45.500567+0000","last_fullsized":"2024-09-21T09:13:45.500567+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.640276+0000","last_change":"2024-09-21T09:13:53.640428+0000","last_active":"2024-09-21T09:13:53.640276+0000","last_peered":"2024-09-21T09:13:53.640276+0000","last_clean":"2024-09-21T09:13:53.640276+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:13:53.640276+0000","last_undegraded":"2024-09-21T09:13:53.640276+0000","last_fullsized":"2024-09-21T09:13:53.640276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.640034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.640034+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.640034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:54.097218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"91'26","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.721123+0000","last_change":"2024-09-21T09:13:58.721193+0000","last_active":"2024-09-21T09:13:58.721123+0000","last_peered":"2024-09-21T09:13:58.721123+0000","last_clean":"2024-09-21T09:13:58.721123+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:13:58.721123+0000","last_undegraded":"2024-09-21T09:13:58.721123+0000","last_fullsized":"2024-09-21T09:13:58.721123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:13:58.720936+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:13:58.720936+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.720936+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:47.220103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":40,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.525733+0000","last_change":"2024-09-21T09:11:04.882308+0000","last_active":"2024-09-21T09:13:34.525733+0000","last_peered":"2024-09-21T09:13:34.525733+0000","last_clean":"2024-09-21T09:13:34.525733+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:13:34.525733+0000","last_undegraded":"2024-09-21T09:13:34.525733+0000","last_fullsized":"2024-09-21T09:13:34.525733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"61'16","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527382+0000","last_change":"2024-09-21T09:11:06.892382+0000","last_active":"2024-09-21T09:13:34.527382+0000","last_peered":"2024-09-21T09:13:34.527382+0000","last_clean":"2024-09-21T09:13:34.527382+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:13:34.527382+0000","last_undegraded":"2024-09-21T09:13:34.527382+0000","last_fullsized":"2024-09-21T09:13:34.527382+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"62'6","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.571510+0000","last_change":"2024-09-21T09:14:05.571575+0000","last_active":"2024-09-21T09:14:05.571510+0000","last_peered":"2024-09-21T09:14:05.571510+0000","last_clean":"2024-09-21T09:14:05.571510+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:14:05.571510+0000","last_undegraded":"2024-09-21T09:14:05.571510+0000","last_fullsized":"2024-09-21T09:14:05.571510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-09-21T09:14:05.571300+0000","last_deep_scrub":"62'6","last_deep_scrub_stamp":"2024-09-21T09:14:05.571300+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.571300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:07.501896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"91'16","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.522863+0000","last_change":"2024-09-21T09:10:56.854764+0000","last_active":"2024-09-21T09:13:45.522863+0000","last_peered":"2024-09-21T09:13:45.522863+0000","last_clean":"2024-09-21T09:13:45.522863+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:13:45.522863+0000","last_undegraded":"2024-09-21T09:13:45.522863+0000","last_fullsized":"2024-09-21T09:13:45.522863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.396996+0000","last_change":"2024-09-21T09:13:57.397053+0000","last_active":"2024-09-21T09:13:57.396996+0000","last_peered":"2024-09-21T09:13:57.396996+0000","last_clean":"2024-09-21T09:13:57.396996+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:13:57.396996+0000","last_undegraded":"2024-09-21T09:13:57.396996+0000","last_fullsized":"2024-09-21T09:13:57.396996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:57.396794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:57.396794+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.396794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:48.120616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"45'5","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.375515+0000","last_change":"2024-09-21T09:13:20.848665+0000","last_active":"2024-09-21T09:13:35.375515+0000","last_peered":"2024-09-21T09:13:35.375515+0000","last_clean":"2024-09-21T09:13:35.375515+0000","last_became_active":"2024-09-21T09:13:19.154000+0000","last_became_peered":"2024-09-21T09:13:19.154000+0000","last_unstale":"2024-09-21T09:13:35.375515+0000","last_undegraded":"2024-09-21T09:13:35.375515+0000","last_fullsized":"2024-09-21T09:13:35.375515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297639+0000","last_change":"2024-09-21T09:13:19.160157+0000","last_active":"2024-09-21T09:13:34.297639+0000","last_peered":"2024-09-21T09:13:34.297639+0000","last_clean":"2024-09-21T09:13:34.297639+0000","last_became_active":"2024-09-21T09:13:19.157523+0000","last_became_peered":"2024-09-21T09:13:19.157523+0000","last_unstale":"2024-09-21T09:13:34.297639+0000","last_undegraded":"2024-09-21T09:13:34.297639+0000","last_fullsized":"2024-09-21T09:13:34.297639+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:37.387982+0000","last_change":"2024-09-21T09:11:06.879042+0000","last_active":"2024-09-21T09:13:37.387982+0000","last_peered":"2024-09-21T09:13:37.387982+0000","last_clean":"2024-09-21T09:13:37.387982+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:13:37.387982+0000","last_undegraded":"2024-09-21T09:13:37.387982+0000","last_fullsized":"2024-09-21T09:13:37.387982+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377904+0000","last_change":"2024-09-21T09:10:58.864481+0000","last_active":"2024-09-21T09:13:35.377904+0000","last_peered":"2024-09-21T09:13:35.377904+0000","last_clean":"2024-09-21T09:13:35.377904+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:13:35.377904+0000","last_undegraded":"2024-09-21T09:13:35.377904+0000","last_fullsized":"2024-09-21T09:13:35.377904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"91'24","reported_seq":79,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.543284+0000","last_change":"2024-09-21T09:13:20.071816+0000","last_active":"2024-09-21T09:13:45.543284+0000","last_peered":"2024-09-21T09:13:45.543284+0000","last_clean":"2024-09-21T09:13:45.543284+0000","last_became_active":"2024-09-21T09:13:19.160370+0000","last_became_peered":"2024-09-21T09:13:19.160370+0000","last_unstale":"2024-09-21T09:13:45.543284+0000","last_undegraded":"2024-09-21T09:13:45.543284+0000","last_fullsized":"2024-09-21T09:13:45.543284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.712188+0000","last_change":"2024-09-21T09:14:03.712240+0000","last_active":"2024-09-21T09:14:03.712188+0000","last_peered":"2024-09-21T09:14:03.712188+0000","last_clean":"2024-09-21T09:14:03.712188+0000","last_became_active":"2024-09-21T09:13:19.142672+0000","last_became_peered":"2024-09-21T09:13:19.142672+0000","last_unstale":"2024-09-21T09:14:03.712188+0000","last_undegraded":"2024-09-21T09:14:03.712188+0000","last_fullsized":"2024-09-21T09:14:03.712188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:03.711998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:03.711998+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.711998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:48.861088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"91'24","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.855899+0000","last_change":"2024-09-21T09:13:54.855982+0000","last_active":"2024-09-21T09:13:54.855899+0000","last_peered":"2024-09-21T09:13:54.855899+0000","last_clean":"2024-09-21T09:13:54.855899+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:13:54.855899+0000","last_undegraded":"2024-09-21T09:13:54.855899+0000","last_fullsized":"2024-09-21T09:13:54.855899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:13:54.855688+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:13:54.855688+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.855688+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:13.221656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.528172+0000","last_change":"2024-09-21T09:11:04.893727+0000","last_active":"2024-09-21T09:13:35.528172+0000","last_peered":"2024-09-21T09:13:35.528172+0000","last_clean":"2024-09-21T09:13:35.528172+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:35.528172+0000","last_undegraded":"2024-09-21T09:13:35.528172+0000","last_fullsized":"2024-09-21T09:13:35.528172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"71'7","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:37.380840+0000","last_change":"2024-09-21T09:13:21.128242+0000","last_active":"2024-09-21T09:13:37.380840+0000","last_peered":"2024-09-21T09:13:37.380840+0000","last_clean":"2024-09-21T09:13:37.380840+0000","last_became_active":"2024-09-21T09:13:19.167169+0000","last_became_peered":"2024-09-21T09:13:19.167169+0000","last_unstale":"2024-09-21T09:13:37.380840+0000","last_undegraded":"2024-09-21T09:13:37.380840+0000","last_fullsized":"2024-09-21T09:13:37.380840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526161+0000","last_change":"2024-09-21T09:10:58.859005+0000","last_active":"2024-09-21T09:13:34.526161+0000","last_peered":"2024-09-21T09:13:34.526161+0000","last_clean":"2024-09-21T09:13:34.526161+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:13:34.526161+0000","last_undegraded":"2024-09-21T09:13:34.526161+0000","last_fullsized":"2024-09-21T09:13:34.526161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'18","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.600701+0000","last_change":"2024-09-21T09:10:56.860416+0000","last_active":"2024-09-21T09:13:45.600701+0000","last_peered":"2024-09-21T09:13:45.600701+0000","last_clean":"2024-09-21T09:13:45.600701+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:13:45.600701+0000","last_undegraded":"2024-09-21T09:13:45.600701+0000","last_fullsized":"2024-09-21T09:13:45.600701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.129722+0000","last_change":"2024-09-21T09:13:57.129779+0000","last_active":"2024-09-21T09:13:57.129722+0000","last_peered":"2024-09-21T09:13:57.129722+0000","last_clean":"2024-09-21T09:13:57.129722+0000","last_became_active":"2024-09-21T09:13:19.152722+0000","last_became_peered":"2024-09-21T09:13:19.152722+0000","last_unstale":"2024-09-21T09:13:57.129722+0000","last_undegraded":"2024-09-21T09:13:57.129722+0000","last_fullsized":"2024-09-21T09:13:57.129722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:57.129492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:57.129492+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.129492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:05:20.856713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"91'19","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.400919+0000","last_change":"2024-09-21T09:11:02.872950+0000","last_active":"2024-09-21T09:13:45.400919+0000","last_peered":"2024-09-21T09:13:45.400919+0000","last_clean":"2024-09-21T09:13:45.400919+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:13:45.400919+0000","last_undegraded":"2024-09-21T09:13:45.400919+0000","last_fullsized":"2024-09-21T09:13:45.400919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.526319+0000","last_change":"2024-09-21T09:13:19.144593+0000","last_active":"2024-09-21T09:13:34.526319+0000","last_peered":"2024-09-21T09:13:34.526319+0000","last_clean":"2024-09-21T09:13:34.526319+0000","last_became_active":"2024-09-21T09:13:19.143577+0000","last_became_peered":"2024-09-21T09:13:19.143577+0000","last_unstale":"2024-09-21T09:13:34.526319+0000","last_undegraded":"2024-09-21T09:13:34.526319+0000","last_fullsized":"2024-09-21T09:13:34.526319+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"61'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.264898+0000","last_change":"2024-09-21T09:14:07.264966+0000","last_active":"2024-09-21T09:14:07.264898+0000","last_peered":"2024-09-21T09:14:07.264898+0000","last_clean":"2024-09-21T09:14:07.264898+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:14:07.264898+0000","last_undegraded":"2024-09-21T09:14:07.264898+0000","last_fullsized":"2024-09-21T09:14:07.264898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-21T09:14:07.264688+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-21T09:14:07.264688+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.264688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:02.039746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"91'18","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.526673+0000","last_change":"2024-09-21T09:10:56.865435+0000","last_active":"2024-09-21T09:13:45.526673+0000","last_peered":"2024-09-21T09:13:45.526673+0000","last_clean":"2024-09-21T09:13:45.526673+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:13:45.526673+0000","last_undegraded":"2024-09-21T09:13:45.526673+0000","last_fullsized":"2024-09-21T09:13:45.526673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.642143+0000","last_change":"2024-09-21T09:13:52.642236+0000","last_active":"2024-09-21T09:13:52.642143+0000","last_peered":"2024-09-21T09:13:52.642143+0000","last_clean":"2024-09-21T09:13:52.642143+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:13:52.642143+0000","last_undegraded":"2024-09-21T09:13:52.642143+0000","last_fullsized":"2024-09-21T09:13:52.642143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:52.641939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:52.641939+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.641939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:06.854304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"91'30","reported_seq":177,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.397702+0000","last_change":"2024-09-21T09:11:02.879895+0000","last_active":"2024-09-21T09:13:45.397702+0000","last_peered":"2024-09-21T09:13:45.397702+0000","last_clean":"2024-09-21T09:13:45.397702+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:13:45.397702+0000","last_undegraded":"2024-09-21T09:13:45.397702+0000","last_fullsized":"2024-09-21T09:13:45.397702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.699873+0000","last_change":"2024-09-21T09:13:56.699926+0000","last_active":"2024-09-21T09:13:56.699873+0000","last_peered":"2024-09-21T09:13:56.699873+0000","last_clean":"2024-09-21T09:13:56.699873+0000","last_became_active":"2024-09-21T09:13:19.165859+0000","last_became_peered":"2024-09-21T09:13:19.165859+0000","last_unstale":"2024-09-21T09:13:56.699873+0000","last_undegraded":"2024-09-21T09:13:56.699873+0000","last_fullsized":"2024-09-21T09:13:56.699873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.699679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.699679+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.699679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:13.215807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957343+0000","last_change":"2024-09-21T09:11:06.896002+0000","last_active":"2024-09-21T09:13:34.957343+0000","last_peered":"2024-09-21T09:13:34.957343+0000","last_clean":"2024-09-21T09:13:34.957343+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:13:34.957343+0000","last_undegraded":"2024-09-21T09:13:34.957343+0000","last_fullsized":"2024-09-21T09:13:34.957343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"71'10","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.510259+0000","last_change":"2024-09-21T09:14:03.510421+0000","last_active":"2024-09-21T09:14:03.510259+0000","last_peered":"2024-09-21T09:14:03.510259+0000","last_clean":"2024-09-21T09:14:03.510259+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:14:03.510259+0000","last_undegraded":"2024-09-21T09:14:03.510259+0000","last_fullsized":"2024-09-21T09:14:03.510259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:14:03.509980+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:14:03.509980+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.509980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:56.009549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"91'10","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.526526+0000","last_change":"2024-09-21T09:10:56.827351+0000","last_active":"2024-09-21T09:13:45.526526+0000","last_peered":"2024-09-21T09:13:45.526526+0000","last_clean":"2024-09-21T09:13:45.526526+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:13:45.526526+0000","last_undegraded":"2024-09-21T09:13:45.526526+0000","last_fullsized":"2024-09-21T09:13:45.526526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.795572+0000","last_change":"2024-09-21T09:14:05.795627+0000","last_active":"2024-09-21T09:14:05.795572+0000","last_peered":"2024-09-21T09:14:05.795572+0000","last_clean":"2024-09-21T09:14:05.795572+0000","last_became_active":"2024-09-21T09:13:19.158652+0000","last_became_peered":"2024-09-21T09:13:19.158652+0000","last_unstale":"2024-09-21T09:14:05.795572+0000","last_undegraded":"2024-09-21T09:14:05.795572+0000","last_fullsized":"2024-09-21T09:14:05.795572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:05.795378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:05.795378+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.795378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:12.074752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"91'25","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.405482+0000","last_change":"2024-09-21T09:13:21.165572+0000","last_active":"2024-09-21T09:13:45.405482+0000","last_peered":"2024-09-21T09:13:45.405482+0000","last_clean":"2024-09-21T09:13:45.405482+0000","last_became_active":"2024-09-21T09:13:19.167344+0000","last_became_peered":"2024-09-21T09:13:19.167344+0000","last_unstale":"2024-09-21T09:13:45.405482+0000","last_undegraded":"2024-09-21T09:13:45.405482+0000","last_fullsized":"2024-09-21T09:13:45.405482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:37.392337+0000","last_change":"2024-09-21T09:11:04.890782+0000","last_active":"2024-09-21T09:13:37.392337+0000","last_peered":"2024-09-21T09:13:37.392337+0000","last_clean":"2024-09-21T09:13:37.392337+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:13:37.392337+0000","last_undegraded":"2024-09-21T09:13:37.392337+0000","last_fullsized":"2024-09-21T09:13:37.392337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"71'2","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.193736+0000","last_change":"2024-09-21T09:13:52.193764+0000","last_active":"2024-09-21T09:13:52.193736+0000","last_peered":"2024-09-21T09:13:52.193736+0000","last_clean":"2024-09-21T09:13:52.193736+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:13:52.193736+0000","last_undegraded":"2024-09-21T09:13:52.193736+0000","last_fullsized":"2024-09-21T09:13:52.193736+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:13:52.193636+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:13:52.193636+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.193636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:37.470983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"62'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.833452+0000","last_change":"2024-09-21T09:14:05.833512+0000","last_active":"2024-09-21T09:14:05.833452+0000","last_peered":"2024-09-21T09:14:05.833452+0000","last_clean":"2024-09-21T09:14:05.833452+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:14:05.833452+0000","last_undegraded":"2024-09-21T09:14:05.833452+0000","last_fullsized":"2024-09-21T09:14:05.833452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:05.833245+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:05.833245+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.833245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:16.336869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"91'20","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.580398+0000","last_change":"2024-09-21T09:10:56.863198+0000","last_active":"2024-09-21T09:13:45.580398+0000","last_peered":"2024-09-21T09:13:45.580398+0000","last_clean":"2024-09-21T09:13:45.580398+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:13:45.580398+0000","last_undegraded":"2024-09-21T09:13:45.580398+0000","last_fullsized":"2024-09-21T09:13:45.580398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.042188+0000","last_change":"2024-09-21T09:13:20.592162+0000","last_active":"2024-09-21T09:13:45.042188+0000","last_peered":"2024-09-21T09:13:45.042188+0000","last_clean":"2024-09-21T09:13:45.042188+0000","last_became_active":"2024-09-21T09:13:19.165929+0000","last_became_peered":"2024-09-21T09:13:19.165929+0000","last_unstale":"2024-09-21T09:13:45.042188+0000","last_undegraded":"2024-09-21T09:13:45.042188+0000","last_fullsized":"2024-09-21T09:13:45.042188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:59.807443+0000","last_clean_scrub_stamp":"2024-09-21T09:10:59.807443+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"91'24","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.759353+0000","last_change":"2024-09-21T09:14:02.759443+0000","last_active":"2024-09-21T09:14:02.759353+0000","last_peered":"2024-09-21T09:14:02.759353+0000","last_clean":"2024-09-21T09:14:02.759353+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:14:02.759353+0000","last_undegraded":"2024-09-21T09:14:02.759353+0000","last_fullsized":"2024-09-21T09:14:02.759353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:02.759160+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:02.759160+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.759160+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:55.261638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.843099+0000","last_change":"2024-09-21T09:14:00.843157+0000","last_active":"2024-09-21T09:14:00.843099+0000","last_peered":"2024-09-21T09:14:00.843099+0000","last_clean":"2024-09-21T09:14:00.843099+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:14:00.843099+0000","last_undegraded":"2024-09-21T09:14:00.843099+0000","last_fullsized":"2024-09-21T09:14:00.843099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.842897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.842897+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.842897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:37.126044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"62'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.144792+0000","last_change":"2024-09-21T09:13:51.144825+0000","last_active":"2024-09-21T09:13:51.144792+0000","last_peered":"2024-09-21T09:13:51.144792+0000","last_clean":"2024-09-21T09:13:51.144792+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:13:51.144792+0000","last_undegraded":"2024-09-21T09:13:51.144792+0000","last_fullsized":"2024-09-21T09:13:51.144792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-09-21T09:13:51.144678+0000","last_deep_scrub":"62'10","last_deep_scrub_stamp":"2024-09-21T09:13:51.144678+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.144678+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:19.905897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":39,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377807+0000","last_change":"2024-09-21T09:10:58.868807+0000","last_active":"2024-09-21T09:13:35.377807+0000","last_peered":"2024-09-21T09:13:35.377807+0000","last_clean":"2024-09-21T09:13:35.377807+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:13:35.377807+0000","last_undegraded":"2024-09-21T09:13:35.377807+0000","last_fullsized":"2024-09-21T09:13:35.377807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"91'24","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.597815+0000","last_change":"2024-09-21T09:10:56.851205+0000","last_active":"2024-09-21T09:13:45.597815+0000","last_peered":"2024-09-21T09:13:45.597815+0000","last_clean":"2024-09-21T09:13:45.597815+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:13:45.597815+0000","last_undegraded":"2024-09-21T09:13:45.597815+0000","last_fullsized":"2024-09-21T09:13:45.597815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.453959+0000","last_change":"2024-09-21T09:14:00.454139+0000","last_active":"2024-09-21T09:14:00.453959+0000","last_peered":"2024-09-21T09:14:00.453959+0000","last_clean":"2024-09-21T09:14:00.453959+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:14:00.453959+0000","last_undegraded":"2024-09-21T09:14:00.453959+0000","last_fullsized":"2024-09-21T09:14:00.453959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.453712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.453712+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.453712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:03.275108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"74'14","reported_seq":190,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483050+0000","last_change":"2024-09-21T09:13:21.153990+0000","last_active":"2024-09-21T09:13:34.483050+0000","last_peered":"2024-09-21T09:13:34.483050+0000","last_clean":"2024-09-21T09:13:34.483050+0000","last_became_active":"2024-09-21T09:13:19.167321+0000","last_became_peered":"2024-09-21T09:13:19.167321+0000","last_unstale":"2024-09-21T09:13:34.483050+0000","last_undegraded":"2024-09-21T09:13:34.483050+0000","last_fullsized":"2024-09-21T09:13:34.483050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"91'105","reported_seq":275,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.610096+0000","last_change":"2024-09-21T09:11:04.870463+0000","last_active":"2024-09-21T09:13:45.610096+0000","last_peered":"2024-09-21T09:13:45.610096+0000","last_clean":"2024-09-21T09:13:45.610096+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:13:45.610096+0000","last_undegraded":"2024-09-21T09:13:45.610096+0000","last_fullsized":"2024-09-21T09:13:45.610096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:03.832426+0000","last_clean_scrub_stamp":"2024-09-21T09:11:03.832426+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"58'2","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.191989+0000","last_change":"2024-09-21T09:13:54.192051+0000","last_active":"2024-09-21T09:13:54.191989+0000","last_peered":"2024-09-21T09:13:54.191989+0000","last_clean":"2024-09-21T09:13:54.191989+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:13:54.191989+0000","last_undegraded":"2024-09-21T09:13:54.191989+0000","last_fullsized":"2024-09-21T09:13:54.191989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:54.191786+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:54.191786+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.191786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:02.969361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"71'10","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.677726+0000","last_change":"2024-09-21T09:13:53.677785+0000","last_active":"2024-09-21T09:13:53.677726+0000","last_peered":"2024-09-21T09:13:53.677726+0000","last_clean":"2024-09-21T09:13:53.677726+0000","last_became_active":"2024-09-21T09:13:19.159904+0000","last_became_peered":"2024-09-21T09:13:19.159904+0000","last_unstale":"2024-09-21T09:13:53.677726+0000","last_undegraded":"2024-09-21T09:13:53.677726+0000","last_fullsized":"2024-09-21T09:13:53.677726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:13:53.677529+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:13:53.677529+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.677529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:17.824810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"91'22","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.583980+0000","last_change":"2024-09-21T09:10:56.852586+0000","last_active":"2024-09-21T09:13:45.583980+0000","last_peered":"2024-09-21T09:13:45.583980+0000","last_clean":"2024-09-21T09:13:45.583980+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:13:45.583980+0000","last_undegraded":"2024-09-21T09:13:45.583980+0000","last_fullsized":"2024-09-21T09:13:45.583980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.808379+0000","last_change":"2024-09-21T09:13:54.808438+0000","last_active":"2024-09-21T09:13:54.808379+0000","last_peered":"2024-09-21T09:13:54.808379+0000","last_clean":"2024-09-21T09:13:54.808379+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:13:54.808379+0000","last_undegraded":"2024-09-21T09:13:54.808379+0000","last_fullsized":"2024-09-21T09:13:54.808379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:54.808158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:54.808158+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.808158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:12.602854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"91'31","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.145113+0000","last_change":"2024-09-21T09:13:57.145195+0000","last_active":"2024-09-21T09:13:57.145113+0000","last_peered":"2024-09-21T09:13:57.145113+0000","last_clean":"2024-09-21T09:13:57.145113+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:13:57.145113+0000","last_undegraded":"2024-09-21T09:13:57.145113+0000","last_fullsized":"2024-09-21T09:13:57.145113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'31","last_scrub_stamp":"2024-09-21T09:13:57.144916+0000","last_deep_scrub":"91'31","last_deep_scrub_stamp":"2024-09-21T09:13:57.144916+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.144916+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:50.267672+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.430683+0000","last_change":"2024-09-21T09:13:55.430833+0000","last_active":"2024-09-21T09:13:55.430683+0000","last_peered":"2024-09-21T09:13:55.430683+0000","last_clean":"2024-09-21T09:13:55.430683+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:13:55.430683+0000","last_undegraded":"2024-09-21T09:13:55.430683+0000","last_fullsized":"2024-09-21T09:13:55.430683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:55.430438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:55.430438+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.430438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:15.880700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"71'10","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527895+0000","last_change":"2024-09-21T09:11:06.873636+0000","last_active":"2024-09-21T09:13:35.527895+0000","last_peered":"2024-09-21T09:13:35.527895+0000","last_clean":"2024-09-21T09:13:35.527895+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:13:35.527895+0000","last_undegraded":"2024-09-21T09:13:35.527895+0000","last_fullsized":"2024-09-21T09:13:35.527895+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.736545+0000","last_change":"2024-09-21T09:14:02.736598+0000","last_active":"2024-09-21T09:14:02.736545+0000","last_peered":"2024-09-21T09:14:02.736545+0000","last_clean":"2024-09-21T09:14:02.736545+0000","last_became_active":"2024-09-21T09:13:19.143746+0000","last_became_peered":"2024-09-21T09:13:19.143746+0000","last_unstale":"2024-09-21T09:14:02.736545+0000","last_undegraded":"2024-09-21T09:14:02.736545+0000","last_fullsized":"2024-09-21T09:14:02.736545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:02.736334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:02.736334+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.736334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:06.609424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"91'30","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.227457+0000","last_change":"2024-09-21T09:13:53.227523+0000","last_active":"2024-09-21T09:13:53.227457+0000","last_peered":"2024-09-21T09:13:53.227457+0000","last_clean":"2024-09-21T09:13:53.227457+0000","last_became_active":"2024-09-21T09:11:34.170599+0000","last_became_peered":"2024-09-21T09:11:34.170599+0000","last_unstale":"2024-09-21T09:13:53.227457+0000","last_undegraded":"2024-09-21T09:13:53.227457+0000","last_fullsized":"2024-09-21T09:13:53.227457+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'30","last_scrub_stamp":"2024-09-21T09:13:53.227240+0000","last_deep_scrub":"91'30","last_deep_scrub_stamp":"2024-09-21T09:13:53.227240+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.227240+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:50.752780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.691148+0000","last_change":"2024-09-21T09:14:01.691205+0000","last_active":"2024-09-21T09:14:01.691148+0000","last_peered":"2024-09-21T09:14:01.691148+0000","last_clean":"2024-09-21T09:14:01.691148+0000","last_became_active":"2024-09-21T09:13:19.141404+0000","last_became_peered":"2024-09-21T09:13:19.141404+0000","last_unstale":"2024-09-21T09:14:01.691148+0000","last_undegraded":"2024-09-21T09:14:01.691148+0000","last_fullsized":"2024-09-21T09:14:01.691148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.690948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.690948+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.690948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:39.633204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.471406+0000","last_change":"2024-09-21T09:14:02.471502+0000","last_active":"2024-09-21T09:14:02.471406+0000","last_peered":"2024-09-21T09:14:02.471406+0000","last_clean":"2024-09-21T09:14:02.471406+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:14:02.471406+0000","last_undegraded":"2024-09-21T09:14:02.471406+0000","last_fullsized":"2024-09-21T09:14:02.471406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:02.471144+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:02.471144+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.471144+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:11.892110+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.134742+0000","last_change":"2024-09-21T09:13:59.134849+0000","last_active":"2024-09-21T09:13:59.134742+0000","last_peered":"2024-09-21T09:13:59.134742+0000","last_clean":"2024-09-21T09:13:59.134742+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:13:59.134742+0000","last_undegraded":"2024-09-21T09:13:59.134742+0000","last_fullsized":"2024-09-21T09:13:59.134742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:59.134483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:59.134483+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.134483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:40.830729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957548+0000","last_change":"2024-09-21T09:11:06.899493+0000","last_active":"2024-09-21T09:13:34.957548+0000","last_peered":"2024-09-21T09:13:34.957548+0000","last_clean":"2024-09-21T09:13:34.957548+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:13:34.957548+0000","last_undegraded":"2024-09-21T09:13:34.957548+0000","last_fullsized":"2024-09-21T09:13:34.957548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.847984+0000","last_change":"2024-09-21T09:14:06.848035+0000","last_active":"2024-09-21T09:14:06.847984+0000","last_peered":"2024-09-21T09:14:06.847984+0000","last_clean":"2024-09-21T09:14:06.847984+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:14:06.847984+0000","last_undegraded":"2024-09-21T09:14:06.847984+0000","last_fullsized":"2024-09-21T09:14:06.847984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:06.847793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:06.847793+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.847793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:54.140783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"91'22","reported_seq":222,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.600946+0000","last_change":"2024-09-21T09:13:20.628384+0000","last_active":"2024-09-21T09:13:45.600946+0000","last_peered":"2024-09-21T09:13:45.600946+0000","last_clean":"2024-09-21T09:13:45.600946+0000","last_became_active":"2024-09-21T09:13:19.169569+0000","last_became_peered":"2024-09-21T09:13:19.169569+0000","last_unstale":"2024-09-21T09:13:45.600946+0000","last_undegraded":"2024-09-21T09:13:45.600946+0000","last_fullsized":"2024-09-21T09:13:45.600946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:49.711655+0000","last_change":"2024-09-21T09:13:49.711711+0000","last_active":"2024-09-21T09:13:49.711655+0000","last_peered":"2024-09-21T09:13:49.711655+0000","last_clean":"2024-09-21T09:13:49.711655+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:13:49.711655+0000","last_undegraded":"2024-09-21T09:13:49.711655+0000","last_fullsized":"2024-09-21T09:13:49.711655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:49.711547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:49.711547+0000","last_clean_scrub_stamp":"2024-09-21T09:13:49.711547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:08.077515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"91'14","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.158135+0000","last_change":"2024-09-21T09:13:20.076515+0000","last_active":"2024-09-21T09:13:45.158135+0000","last_peered":"2024-09-21T09:13:45.158135+0000","last_clean":"2024-09-21T09:13:45.158135+0000","last_became_active":"2024-09-21T09:13:19.150207+0000","last_became_peered":"2024-09-21T09:13:19.150207+0000","last_unstale":"2024-09-21T09:13:45.158135+0000","last_undegraded":"2024-09-21T09:13:45.158135+0000","last_fullsized":"2024-09-21T09:13:45.158135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.159493+0000","last_change":"2024-09-21T09:13:58.159551+0000","last_active":"2024-09-21T09:13:58.159493+0000","last_peered":"2024-09-21T09:13:58.159493+0000","last_clean":"2024-09-21T09:13:58.159493+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:13:58.159493+0000","last_undegraded":"2024-09-21T09:13:58.159493+0000","last_fullsized":"2024-09-21T09:13:58.159493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.159293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.159293+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.159293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:00.285955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.140566+0000","last_change":"2024-09-21T09:14:01.140618+0000","last_active":"2024-09-21T09:14:01.140566+0000","last_peered":"2024-09-21T09:14:01.140566+0000","last_clean":"2024-09-21T09:14:01.140566+0000","last_became_active":"2024-09-21T09:13:19.157306+0000","last_became_peered":"2024-09-21T09:13:19.157306+0000","last_unstale":"2024-09-21T09:14:01.140566+0000","last_undegraded":"2024-09-21T09:14:01.140566+0000","last_fullsized":"2024-09-21T09:14:01.140566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.140359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.140359+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.140359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:42.381193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"71'4","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.716046+0000","last_change":"2024-09-21T09:13:59.716197+0000","last_active":"2024-09-21T09:13:59.716046+0000","last_peered":"2024-09-21T09:13:59.716046+0000","last_clean":"2024-09-21T09:13:59.716046+0000","last_became_active":"2024-09-21T09:13:19.161496+0000","last_became_peered":"2024-09-21T09:13:19.161496+0000","last_unstale":"2024-09-21T09:13:59.716046+0000","last_undegraded":"2024-09-21T09:13:59.716046+0000","last_fullsized":"2024-09-21T09:13:59.716046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:59.715805+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:59.715805+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.715805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.862207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"91'8","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.593660+0000","last_change":"2024-09-21T09:10:56.861373+0000","last_active":"2024-09-21T09:13:45.593660+0000","last_peered":"2024-09-21T09:13:45.593660+0000","last_clean":"2024-09-21T09:13:45.593660+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:13:45.593660+0000","last_undegraded":"2024-09-21T09:13:45.593660+0000","last_fullsized":"2024-09-21T09:13:45.593660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"91'2","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.415530+0000","last_change":"2024-09-21T09:13:59.415662+0000","last_active":"2024-09-21T09:13:59.415530+0000","last_peered":"2024-09-21T09:13:59.415530+0000","last_clean":"2024-09-21T09:13:59.415530+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:13:59.415530+0000","last_undegraded":"2024-09-21T09:13:59.415530+0000","last_fullsized":"2024-09-21T09:13:59.415530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-21T09:13:59.415299+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-21T09:13:59.415299+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.415299+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:12.290157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"91'24","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.190973+0000","last_change":"2024-09-21T09:14:02.191055+0000","last_active":"2024-09-21T09:14:02.190973+0000","last_peered":"2024-09-21T09:14:02.190973+0000","last_clean":"2024-09-21T09:14:02.190973+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:14:02.190973+0000","last_undegraded":"2024-09-21T09:14:02.190973+0000","last_fullsized":"2024-09-21T09:14:02.190973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:02.190779+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:02.190779+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.190779+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:09.648803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":155,"num_write":18,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.362314+0000","last_change":"2024-09-21T09:13:51.362369+0000","last_active":"2024-09-21T09:13:51.362314+0000","last_peered":"2024-09-21T09:13:51.362314+0000","last_clean":"2024-09-21T09:13:51.362314+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:13:51.362314+0000","last_undegraded":"2024-09-21T09:13:51.362314+0000","last_fullsized":"2024-09-21T09:13:51.362314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:51.362073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:51.362073+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.362073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:33.156385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'2","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.297435+0000","last_change":"2024-09-21T09:13:20.646926+0000","last_active":"2024-09-21T09:13:34.297435+0000","last_peered":"2024-09-21T09:13:34.297435+0000","last_clean":"2024-09-21T09:13:34.297435+0000","last_became_active":"2024-09-21T09:13:19.153765+0000","last_became_peered":"2024-09-21T09:13:19.153765+0000","last_unstale":"2024-09-21T09:13:34.297435+0000","last_undegraded":"2024-09-21T09:13:34.297435+0000","last_fullsized":"2024-09-21T09:13:34.297435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'6","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.378693+0000","last_change":"2024-09-21T09:10:58.865842+0000","last_active":"2024-09-21T09:13:35.378693+0000","last_peered":"2024-09-21T09:13:35.378693+0000","last_clean":"2024-09-21T09:13:35.378693+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:13:35.378693+0000","last_undegraded":"2024-09-21T09:13:35.378693+0000","last_fullsized":"2024-09-21T09:13:35.378693+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"91'14","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:50.681288+0000","last_change":"2024-09-21T09:13:50.681323+0000","last_active":"2024-09-21T09:13:50.681288+0000","last_peered":"2024-09-21T09:13:50.681288+0000","last_clean":"2024-09-21T09:13:50.681288+0000","last_became_active":"2024-09-21T09:13:19.143052+0000","last_became_peered":"2024-09-21T09:13:19.143052+0000","last_unstale":"2024-09-21T09:13:50.681288+0000","last_undegraded":"2024-09-21T09:13:50.681288+0000","last_fullsized":"2024-09-21T09:13:50.681288+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:13:50.681171+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:13:50.681171+0000","last_clean_scrub_stamp":"2024-09-21T09:13:50.681171+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:45.116569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"71'8","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.528014+0000","last_change":"2024-09-21T09:10:58.871267+0000","last_active":"2024-09-21T09:13:34.528014+0000","last_peered":"2024-09-21T09:13:34.528014+0000","last_clean":"2024-09-21T09:13:34.528014+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:13:34.528014+0000","last_undegraded":"2024-09-21T09:13:34.528014+0000","last_fullsized":"2024-09-21T09:13:34.528014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"91'16","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.828782+0000","last_change":"2024-09-21T09:14:03.828841+0000","last_active":"2024-09-21T09:14:03.828782+0000","last_peered":"2024-09-21T09:14:03.828782+0000","last_clean":"2024-09-21T09:14:03.828782+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:14:03.828782+0000","last_undegraded":"2024-09-21T09:14:03.828782+0000","last_fullsized":"2024-09-21T09:14:03.828782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:03.828580+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:03.828580+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.828580+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:27.975861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.482807+0000","last_change":"2024-09-21T09:10:58.837841+0000","last_active":"2024-09-21T09:13:34.482807+0000","last_peered":"2024-09-21T09:13:34.482807+0000","last_clean":"2024-09-21T09:13:34.482807+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:13:34.482807+0000","last_undegraded":"2024-09-21T09:13:34.482807+0000","last_fullsized":"2024-09-21T09:13:34.482807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"91'22","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.598648+0000","last_change":"2024-09-21T09:10:56.861995+0000","last_active":"2024-09-21T09:13:45.598648+0000","last_peered":"2024-09-21T09:13:45.598648+0000","last_clean":"2024-09-21T09:13:45.598648+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:13:45.598648+0000","last_undegraded":"2024-09-21T09:13:45.598648+0000","last_fullsized":"2024-09-21T09:13:45.598648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"58'4","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.957116+0000","last_change":"2024-09-21T09:13:20.835461+0000","last_active":"2024-09-21T09:13:34.957116+0000","last_peered":"2024-09-21T09:13:34.957116+0000","last_clean":"2024-09-21T09:13:34.957116+0000","last_became_active":"2024-09-21T09:13:19.169698+0000","last_became_peered":"2024-09-21T09:13:19.169698+0000","last_unstale":"2024-09-21T09:13:34.957116+0000","last_undegraded":"2024-09-21T09:13:34.957116+0000","last_fullsized":"2024-09-21T09:13:34.957116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"91'12","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.579439+0000","last_change":"2024-09-21T09:10:56.866139+0000","last_active":"2024-09-21T09:13:45.579439+0000","last_peered":"2024-09-21T09:13:45.579439+0000","last_clean":"2024-09-21T09:13:45.579439+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:13:45.579439+0000","last_undegraded":"2024-09-21T09:13:45.579439+0000","last_fullsized":"2024-09-21T09:13:45.579439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"58'6","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.991436+0000","last_change":"2024-09-21T09:14:00.991495+0000","last_active":"2024-09-21T09:14:00.991436+0000","last_peered":"2024-09-21T09:14:00.991436+0000","last_clean":"2024-09-21T09:14:00.991436+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:14:00.991436+0000","last_undegraded":"2024-09-21T09:14:00.991436+0000","last_fullsized":"2024-09-21T09:14:00.991436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'6","last_scrub_stamp":"2024-09-21T09:14:00.991188+0000","last_deep_scrub":"58'6","last_deep_scrub_stamp":"2024-09-21T09:14:00.991188+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.991188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:38.933444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"91'16","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.584034+0000","last_change":"2024-09-21T09:10:56.860054+0000","last_active":"2024-09-21T09:13:45.584034+0000","last_peered":"2024-09-21T09:13:45.584034+0000","last_clean":"2024-09-21T09:13:45.584034+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:13:45.584034+0000","last_undegraded":"2024-09-21T09:13:45.584034+0000","last_fullsized":"2024-09-21T09:13:45.584034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"71'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.178229+0000","last_change":"2024-09-21T09:13:56.178383+0000","last_active":"2024-09-21T09:13:56.178229+0000","last_peered":"2024-09-21T09:13:56.178229+0000","last_clean":"2024-09-21T09:13:56.178229+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:13:56.178229+0000","last_undegraded":"2024-09-21T09:13:56.178229+0000","last_fullsized":"2024-09-21T09:13:56.178229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:56.177990+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:56.177990+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.177990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:49.376423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"91'16","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.598136+0000","last_change":"2024-09-21T09:10:56.862765+0000","last_active":"2024-09-21T09:13:45.598136+0000","last_peered":"2024-09-21T09:13:45.598136+0000","last_clean":"2024-09-21T09:13:45.598136+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:13:45.598136+0000","last_undegraded":"2024-09-21T09:13:45.598136+0000","last_fullsized":"2024-09-21T09:13:45.598136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"62'2","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.294321+0000","last_change":"2024-09-21T09:10:58.826466+0000","last_active":"2024-09-21T09:13:34.294321+0000","last_peered":"2024-09-21T09:13:34.294321+0000","last_clean":"2024-09-21T09:13:34.294321+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:13:34.294321+0000","last_undegraded":"2024-09-21T09:13:34.294321+0000","last_fullsized":"2024-09-21T09:13:34.294321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"91'18","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.598842+0000","last_change":"2024-09-21T09:13:20.211974+0000","last_active":"2024-09-21T09:13:45.598842+0000","last_peered":"2024-09-21T09:13:45.598842+0000","last_clean":"2024-09-21T09:13:45.598842+0000","last_became_active":"2024-09-21T09:13:19.161214+0000","last_became_peered":"2024-09-21T09:13:19.161214+0000","last_unstale":"2024-09-21T09:13:45.598842+0000","last_undegraded":"2024-09-21T09:13:45.598842+0000","last_fullsized":"2024-09-21T09:13:45.598842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"62'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.736604+0000","last_change":"2024-09-21T09:13:51.736626+0000","last_active":"2024-09-21T09:13:51.736604+0000","last_peered":"2024-09-21T09:13:51.736604+0000","last_clean":"2024-09-21T09:13:51.736604+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:13:51.736604+0000","last_undegraded":"2024-09-21T09:13:51.736604+0000","last_fullsized":"2024-09-21T09:13:51.736604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:51.736518+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:51.736518+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.736518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:14.149656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"91'18","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.539514+0000","last_change":"2024-09-21T09:10:56.861072+0000","last_active":"2024-09-21T09:13:45.539514+0000","last_peered":"2024-09-21T09:13:45.539514+0000","last_clean":"2024-09-21T09:13:45.539514+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:13:45.539514+0000","last_undegraded":"2024-09-21T09:13:45.539514+0000","last_fullsized":"2024-09-21T09:13:45.539514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"71'2","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.527881+0000","last_change":"2024-09-21T09:10:58.856982+0000","last_active":"2024-09-21T09:13:34.527881+0000","last_peered":"2024-09-21T09:13:34.527881+0000","last_clean":"2024-09-21T09:13:34.527881+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:13:34.527881+0000","last_undegraded":"2024-09-21T09:13:34.527881+0000","last_fullsized":"2024-09-21T09:13:34.527881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"91'14","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.593522+0000","last_change":"2024-09-21T09:10:56.847793+0000","last_active":"2024-09-21T09:13:45.593522+0000","last_peered":"2024-09-21T09:13:45.593522+0000","last_clean":"2024-09-21T09:13:45.593522+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:13:45.593522+0000","last_undegraded":"2024-09-21T09:13:45.593522+0000","last_fullsized":"2024-09-21T09:13:45.593522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"62'2","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.135852+0000","last_change":"2024-09-21T09:13:52.135885+0000","last_active":"2024-09-21T09:13:52.135852+0000","last_peered":"2024-09-21T09:13:52.135852+0000","last_clean":"2024-09-21T09:13:52.135852+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:13:52.135852+0000","last_undegraded":"2024-09-21T09:13:52.135852+0000","last_fullsized":"2024-09-21T09:13:52.135852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:52.135752+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:52.135752+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.135752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:56.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"91'24","reported_seq":228,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.594740+0000","last_change":"2024-09-21T09:13:20.068227+0000","last_active":"2024-09-21T09:13:45.594740+0000","last_peered":"2024-09-21T09:13:45.594740+0000","last_clean":"2024-09-21T09:13:45.594740+0000","last_became_active":"2024-09-21T09:13:19.169480+0000","last_became_peered":"2024-09-21T09:13:19.169480+0000","last_unstale":"2024-09-21T09:13:45.594740+0000","last_undegraded":"2024-09-21T09:13:45.594740+0000","last_fullsized":"2024-09-21T09:13:45.594740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.946506+0000","last_change":"2024-09-21T09:14:02.946557+0000","last_active":"2024-09-21T09:14:02.946506+0000","last_peered":"2024-09-21T09:14:02.946506+0000","last_clean":"2024-09-21T09:14:02.946506+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:14:02.946506+0000","last_undegraded":"2024-09-21T09:14:02.946506+0000","last_fullsized":"2024-09-21T09:14:02.946506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:02.946351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:02.946351+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.946351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:48.095441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.885130+0000","last_change":"2024-09-21T09:14:05.885193+0000","last_active":"2024-09-21T09:14:05.885130+0000","last_peered":"2024-09-21T09:14:05.885130+0000","last_clean":"2024-09-21T09:14:05.885130+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:14:05.885130+0000","last_undegraded":"2024-09-21T09:14:05.885130+0000","last_fullsized":"2024-09-21T09:14:05.885130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-21T09:14:05.884933+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-21T09:14:05.884933+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.884933+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:19.026961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.775875+0000","last_change":"2024-09-21T09:13:53.775933+0000","last_active":"2024-09-21T09:13:53.775875+0000","last_peered":"2024-09-21T09:13:53.775875+0000","last_clean":"2024-09-21T09:13:53.775875+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:13:53.775875+0000","last_undegraded":"2024-09-21T09:13:53.775875+0000","last_fullsized":"2024-09-21T09:13:53.775875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:53.775675+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:53.775675+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.775675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:07.988041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'26","reported_seq":236,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.599040+0000","last_change":"2024-09-21T09:13:20.275872+0000","last_active":"2024-09-21T09:13:45.599040+0000","last_peered":"2024-09-21T09:13:45.599040+0000","last_clean":"2024-09-21T09:13:45.599040+0000","last_became_active":"2024-09-21T09:13:19.153073+0000","last_became_peered":"2024-09-21T09:13:19.153073+0000","last_unstale":"2024-09-21T09:13:45.599040+0000","last_undegraded":"2024-09-21T09:13:45.599040+0000","last_fullsized":"2024-09-21T09:13:45.599040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.828058+0000","last_change":"2024-09-21T09:13:55.828116+0000","last_active":"2024-09-21T09:13:55.828058+0000","last_peered":"2024-09-21T09:13:55.828058+0000","last_clean":"2024-09-21T09:13:55.828058+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:13:55.828058+0000","last_undegraded":"2024-09-21T09:13:55.828058+0000","last_fullsized":"2024-09-21T09:13:55.828058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:55.827822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:55.827822+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.827822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:50.263220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"91'26","reported_seq":177,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.093705+0000","last_change":"2024-09-21T09:14:01.093772+0000","last_active":"2024-09-21T09:14:01.093705+0000","last_peered":"2024-09-21T09:14:01.093705+0000","last_clean":"2024-09-21T09:14:01.093705+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:14:01.093705+0000","last_undegraded":"2024-09-21T09:14:01.093705+0000","last_fullsized":"2024-09-21T09:14:01.093705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:01.093485+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:01.093485+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.093485+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:17.609612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.863628+0000","last_change":"2024-09-21T09:13:59.863692+0000","last_active":"2024-09-21T09:13:59.863628+0000","last_peered":"2024-09-21T09:13:59.863628+0000","last_clean":"2024-09-21T09:13:59.863628+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:13:59.863628+0000","last_undegraded":"2024-09-21T09:13:59.863628+0000","last_fullsized":"2024-09-21T09:13:59.863628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-21T09:13:59.863431+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-21T09:13:59.863431+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.863431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:00.320615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"91'10","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.537426+0000","last_change":"2024-09-21T09:10:56.843359+0000","last_active":"2024-09-21T09:13:45.537426+0000","last_peered":"2024-09-21T09:13:45.537426+0000","last_clean":"2024-09-21T09:13:45.537426+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:13:45.537426+0000","last_undegraded":"2024-09-21T09:13:45.537426+0000","last_fullsized":"2024-09-21T09:13:45.537426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"71'4","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.377199+0000","last_change":"2024-09-21T09:10:58.864268+0000","last_active":"2024-09-21T09:13:35.377199+0000","last_peered":"2024-09-21T09:13:35.377199+0000","last_clean":"2024-09-21T09:13:35.377199+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:13:35.377199+0000","last_undegraded":"2024-09-21T09:13:35.377199+0000","last_fullsized":"2024-09-21T09:13:35.377199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"91'18","reported_seq":211,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.448478+0000","last_change":"2024-09-21T09:13:19.704634+0000","last_active":"2024-09-21T09:13:45.448478+0000","last_peered":"2024-09-21T09:13:45.448478+0000","last_clean":"2024-09-21T09:13:45.448478+0000","last_became_active":"2024-09-21T09:13:19.159408+0000","last_became_peered":"2024-09-21T09:13:19.159408+0000","last_unstale":"2024-09-21T09:13:45.448478+0000","last_undegraded":"2024-09-21T09:13:45.448478+0000","last_fullsized":"2024-09-21T09:13:45.448478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.792880+0000","last_change":"2024-09-21T09:13:59.793061+0000","last_active":"2024-09-21T09:13:59.792880+0000","last_peered":"2024-09-21T09:13:59.792880+0000","last_clean":"2024-09-21T09:13:59.792880+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:13:59.792880+0000","last_undegraded":"2024-09-21T09:13:59.792880+0000","last_fullsized":"2024-09-21T09:13:59.792880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-09-21T09:13:59.792653+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-09-21T09:13:59.792653+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.792653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:48.291820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'22","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.523135+0000","last_change":"2024-09-21T09:10:56.845828+0000","last_active":"2024-09-21T09:13:45.523135+0000","last_peered":"2024-09-21T09:13:45.523135+0000","last_clean":"2024-09-21T09:13:45.523135+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:13:45.523135+0000","last_undegraded":"2024-09-21T09:13:45.523135+0000","last_fullsized":"2024-09-21T09:13:45.523135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"91'16","reported_seq":203,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.566496+0000","last_change":"2024-09-21T09:13:20.828458+0000","last_active":"2024-09-21T09:13:45.566496+0000","last_peered":"2024-09-21T09:13:45.566496+0000","last_clean":"2024-09-21T09:13:45.566496+0000","last_became_active":"2024-09-21T09:13:19.155182+0000","last_became_peered":"2024-09-21T09:13:19.155182+0000","last_unstale":"2024-09-21T09:13:45.566496+0000","last_undegraded":"2024-09-21T09:13:45.566496+0000","last_fullsized":"2024-09-21T09:13:45.566496+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.450792+0000","last_change":"2024-09-21T09:14:01.450850+0000","last_active":"2024-09-21T09:14:01.450792+0000","last_peered":"2024-09-21T09:14:01.450792+0000","last_clean":"2024-09-21T09:14:01.450792+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:14:01.450792+0000","last_undegraded":"2024-09-21T09:14:01.450792+0000","last_fullsized":"2024-09-21T09:14:01.450792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.450595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.450595+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.450595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:47.258642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"91'20","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.490492+0000","last_change":"2024-09-21T09:10:56.862439+0000","last_active":"2024-09-21T09:13:45.490492+0000","last_peered":"2024-09-21T09:13:45.490492+0000","last_clean":"2024-09-21T09:13:45.490492+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:13:45.490492+0000","last_undegraded":"2024-09-21T09:13:45.490492+0000","last_fullsized":"2024-09-21T09:13:45.490492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"62'4","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:35.527213+0000","last_change":"2024-09-21T09:10:58.828974+0000","last_active":"2024-09-21T09:13:35.527213+0000","last_peered":"2024-09-21T09:13:35.527213+0000","last_clean":"2024-09-21T09:13:35.527213+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:13:35.527213+0000","last_undegraded":"2024-09-21T09:13:35.527213+0000","last_fullsized":"2024-09-21T09:13:35.527213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:57.800396+0000","last_clean_scrub_stamp":"2024-09-21T09:10:57.800396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":233,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":848,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":844,"ondisk_log_size":844,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1023,"num_read_kb":1069,"num_write":533,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":660,"num_keys_recovered":24,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1596,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":874,"ondisk_log_size":874,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":250,"num_read_kb":250,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":545,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":23,"num_write":1216,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":1149239296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509485,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1110016,"data_stored":600664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335416,"statfs":{"total":96636764160,"available":96599465984,"internally_reserved":0,"allocated":1105920,"data_stored":599726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41164,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330676,"statfs":{"total":96636764160,"available":96594612224,"internally_reserved":0,"allocated":1699840,"data_stored":1190185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335420,"statfs":{"total":96636764160,"available":96599470080,"internally_reserved":0,"allocated":1101824,"data_stored":599552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40564,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331276,"statfs":{"total":96636764160,"available":96595226624,"internally_reserved":0,"allocated":1085440,"data_stored":599593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509486,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41188,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330652,"statfs":{"total":96636764160,"available":96594587648,"internally_reserved":0,"allocated":1724416,"data_stored":1190679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509485,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1134592,"data_stored":601322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40592,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331248,"statfs":{"total":96636764160,"available":96595197952,"internally_reserved":0,"allocated":1114112,"data_stored":600299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:14:12.844 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.844 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.844 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.845 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.845 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.845 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.845 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.845 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.846 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.846 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.846 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.846 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.846 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.846 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.847 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.847 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.847 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.847 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.847 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.847 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.847 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.847 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.848 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.848 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.848 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.848 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.848 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.848 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.848 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.848 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.849 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.849 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.849 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.849 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.849 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.849 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.849 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.849 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.850 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.850 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.850 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.850 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.850 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.850 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.850 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.850 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.850 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.851 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.851 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.851 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.851 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.851 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.851 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.851 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.852 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.852 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.852 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.852 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.852 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.852 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.852 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.853 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.853 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.853 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.853 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.853 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.853 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.854 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.854 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.854 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T09:10:47.739014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.854 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.854 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.854 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.854 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.854 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.855 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.855 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.855 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.855 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.855 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.855 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.855 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.855 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.855 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.856 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.856 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.856 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.856 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.856 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.856 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.856 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.856 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.857 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.857 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.857 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-21T09:10:59.807443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.857 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.857 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.857 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.857 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-21T09:11:03.832426+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.857 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.858 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.858 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.858 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.858 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.858 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.858 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.858 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.859 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.859 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.859 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.859 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.859 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.859 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.859 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.859 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.860 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.860 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.860 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.860 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.860 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.860 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.860 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.860 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.861 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.861 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.861 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.861 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.861 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-21T09:10:57.800396+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:12.861 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T09:14:32.862 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:14:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:14:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:14:33.268 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-09-21T09:14:33.051200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615632,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":2792,"num_read_kb":2220,"num_write":2385,"num_write_kb":2368156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":1149241676,"num_keys_recovered":26,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3062,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3379,"ondisk_log_size":3379,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309232,"kb_used_data":9840,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754665488,"statfs":{"total":773094113280,"available":772777459712,"internally_reserved":0,"allocated":10076160,"data_stored":5982020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006443"},"pg_stats":[{"pgid":"3.3f","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.061384+0000","last_change":"2024-09-21T09:14:03.061447+0000","last_active":"2024-09-21T09:14:03.061384+0000","last_peered":"2024-09-21T09:14:03.061384+0000","last_clean":"2024-09-21T09:14:03.061384+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:14:03.061384+0000","last_undegraded":"2024-09-21T09:14:03.061384+0000","last_fullsized":"2024-09-21T09:14:03.061384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:03.061173+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:03.061173+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.061173+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:11.592534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"58'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.847654+0000","last_change":"2024-09-21T09:14:03.847717+0000","last_active":"2024-09-21T09:14:03.847654+0000","last_peered":"2024-09-21T09:14:03.847654+0000","last_clean":"2024-09-21T09:14:03.847654+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:14:03.847654+0000","last_undegraded":"2024-09-21T09:14:03.847654+0000","last_fullsized":"2024-09-21T09:14:03.847654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:03.847431+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:03.847431+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.847431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:12.378793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"91'26","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:21.086497+0000","last_change":"2024-09-21T09:14:21.086645+0000","last_active":"2024-09-21T09:14:21.086497+0000","last_peered":"2024-09-21T09:14:21.086497+0000","last_clean":"2024-09-21T09:14:21.086497+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:14:21.086497+0000","last_undegraded":"2024-09-21T09:14:21.086497+0000","last_fullsized":"2024-09-21T09:14:21.086497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:21.086242+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:21.086242+0000","last_clean_scrub_stamp":"2024-09-21T09:14:21.086242+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:28.544266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"58'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.394742+0000","last_change":"2024-09-21T09:14:14.394805+0000","last_active":"2024-09-21T09:14:14.394742+0000","last_peered":"2024-09-21T09:14:14.394742+0000","last_clean":"2024-09-21T09:14:14.394742+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:14:14.394742+0000","last_undegraded":"2024-09-21T09:14:14.394742+0000","last_fullsized":"2024-09-21T09:14:14.394742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:14.394501+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:14.394501+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.394501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:26.771945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"91'26","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.035293+0000","last_change":"2024-09-21T09:14:17.035357+0000","last_active":"2024-09-21T09:14:17.035293+0000","last_peered":"2024-09-21T09:14:17.035293+0000","last_clean":"2024-09-21T09:14:17.035293+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:14:17.035293+0000","last_undegraded":"2024-09-21T09:14:17.035293+0000","last_fullsized":"2024-09-21T09:14:17.035293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:17.035106+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:17.035106+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.035106+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:20.467139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.267569+0000","last_change":"2024-09-21T09:14:05.267629+0000","last_active":"2024-09-21T09:14:05.267569+0000","last_peered":"2024-09-21T09:14:05.267569+0000","last_clean":"2024-09-21T09:14:05.267569+0000","last_became_active":"2024-09-21T09:13:19.153424+0000","last_became_peered":"2024-09-21T09:13:19.153424+0000","last_unstale":"2024-09-21T09:14:05.267569+0000","last_undegraded":"2024-09-21T09:14:05.267569+0000","last_fullsized":"2024-09-21T09:14:05.267569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:05.267355+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:05.267355+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.267355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:37.100982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"91'26","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.731202+0000","last_change":"2024-09-21T09:14:15.731264+0000","last_active":"2024-09-21T09:14:15.731202+0000","last_peered":"2024-09-21T09:14:15.731202+0000","last_clean":"2024-09-21T09:14:15.731202+0000","last_became_active":"2024-09-21T09:13:19.165441+0000","last_became_peered":"2024-09-21T09:13:19.165441+0000","last_unstale":"2024-09-21T09:14:15.731202+0000","last_undegraded":"2024-09-21T09:14:15.731202+0000","last_fullsized":"2024-09-21T09:14:15.731202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:15.731002+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:15.731002+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.731002+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:13.397919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"58'4","reported_seq":180,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:26.475060+0000","last_change":"2024-09-21T09:14:26.475130+0000","last_active":"2024-09-21T09:14:26.475060+0000","last_peered":"2024-09-21T09:14:26.475060+0000","last_clean":"2024-09-21T09:14:26.475060+0000","last_became_active":"2024-09-21T09:13:19.153875+0000","last_became_peered":"2024-09-21T09:13:19.153875+0000","last_unstale":"2024-09-21T09:14:26.475060+0000","last_undegraded":"2024-09-21T09:14:26.475060+0000","last_fullsized":"2024-09-21T09:14:26.475060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'4","last_scrub_stamp":"2024-09-21T09:14:26.474828+0000","last_deep_scrub":"58'4","last_deep_scrub_stamp":"2024-09-21T09:14:26.474828+0000","last_clean_scrub_stamp":"2024-09-21T09:14:26.474828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:01.650953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.138277+0000","last_change":"2024-09-21T09:14:00.138467+0000","last_active":"2024-09-21T09:14:00.138277+0000","last_peered":"2024-09-21T09:14:00.138277+0000","last_clean":"2024-09-21T09:14:00.138277+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:14:00.138277+0000","last_undegraded":"2024-09-21T09:14:00.138277+0000","last_fullsized":"2024-09-21T09:14:00.138277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:00.138047+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:00.138047+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.138047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:33.277620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.152966+0000","last_change":"2024-09-21T09:13:54.153056+0000","last_active":"2024-09-21T09:13:54.152966+0000","last_peered":"2024-09-21T09:13:54.152966+0000","last_clean":"2024-09-21T09:13:54.152966+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:13:54.152966+0000","last_undegraded":"2024-09-21T09:13:54.152966+0000","last_fullsized":"2024-09-21T09:13:54.152966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:13:54.152764+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:13:54.152764+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.152764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:11.947460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"91'12","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.677538+0000","last_change":"2024-09-21T09:13:57.677688+0000","last_active":"2024-09-21T09:13:57.677538+0000","last_peered":"2024-09-21T09:13:57.677538+0000","last_clean":"2024-09-21T09:13:57.677538+0000","last_became_active":"2024-09-21T09:13:19.160915+0000","last_became_peered":"2024-09-21T09:13:19.160915+0000","last_unstale":"2024-09-21T09:13:57.677538+0000","last_undegraded":"2024-09-21T09:13:57.677538+0000","last_fullsized":"2024-09-21T09:13:57.677538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-21T09:13:57.677253+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-21T09:13:57.677253+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.677253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:29.035343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'2","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.096228+0000","last_change":"2024-09-21T09:13:58.096313+0000","last_active":"2024-09-21T09:13:58.096228+0000","last_peered":"2024-09-21T09:13:58.096228+0000","last_clean":"2024-09-21T09:13:58.096228+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:13:58.096228+0000","last_undegraded":"2024-09-21T09:13:58.096228+0000","last_fullsized":"2024-09-21T09:13:58.096228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:58.095982+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:58.095982+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.095982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:22.243263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"91'10","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.974433+0000","last_change":"2024-09-21T09:14:04.974493+0000","last_active":"2024-09-21T09:14:04.974433+0000","last_peered":"2024-09-21T09:14:04.974433+0000","last_clean":"2024-09-21T09:14:04.974433+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:14:04.974433+0000","last_undegraded":"2024-09-21T09:14:04.974433+0000","last_fullsized":"2024-09-21T09:14:04.974433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-21T09:14:04.974240+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-21T09:14:04.974240+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.974240+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:18.116269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"62'4","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.743301+0000","last_change":"2024-09-21T09:14:13.743489+0000","last_active":"2024-09-21T09:14:13.743301+0000","last_peered":"2024-09-21T09:14:13.743301+0000","last_clean":"2024-09-21T09:14:13.743301+0000","last_became_active":"2024-09-21T09:13:19.164775+0000","last_became_peered":"2024-09-21T09:13:19.164775+0000","last_unstale":"2024-09-21T09:14:13.743301+0000","last_undegraded":"2024-09-21T09:14:13.743301+0000","last_fullsized":"2024-09-21T09:14:13.743301+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:13.743066+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:13.743066+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.743066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:51.529587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"91'22","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:20.057163+0000","last_change":"2024-09-21T09:14:20.057227+0000","last_active":"2024-09-21T09:14:20.057163+0000","last_peered":"2024-09-21T09:14:20.057163+0000","last_clean":"2024-09-21T09:14:20.057163+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:14:20.057163+0000","last_undegraded":"2024-09-21T09:14:20.057163+0000","last_fullsized":"2024-09-21T09:14:20.057163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:20.056974+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:20.056974+0000","last_clean_scrub_stamp":"2024-09-21T09:14:20.056974+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:24.843232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"62'4","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.981636+0000","last_change":"2024-09-21T09:14:06.981706+0000","last_active":"2024-09-21T09:14:06.981636+0000","last_peered":"2024-09-21T09:14:06.981636+0000","last_clean":"2024-09-21T09:14:06.981636+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:14:06.981636+0000","last_undegraded":"2024-09-21T09:14:06.981636+0000","last_fullsized":"2024-09-21T09:14:06.981636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:06.981436+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:06.981436+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.981436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:09.653181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"61'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.365294+0000","last_change":"2024-09-21T09:14:13.365384+0000","last_active":"2024-09-21T09:14:13.365294+0000","last_peered":"2024-09-21T09:14:13.365294+0000","last_clean":"2024-09-21T09:14:13.365294+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:14:13.365294+0000","last_undegraded":"2024-09-21T09:14:13.365294+0000","last_fullsized":"2024-09-21T09:14:13.365294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-21T09:14:13.365083+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-21T09:14:13.365083+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.365083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:01:20.956269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.878513+0000","last_change":"2024-09-21T09:14:06.878576+0000","last_active":"2024-09-21T09:14:06.878513+0000","last_peered":"2024-09-21T09:14:06.878513+0000","last_clean":"2024-09-21T09:14:06.878513+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:14:06.878513+0000","last_undegraded":"2024-09-21T09:14:06.878513+0000","last_fullsized":"2024-09-21T09:14:06.878513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:06.878320+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:06.878320+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.878320+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:44.820576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:50.084198+0000","last_change":"2024-09-21T09:13:50.084263+0000","last_active":"2024-09-21T09:13:50.084198+0000","last_peered":"2024-09-21T09:13:50.084198+0000","last_clean":"2024-09-21T09:13:50.084198+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:13:50.084198+0000","last_undegraded":"2024-09-21T09:13:50.084198+0000","last_fullsized":"2024-09-21T09:13:50.084198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:50.083977+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:50.083977+0000","last_clean_scrub_stamp":"2024-09-21T09:13:50.083977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:57.588236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"91'14","reported_seq":207,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.978319+0000","last_change":"2024-09-21T09:14:15.978466+0000","last_active":"2024-09-21T09:14:15.978319+0000","last_peered":"2024-09-21T09:14:15.978319+0000","last_clean":"2024-09-21T09:14:15.978319+0000","last_became_active":"2024-09-21T09:13:19.154413+0000","last_became_peered":"2024-09-21T09:13:19.154413+0000","last_unstale":"2024-09-21T09:14:15.978319+0000","last_undegraded":"2024-09-21T09:14:15.978319+0000","last_fullsized":"2024-09-21T09:14:15.978319+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:15.978087+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:15.978087+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.978087+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:13.503628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'8","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.796959+0000","last_change":"2024-09-21T09:13:57.797029+0000","last_active":"2024-09-21T09:13:57.796959+0000","last_peered":"2024-09-21T09:13:57.796959+0000","last_clean":"2024-09-21T09:13:57.796959+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:13:57.796959+0000","last_undegraded":"2024-09-21T09:13:57.796959+0000","last_fullsized":"2024-09-21T09:13:57.796959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'8","last_scrub_stamp":"2024-09-21T09:13:57.796750+0000","last_deep_scrub":"71'8","last_deep_scrub_stamp":"2024-09-21T09:13:57.796750+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.796750+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:50.919506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"91'18","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.990012+0000","last_change":"2024-09-21T09:14:05.990075+0000","last_active":"2024-09-21T09:14:05.990012+0000","last_peered":"2024-09-21T09:14:05.990012+0000","last_clean":"2024-09-21T09:14:05.990012+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:14:05.990012+0000","last_undegraded":"2024-09-21T09:14:05.990012+0000","last_fullsized":"2024-09-21T09:14:05.990012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:05.989826+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:05.989826+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.989826+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:43.932082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.744391+0000","last_change":"2024-09-21T09:14:01.744445+0000","last_active":"2024-09-21T09:14:01.744391+0000","last_peered":"2024-09-21T09:14:01.744391+0000","last_clean":"2024-09-21T09:14:01.744391+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:14:01.744391+0000","last_undegraded":"2024-09-21T09:14:01.744391+0000","last_fullsized":"2024-09-21T09:14:01.744391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.744166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.744166+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.744166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:14.274322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'20","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.046344+0000","last_change":"2024-09-21T09:14:02.046475+0000","last_active":"2024-09-21T09:14:02.046344+0000","last_peered":"2024-09-21T09:14:02.046344+0000","last_clean":"2024-09-21T09:14:02.046344+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:14:02.046344+0000","last_undegraded":"2024-09-21T09:14:02.046344+0000","last_fullsized":"2024-09-21T09:14:02.046344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:14:02.046101+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:14:02.046101+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.046101+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:33.404191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'8","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.974708+0000","last_change":"2024-09-21T09:13:58.974768+0000","last_active":"2024-09-21T09:13:58.974708+0000","last_peered":"2024-09-21T09:13:58.974708+0000","last_clean":"2024-09-21T09:13:58.974708+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:13:58.974708+0000","last_undegraded":"2024-09-21T09:13:58.974708+0000","last_fullsized":"2024-09-21T09:13:58.974708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-09-21T09:13:58.974520+0000","last_deep_scrub":"62'8","last_deep_scrub_stamp":"2024-09-21T09:13:58.974520+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.974520+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.120923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.800436+0000","last_change":"2024-09-21T09:14:06.800570+0000","last_active":"2024-09-21T09:14:06.800436+0000","last_peered":"2024-09-21T09:14:06.800436+0000","last_clean":"2024-09-21T09:14:06.800436+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:14:06.800436+0000","last_undegraded":"2024-09-21T09:14:06.800436+0000","last_fullsized":"2024-09-21T09:14:06.800436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:06.800170+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:06.800170+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.800170+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:10.673261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"62'4","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.909849+0000","last_change":"2024-09-21T09:14:11.909989+0000","last_active":"2024-09-21T09:14:11.909849+0000","last_peered":"2024-09-21T09:14:11.909849+0000","last_clean":"2024-09-21T09:14:11.909849+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:14:11.909849+0000","last_undegraded":"2024-09-21T09:14:11.909849+0000","last_fullsized":"2024-09-21T09:14:11.909849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:11.909588+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:11.909588+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.909588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:19.032107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"91'14","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.833412+0000","last_change":"2024-09-21T09:14:08.833503+0000","last_active":"2024-09-21T09:14:08.833412+0000","last_peered":"2024-09-21T09:14:08.833412+0000","last_clean":"2024-09-21T09:14:08.833412+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:14:08.833412+0000","last_undegraded":"2024-09-21T09:14:08.833412+0000","last_fullsized":"2024-09-21T09:14:08.833412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:08.833170+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:08.833170+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.833170+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:12.948905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.967482+0000","last_change":"2024-09-21T09:14:11.967544+0000","last_active":"2024-09-21T09:14:11.967482+0000","last_peered":"2024-09-21T09:14:11.967482+0000","last_clean":"2024-09-21T09:14:11.967482+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:14:11.967482+0000","last_undegraded":"2024-09-21T09:14:11.967482+0000","last_fullsized":"2024-09-21T09:14:11.967482+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:11.967286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:11.967286+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.967286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:14.639031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'4","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.614063+0000","last_change":"2024-09-21T09:13:55.614128+0000","last_active":"2024-09-21T09:13:55.614063+0000","last_peered":"2024-09-21T09:13:55.614063+0000","last_clean":"2024-09-21T09:13:55.614063+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:13:55.614063+0000","last_undegraded":"2024-09-21T09:13:55.614063+0000","last_fullsized":"2024-09-21T09:13:55.614063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:13:55.613858+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:13:55.613858+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.613858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:08:14.580524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"91'8","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:18.304045+0000","last_change":"2024-09-21T09:14:18.304104+0000","last_active":"2024-09-21T09:14:18.304045+0000","last_peered":"2024-09-21T09:14:18.304045+0000","last_clean":"2024-09-21T09:14:18.304045+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:14:18.304045+0000","last_undegraded":"2024-09-21T09:14:18.304045+0000","last_fullsized":"2024-09-21T09:14:18.304045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-09-21T09:14:18.303842+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-09-21T09:14:18.303842+0000","last_clean_scrub_stamp":"2024-09-21T09:14:18.303842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:45.573508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.318705+0000","last_change":"2024-09-21T09:14:17.318817+0000","last_active":"2024-09-21T09:14:17.318705+0000","last_peered":"2024-09-21T09:14:17.318705+0000","last_clean":"2024-09-21T09:14:17.318705+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:14:17.318705+0000","last_undegraded":"2024-09-21T09:14:17.318705+0000","last_fullsized":"2024-09-21T09:14:17.318705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:17.318395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:17.318395+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.318395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:19.551614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"91'21","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.583587+0000","last_change":"2024-09-21T09:14:08.583773+0000","last_active":"2024-09-21T09:14:08.583587+0000","last_peered":"2024-09-21T09:14:08.583587+0000","last_clean":"2024-09-21T09:14:08.583587+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:14:08.583587+0000","last_undegraded":"2024-09-21T09:14:08.583587+0000","last_fullsized":"2024-09-21T09:14:08.583587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'21","last_scrub_stamp":"2024-09-21T09:14:08.583349+0000","last_deep_scrub":"91'21","last_deep_scrub_stamp":"2024-09-21T09:14:08.583349+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.583349+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:15.068598+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.905332+0000","last_change":"2024-09-21T09:14:15.905470+0000","last_active":"2024-09-21T09:14:15.905332+0000","last_peered":"2024-09-21T09:14:15.905332+0000","last_clean":"2024-09-21T09:14:15.905332+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:14:15.905332+0000","last_undegraded":"2024-09-21T09:14:15.905332+0000","last_fullsized":"2024-09-21T09:14:15.905332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:15.905105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:15.905105+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.905105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:01.182452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"58'2","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:18.827285+0000","last_change":"2024-09-21T09:14:18.827352+0000","last_active":"2024-09-21T09:14:18.827285+0000","last_peered":"2024-09-21T09:14:18.827285+0000","last_clean":"2024-09-21T09:14:18.827285+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:14:18.827285+0000","last_undegraded":"2024-09-21T09:14:18.827285+0000","last_fullsized":"2024-09-21T09:14:18.827285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:18.827081+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:18.827081+0000","last_clean_scrub_stamp":"2024-09-21T09:14:18.827081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:49.751039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"61'6","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.282780+0000","last_change":"2024-09-21T09:14:11.282841+0000","last_active":"2024-09-21T09:14:11.282780+0000","last_peered":"2024-09-21T09:14:11.282780+0000","last_clean":"2024-09-21T09:14:11.282780+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:14:11.282780+0000","last_undegraded":"2024-09-21T09:14:11.282780+0000","last_fullsized":"2024-09-21T09:14:11.282780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'6","last_scrub_stamp":"2024-09-21T09:14:11.282569+0000","last_deep_scrub":"61'6","last_deep_scrub_stamp":"2024-09-21T09:14:11.282569+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.282569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:17.696437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"91'18","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.759573+0000","last_change":"2024-09-21T09:14:04.759638+0000","last_active":"2024-09-21T09:14:04.759573+0000","last_peered":"2024-09-21T09:14:04.759573+0000","last_clean":"2024-09-21T09:14:04.759573+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:14:04.759573+0000","last_undegraded":"2024-09-21T09:14:04.759573+0000","last_fullsized":"2024-09-21T09:14:04.759573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:04.759348+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:04.759348+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.759348+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.905751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:23.492672+0000","last_change":"2024-09-21T09:14:23.492729+0000","last_active":"2024-09-21T09:14:23.492672+0000","last_peered":"2024-09-21T09:14:23.492672+0000","last_clean":"2024-09-21T09:14:23.492672+0000","last_became_active":"2024-09-21T09:13:19.153940+0000","last_became_peered":"2024-09-21T09:13:19.153940+0000","last_unstale":"2024-09-21T09:14:23.492672+0000","last_undegraded":"2024-09-21T09:14:23.492672+0000","last_fullsized":"2024-09-21T09:14:23.492672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:23.492448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:23.492448+0000","last_clean_scrub_stamp":"2024-09-21T09:14:23.492448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:23.469154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"91'9","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.843790+0000","last_change":"2024-09-21T09:13:58.843868+0000","last_active":"2024-09-21T09:13:58.843790+0000","last_peered":"2024-09-21T09:13:58.843790+0000","last_clean":"2024-09-21T09:13:58.843790+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:13:58.843790+0000","last_undegraded":"2024-09-21T09:13:58.843790+0000","last_fullsized":"2024-09-21T09:13:58.843790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2024-09-21T09:13:58.843552+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2024-09-21T09:13:58.843552+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.843552+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:22.990833+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.917586+0000","last_change":"2024-09-21T09:14:12.917647+0000","last_active":"2024-09-21T09:14:12.917586+0000","last_peered":"2024-09-21T09:14:12.917586+0000","last_clean":"2024-09-21T09:14:12.917586+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:14:12.917586+0000","last_undegraded":"2024-09-21T09:14:12.917586+0000","last_fullsized":"2024-09-21T09:14:12.917586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:12.917360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:12.917360+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.917360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:15.589106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.963626+0000","last_change":"2024-09-21T09:14:15.963681+0000","last_active":"2024-09-21T09:14:15.963626+0000","last_peered":"2024-09-21T09:14:15.963626+0000","last_clean":"2024-09-21T09:14:15.963626+0000","last_became_active":"2024-09-21T09:13:19.144143+0000","last_became_peered":"2024-09-21T09:13:19.144143+0000","last_unstale":"2024-09-21T09:14:15.963626+0000","last_undegraded":"2024-09-21T09:14:15.963626+0000","last_fullsized":"2024-09-21T09:14:15.963626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:15.963428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:15.963428+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.963428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:53.743232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"71'10","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.956231+0000","last_change":"2024-09-21T09:13:57.956292+0000","last_active":"2024-09-21T09:13:57.956231+0000","last_peered":"2024-09-21T09:13:57.956231+0000","last_clean":"2024-09-21T09:13:57.956231+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:13:57.956231+0000","last_undegraded":"2024-09-21T09:13:57.956231+0000","last_fullsized":"2024-09-21T09:13:57.956231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:13:57.956033+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:13:57.956033+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.956033+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:06.487395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'8","reported_seq":179,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.584320+0000","last_change":"2024-09-21T09:13:21.119832+0000","last_active":"2024-09-21T09:13:45.584320+0000","last_peered":"2024-09-21T09:13:45.584320+0000","last_clean":"2024-09-21T09:13:45.584320+0000","last_became_active":"2024-09-21T09:13:19.159398+0000","last_became_peered":"2024-09-21T09:13:19.159398+0000","last_unstale":"2024-09-21T09:13:45.584320+0000","last_undegraded":"2024-09-21T09:13:45.584320+0000","last_fullsized":"2024-09-21T09:13:45.584320+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.400845+0000","last_change":"2024-09-21T09:13:56.400898+0000","last_active":"2024-09-21T09:13:56.400845+0000","last_peered":"2024-09-21T09:13:56.400845+0000","last_clean":"2024-09-21T09:13:56.400845+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:13:56.400845+0000","last_undegraded":"2024-09-21T09:13:56.400845+0000","last_fullsized":"2024-09-21T09:13:56.400845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.400601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.400601+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.400601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:48.207738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"91'15","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.552383+0000","last_change":"2024-09-21T09:14:04.552575+0000","last_active":"2024-09-21T09:14:04.552383+0000","last_peered":"2024-09-21T09:14:04.552383+0000","last_clean":"2024-09-21T09:14:04.552383+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:14:04.552383+0000","last_undegraded":"2024-09-21T09:14:04.552383+0000","last_fullsized":"2024-09-21T09:14:04.552383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'15","last_scrub_stamp":"2024-09-21T09:14:04.552134+0000","last_deep_scrub":"91'15","last_deep_scrub_stamp":"2024-09-21T09:14:04.552134+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.552134+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:24.444742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"91'105","reported_seq":341,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.150427+0000","last_change":"2024-09-21T09:13:55.150488+0000","last_active":"2024-09-21T09:13:55.150427+0000","last_peered":"2024-09-21T09:13:55.150427+0000","last_clean":"2024-09-21T09:13:55.150427+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:13:55.150427+0000","last_undegraded":"2024-09-21T09:13:55.150427+0000","last_fullsized":"2024-09-21T09:13:55.150427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:13:55.150231+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:13:55.150231+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.150231+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:26.074188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.671622+0000","last_change":"2024-09-21T09:14:00.671677+0000","last_active":"2024-09-21T09:14:00.671622+0000","last_peered":"2024-09-21T09:14:00.671622+0000","last_clean":"2024-09-21T09:14:00.671622+0000","last_became_active":"2024-09-21T09:13:19.161659+0000","last_became_peered":"2024-09-21T09:13:19.161659+0000","last_unstale":"2024-09-21T09:14:00.671622+0000","last_undegraded":"2024-09-21T09:14:00.671622+0000","last_fullsized":"2024-09-21T09:14:00.671622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.671424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.671424+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.671424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:13.813452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"71'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.962824+0000","last_change":"2024-09-21T09:14:04.962963+0000","last_active":"2024-09-21T09:14:04.962824+0000","last_peered":"2024-09-21T09:14:04.962824+0000","last_clean":"2024-09-21T09:14:04.962824+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:14:04.962824+0000","last_undegraded":"2024-09-21T09:14:04.962824+0000","last_fullsized":"2024-09-21T09:14:04.962824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:14:04.962501+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:14:04.962501+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.962501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:11.241875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"91'34","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.867545+0000","last_change":"2024-09-21T09:14:07.867607+0000","last_active":"2024-09-21T09:14:07.867545+0000","last_peered":"2024-09-21T09:14:07.867545+0000","last_clean":"2024-09-21T09:14:07.867545+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:14:07.867545+0000","last_undegraded":"2024-09-21T09:14:07.867545+0000","last_fullsized":"2024-09-21T09:14:07.867545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'34","last_scrub_stamp":"2024-09-21T09:14:07.867323+0000","last_deep_scrub":"91'34","last_deep_scrub_stamp":"2024-09-21T09:14:07.867323+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.867323+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:11.740413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:31.052668+0000","last_change":"2024-09-21T09:14:31.052767+0000","last_active":"2024-09-21T09:14:31.052668+0000","last_peered":"2024-09-21T09:14:31.052668+0000","last_clean":"2024-09-21T09:14:31.052668+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:14:31.052668+0000","last_undegraded":"2024-09-21T09:14:31.052668+0000","last_fullsized":"2024-09-21T09:14:31.052668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:31.052425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:31.052425+0000","last_clean_scrub_stamp":"2024-09-21T09:14:31.052425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:39.514734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"91'21","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.718293+0000","last_change":"2024-09-21T09:13:55.718374+0000","last_active":"2024-09-21T09:13:55.718293+0000","last_peered":"2024-09-21T09:13:55.718293+0000","last_clean":"2024-09-21T09:13:55.718293+0000","last_became_active":"2024-09-21T09:13:19.160798+0000","last_became_peered":"2024-09-21T09:13:19.160798+0000","last_unstale":"2024-09-21T09:13:55.718293+0000","last_undegraded":"2024-09-21T09:13:55.718293+0000","last_fullsized":"2024-09-21T09:13:55.718293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'21","last_scrub_stamp":"2024-09-21T09:13:55.718093+0000","last_deep_scrub":"91'21","last_deep_scrub_stamp":"2024-09-21T09:13:55.718093+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.718093+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:28.857666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"91'105","reported_seq":315,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.953756+0000","last_change":"2024-09-21T09:13:54.953820+0000","last_active":"2024-09-21T09:13:54.953756+0000","last_peered":"2024-09-21T09:13:54.953756+0000","last_clean":"2024-09-21T09:13:54.953756+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:13:54.953756+0000","last_undegraded":"2024-09-21T09:13:54.953756+0000","last_fullsized":"2024-09-21T09:13:54.953756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:13:54.953528+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:13:54.953528+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.953528+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:28.093101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"62'4","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.275759+0000","last_change":"2024-09-21T09:14:09.275824+0000","last_active":"2024-09-21T09:14:09.275759+0000","last_peered":"2024-09-21T09:14:09.275759+0000","last_clean":"2024-09-21T09:14:09.275759+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:14:09.275759+0000","last_undegraded":"2024-09-21T09:14:09.275759+0000","last_fullsized":"2024-09-21T09:14:09.275759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:09.275554+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:09.275554+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.275554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:47.604035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.015880+0000","last_change":"2024-09-21T09:14:04.015943+0000","last_active":"2024-09-21T09:14:04.015880+0000","last_peered":"2024-09-21T09:14:04.015880+0000","last_clean":"2024-09-21T09:14:04.015880+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:14:04.015880+0000","last_undegraded":"2024-09-21T09:14:04.015880+0000","last_fullsized":"2024-09-21T09:14:04.015880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:04.015654+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:04.015654+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.015654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.162056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.740425+0000","last_change":"2024-09-21T09:13:52.740536+0000","last_active":"2024-09-21T09:13:52.740425+0000","last_peered":"2024-09-21T09:13:52.740425+0000","last_clean":"2024-09-21T09:13:52.740425+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:13:52.740425+0000","last_undegraded":"2024-09-21T09:13:52.740425+0000","last_fullsized":"2024-09-21T09:13:52.740425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:52.740196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:52.740196+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.740196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:57.336774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"91'38","reported_seq":193,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.149459+0000","last_change":"2024-09-21T09:13:59.149554+0000","last_active":"2024-09-21T09:13:59.149459+0000","last_peered":"2024-09-21T09:13:59.149459+0000","last_clean":"2024-09-21T09:13:59.149459+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:13:59.149459+0000","last_undegraded":"2024-09-21T09:13:59.149459+0000","last_fullsized":"2024-09-21T09:13:59.149459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'38","last_scrub_stamp":"2024-09-21T09:13:59.149230+0000","last_deep_scrub":"91'38","last_deep_scrub_stamp":"2024-09-21T09:13:59.149230+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.149230+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:47.648398+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":48,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.924843+0000","last_change":"2024-09-21T09:14:16.924900+0000","last_active":"2024-09-21T09:14:16.924843+0000","last_peered":"2024-09-21T09:14:16.924843+0000","last_clean":"2024-09-21T09:14:16.924843+0000","last_became_active":"2024-09-21T09:13:19.149936+0000","last_became_peered":"2024-09-21T09:13:19.149936+0000","last_unstale":"2024-09-21T09:14:16.924843+0000","last_undegraded":"2024-09-21T09:14:16.924843+0000","last_fullsized":"2024-09-21T09:14:16.924843+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:16.924620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:16.924620+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.924620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:27.373314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"62'12","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.762480+0000","last_change":"2024-09-21T09:14:14.762546+0000","last_active":"2024-09-21T09:14:14.762480+0000","last_peered":"2024-09-21T09:14:14.762480+0000","last_clean":"2024-09-21T09:14:14.762480+0000","last_became_active":"2024-09-21T09:13:19.165108+0000","last_became_peered":"2024-09-21T09:13:19.165108+0000","last_unstale":"2024-09-21T09:14:14.762480+0000","last_undegraded":"2024-09-21T09:14:14.762480+0000","last_fullsized":"2024-09-21T09:14:14.762480+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-09-21T09:14:14.762277+0000","last_deep_scrub":"62'12","last_deep_scrub_stamp":"2024-09-21T09:14:14.762277+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.762277+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:00.547243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.798739+0000","last_change":"2024-09-21T09:14:01.798806+0000","last_active":"2024-09-21T09:14:01.798739+0000","last_peered":"2024-09-21T09:14:01.798739+0000","last_clean":"2024-09-21T09:14:01.798739+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:14:01.798739+0000","last_undegraded":"2024-09-21T09:14:01.798739+0000","last_fullsized":"2024-09-21T09:14:01.798739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:01.798538+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:01.798538+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.798538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:18.314665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'14","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.765462+0000","last_change":"2024-09-21T09:14:12.765484+0000","last_active":"2024-09-21T09:14:12.765462+0000","last_peered":"2024-09-21T09:14:12.765462+0000","last_clean":"2024-09-21T09:14:12.765462+0000","last_became_active":"2024-09-21T09:13:19.162605+0000","last_became_peered":"2024-09-21T09:13:19.162605+0000","last_unstale":"2024-09-21T09:14:12.765462+0000","last_undegraded":"2024-09-21T09:14:12.765462+0000","last_fullsized":"2024-09-21T09:14:12.765462+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:12.765392+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:12.765392+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.765392+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.542967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.649750+0000","last_change":"2024-09-21T09:13:54.649802+0000","last_active":"2024-09-21T09:13:54.649750+0000","last_peered":"2024-09-21T09:13:54.649750+0000","last_clean":"2024-09-21T09:13:54.649750+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:13:54.649750+0000","last_undegraded":"2024-09-21T09:13:54.649750+0000","last_fullsized":"2024-09-21T09:13:54.649750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:54.649547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:54.649547+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.649547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:30.932694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.596444+0000","last_change":"2024-09-21T09:14:06.596521+0000","last_active":"2024-09-21T09:14:06.596444+0000","last_peered":"2024-09-21T09:14:06.596444+0000","last_clean":"2024-09-21T09:14:06.596444+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:14:06.596444+0000","last_undegraded":"2024-09-21T09:14:06.596444+0000","last_fullsized":"2024-09-21T09:14:06.596444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:06.596240+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:06.596240+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.596240+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:33.779255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:20.448948+0000","last_change":"2024-09-21T09:14:20.449003+0000","last_active":"2024-09-21T09:14:20.448948+0000","last_peered":"2024-09-21T09:14:20.448948+0000","last_clean":"2024-09-21T09:14:20.448948+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:14:20.448948+0000","last_undegraded":"2024-09-21T09:14:20.448948+0000","last_fullsized":"2024-09-21T09:14:20.448948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:20.448754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:20.448754+0000","last_clean_scrub_stamp":"2024-09-21T09:14:20.448754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:15.811436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"58'2","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:19.831736+0000","last_change":"2024-09-21T09:14:19.831850+0000","last_active":"2024-09-21T09:14:19.831736+0000","last_peered":"2024-09-21T09:14:19.831736+0000","last_clean":"2024-09-21T09:14:19.831736+0000","last_became_active":"2024-09-21T09:13:19.167145+0000","last_became_peered":"2024-09-21T09:13:19.167145+0000","last_unstale":"2024-09-21T09:14:19.831736+0000","last_undegraded":"2024-09-21T09:14:19.831736+0000","last_fullsized":"2024-09-21T09:14:19.831736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:19.831405+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:19.831405+0000","last_clean_scrub_stamp":"2024-09-21T09:14:19.831405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.759954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'8","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:49.706810+0000","last_change":"2024-09-21T09:13:49.706837+0000","last_active":"2024-09-21T09:13:49.706810+0000","last_peered":"2024-09-21T09:13:49.706810+0000","last_clean":"2024-09-21T09:13:49.706810+0000","last_became_active":"2024-09-21T09:13:19.158113+0000","last_became_peered":"2024-09-21T09:13:19.158113+0000","last_unstale":"2024-09-21T09:13:49.706810+0000","last_undegraded":"2024-09-21T09:13:49.706810+0000","last_fullsized":"2024-09-21T09:13:49.706810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'8","last_scrub_stamp":"2024-09-21T09:13:49.706708+0000","last_deep_scrub":"71'8","last_deep_scrub_stamp":"2024-09-21T09:13:49.706708+0000","last_clean_scrub_stamp":"2024-09-21T09:13:49.706708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:07.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'36","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:28.176860+0000","last_change":"2024-09-21T09:14:28.177004+0000","last_active":"2024-09-21T09:14:28.176860+0000","last_peered":"2024-09-21T09:14:28.176860+0000","last_clean":"2024-09-21T09:14:28.176860+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:14:28.176860+0000","last_undegraded":"2024-09-21T09:14:28.176860+0000","last_fullsized":"2024-09-21T09:14:28.176860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'36","last_scrub_stamp":"2024-09-21T09:14:28.176570+0000","last_deep_scrub":"91'36","last_deep_scrub_stamp":"2024-09-21T09:14:28.176570+0000","last_clean_scrub_stamp":"2024-09-21T09:14:28.176570+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:13.625209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.986112+0000","last_change":"2024-09-21T09:14:05.986218+0000","last_active":"2024-09-21T09:14:05.986112+0000","last_peered":"2024-09-21T09:14:05.986112+0000","last_clean":"2024-09-21T09:14:05.986112+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:14:05.986112+0000","last_undegraded":"2024-09-21T09:14:05.986112+0000","last_fullsized":"2024-09-21T09:14:05.986112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:05.985892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:05.985892+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.985892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:13.108411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"91'30","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.260791+0000","last_change":"2024-09-21T09:14:04.260872+0000","last_active":"2024-09-21T09:14:04.260791+0000","last_peered":"2024-09-21T09:14:04.260791+0000","last_clean":"2024-09-21T09:14:04.260791+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:14:04.260791+0000","last_undegraded":"2024-09-21T09:14:04.260791+0000","last_fullsized":"2024-09-21T09:14:04.260791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'30","last_scrub_stamp":"2024-09-21T09:14:04.260605+0000","last_deep_scrub":"91'30","last_deep_scrub_stamp":"2024-09-21T09:14:04.260605+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.260605+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:04.067219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"91'105","reported_seq":270,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.981810+0000","last_change":"2024-09-21T09:13:53.981879+0000","last_active":"2024-09-21T09:13:53.981810+0000","last_peered":"2024-09-21T09:13:53.981810+0000","last_clean":"2024-09-21T09:13:53.981810+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:13:53.981810+0000","last_undegraded":"2024-09-21T09:13:53.981810+0000","last_fullsized":"2024-09-21T09:13:53.981810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:13:53.981621+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:13:53.981621+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.981621+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:42.480788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'4","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:19.964660+0000","last_change":"2024-09-21T09:14:19.964801+0000","last_active":"2024-09-21T09:14:19.964660+0000","last_peered":"2024-09-21T09:14:19.964660+0000","last_clean":"2024-09-21T09:14:19.964660+0000","last_became_active":"2024-09-21T09:13:19.159646+0000","last_became_peered":"2024-09-21T09:13:19.159646+0000","last_unstale":"2024-09-21T09:14:19.964660+0000","last_undegraded":"2024-09-21T09:14:19.964660+0000","last_fullsized":"2024-09-21T09:14:19.964660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:19.964383+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:19.964383+0000","last_clean_scrub_stamp":"2024-09-21T09:14:19.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:38.247326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"71'10","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.980919+0000","last_change":"2024-09-21T09:14:01.980982+0000","last_active":"2024-09-21T09:14:01.980919+0000","last_peered":"2024-09-21T09:14:01.980919+0000","last_clean":"2024-09-21T09:14:01.980919+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:14:01.980919+0000","last_undegraded":"2024-09-21T09:14:01.980919+0000","last_fullsized":"2024-09-21T09:14:01.980919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:14:01.980698+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:14:01.980698+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.980698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:05.853788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'14","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.992416+0000","last_change":"2024-09-21T09:14:06.992477+0000","last_active":"2024-09-21T09:14:06.992416+0000","last_peered":"2024-09-21T09:14:06.992416+0000","last_clean":"2024-09-21T09:14:06.992416+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:14:06.992416+0000","last_undegraded":"2024-09-21T09:14:06.992416+0000","last_fullsized":"2024-09-21T09:14:06.992416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:06.992229+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:06.992229+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.992229+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:10.865320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.658528+0000","last_change":"2024-09-21T09:13:51.658637+0000","last_active":"2024-09-21T09:13:51.658528+0000","last_peered":"2024-09-21T09:13:51.658528+0000","last_clean":"2024-09-21T09:13:51.658528+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:13:51.658528+0000","last_undegraded":"2024-09-21T09:13:51.658528+0000","last_fullsized":"2024-09-21T09:13:51.658528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:51.658295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:51.658295+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.658295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:56.254874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"91'33","reported_seq":192,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.531277+0000","last_change":"2024-09-21T09:14:10.531355+0000","last_active":"2024-09-21T09:14:10.531277+0000","last_peered":"2024-09-21T09:14:10.531277+0000","last_clean":"2024-09-21T09:14:10.531277+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:14:10.531277+0000","last_undegraded":"2024-09-21T09:14:10.531277+0000","last_fullsized":"2024-09-21T09:14:10.531277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33","last_scrub_stamp":"2024-09-21T09:14:10.531062+0000","last_deep_scrub":"91'33","last_deep_scrub_stamp":"2024-09-21T09:14:10.531062+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.531062+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:56.515750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:22.090160+0000","last_change":"2024-09-21T09:14:22.090213+0000","last_active":"2024-09-21T09:14:22.090160+0000","last_peered":"2024-09-21T09:14:22.090160+0000","last_clean":"2024-09-21T09:14:22.090160+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:14:22.090160+0000","last_undegraded":"2024-09-21T09:14:22.090160+0000","last_fullsized":"2024-09-21T09:14:22.090160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:22.089958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:22.089958+0000","last_clean_scrub_stamp":"2024-09-21T09:14:22.089958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:42.723331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.721315+0000","last_change":"2024-09-21T09:14:14.721372+0000","last_active":"2024-09-21T09:14:14.721315+0000","last_peered":"2024-09-21T09:14:14.721315+0000","last_clean":"2024-09-21T09:14:14.721315+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:14:14.721315+0000","last_undegraded":"2024-09-21T09:14:14.721315+0000","last_fullsized":"2024-09-21T09:14:14.721315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:14.721129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:14.721129+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.721129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:47.555947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"62'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:49.085649+0000","last_change":"2024-09-21T09:13:49.085691+0000","last_active":"2024-09-21T09:13:49.085649+0000","last_peered":"2024-09-21T09:13:49.085649+0000","last_clean":"2024-09-21T09:13:49.085649+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:13:49.085649+0000","last_undegraded":"2024-09-21T09:13:49.085649+0000","last_fullsized":"2024-09-21T09:13:49.085649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:13:49.085518+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:13:49.085518+0000","last_clean_scrub_stamp":"2024-09-21T09:13:49.085518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:07.451486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"91'14","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.876281+0000","last_change":"2024-09-21T09:14:04.876339+0000","last_active":"2024-09-21T09:14:04.876281+0000","last_peered":"2024-09-21T09:14:04.876281+0000","last_clean":"2024-09-21T09:14:04.876281+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:14:04.876281+0000","last_undegraded":"2024-09-21T09:14:04.876281+0000","last_fullsized":"2024-09-21T09:14:04.876281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:04.876085+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:04.876085+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.876085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:53.375253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.829115+0000","last_change":"2024-09-21T09:13:55.829174+0000","last_active":"2024-09-21T09:13:55.829115+0000","last_peered":"2024-09-21T09:13:55.829115+0000","last_clean":"2024-09-21T09:13:55.829115+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:13:55.829115+0000","last_undegraded":"2024-09-21T09:13:55.829115+0000","last_fullsized":"2024-09-21T09:13:55.829115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:55.828855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:55.828855+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.828855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:37.393939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"91'24","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.842420+0000","last_change":"2024-09-21T09:13:56.842511+0000","last_active":"2024-09-21T09:13:56.842420+0000","last_peered":"2024-09-21T09:13:56.842420+0000","last_clean":"2024-09-21T09:13:56.842420+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:13:56.842420+0000","last_undegraded":"2024-09-21T09:13:56.842420+0000","last_fullsized":"2024-09-21T09:13:56.842420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:13:56.842206+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:13:56.842206+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.842206+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:50.040639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.853826+0000","last_change":"2024-09-21T09:13:58.853895+0000","last_active":"2024-09-21T09:13:58.853826+0000","last_peered":"2024-09-21T09:13:58.853826+0000","last_clean":"2024-09-21T09:13:58.853826+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:13:58.853826+0000","last_undegraded":"2024-09-21T09:13:58.853826+0000","last_fullsized":"2024-09-21T09:13:58.853826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.853632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.853632+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.853632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:13.065998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"71'4","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.924041+0000","last_change":"2024-09-21T09:13:51.924102+0000","last_active":"2024-09-21T09:13:51.924041+0000","last_peered":"2024-09-21T09:13:51.924041+0000","last_clean":"2024-09-21T09:13:51.924041+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:13:51.924041+0000","last_undegraded":"2024-09-21T09:13:51.924041+0000","last_fullsized":"2024-09-21T09:13:51.924041+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:51.923811+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:51.923811+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.923811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:45.046566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.232745+0000","last_change":"2024-09-21T09:14:10.232876+0000","last_active":"2024-09-21T09:14:10.232745+0000","last_peered":"2024-09-21T09:14:10.232745+0000","last_clean":"2024-09-21T09:14:10.232745+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:14:10.232745+0000","last_undegraded":"2024-09-21T09:14:10.232745+0000","last_fullsized":"2024-09-21T09:14:10.232745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:10.232476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:10.232476+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.232476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:06.843881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"91'12","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:27.146929+0000","last_change":"2024-09-21T09:14:27.146991+0000","last_active":"2024-09-21T09:14:27.146929+0000","last_peered":"2024-09-21T09:14:27.146929+0000","last_clean":"2024-09-21T09:14:27.146929+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:14:27.146929+0000","last_undegraded":"2024-09-21T09:14:27.146929+0000","last_fullsized":"2024-09-21T09:14:27.146929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-21T09:14:27.146736+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-21T09:14:27.146736+0000","last_clean_scrub_stamp":"2024-09-21T09:14:27.146736+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:28.770410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.914644+0000","last_change":"2024-09-21T09:14:03.914695+0000","last_active":"2024-09-21T09:14:03.914644+0000","last_peered":"2024-09-21T09:14:03.914644+0000","last_clean":"2024-09-21T09:14:03.914644+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:14:03.914644+0000","last_undegraded":"2024-09-21T09:14:03.914644+0000","last_fullsized":"2024-09-21T09:14:03.914644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:03.914453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:03.914453+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.914453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:36.749271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"91'33","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.007328+0000","last_change":"2024-09-21T09:14:08.007410+0000","last_active":"2024-09-21T09:14:08.007328+0000","last_peered":"2024-09-21T09:14:08.007328+0000","last_clean":"2024-09-21T09:14:08.007328+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:14:08.007328+0000","last_undegraded":"2024-09-21T09:14:08.007328+0000","last_fullsized":"2024-09-21T09:14:08.007328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33","last_scrub_stamp":"2024-09-21T09:14:08.007133+0000","last_deep_scrub":"91'33","last_deep_scrub_stamp":"2024-09-21T09:14:08.007133+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.007133+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:08.430200+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1216,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"91'105","reported_seq":309,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.790155+0000","last_change":"2024-09-21T09:14:11.790216+0000","last_active":"2024-09-21T09:14:11.790155+0000","last_peered":"2024-09-21T09:14:11.790155+0000","last_clean":"2024-09-21T09:14:11.790155+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:14:11.790155+0000","last_undegraded":"2024-09-21T09:14:11.790155+0000","last_fullsized":"2024-09-21T09:14:11.790155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:14:11.789958+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:14:11.789958+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.789958+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:24.931987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.944387+0000","last_change":"2024-09-21T09:14:14.944531+0000","last_active":"2024-09-21T09:14:14.944387+0000","last_peered":"2024-09-21T09:14:14.944387+0000","last_clean":"2024-09-21T09:14:14.944387+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:14:14.944387+0000","last_undegraded":"2024-09-21T09:14:14.944387+0000","last_fullsized":"2024-09-21T09:14:14.944387+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:14.944137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:14.944137+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.944137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:15.190350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"71'8","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.738791+0000","last_change":"2024-09-21T09:14:11.738849+0000","last_active":"2024-09-21T09:14:11.738791+0000","last_peered":"2024-09-21T09:14:11.738791+0000","last_clean":"2024-09-21T09:14:11.738791+0000","last_became_active":"2024-09-21T09:13:19.161819+0000","last_became_peered":"2024-09-21T09:13:19.161819+0000","last_unstale":"2024-09-21T09:14:11.738791+0000","last_undegraded":"2024-09-21T09:14:11.738791+0000","last_fullsized":"2024-09-21T09:14:11.738791+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'8","last_scrub_stamp":"2024-09-21T09:14:11.738592+0000","last_deep_scrub":"71'8","last_deep_scrub_stamp":"2024-09-21T09:14:11.738592+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.738592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:09.264133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:30.092034+0000","last_change":"2024-09-21T09:14:30.092100+0000","last_active":"2024-09-21T09:14:30.092034+0000","last_peered":"2024-09-21T09:14:30.092034+0000","last_clean":"2024-09-21T09:14:30.092034+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:14:30.092034+0000","last_undegraded":"2024-09-21T09:14:30.092034+0000","last_fullsized":"2024-09-21T09:14:30.092034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:30.091831+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:30.091831+0000","last_clean_scrub_stamp":"2024-09-21T09:14:30.091831+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:27:52.373341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"91'4","reported_seq":283,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:50.715930+0000","last_change":"2024-09-21T09:13:50.716004+0000","last_active":"2024-09-21T09:13:50.715930+0000","last_peered":"2024-09-21T09:13:50.715930+0000","last_clean":"2024-09-21T09:13:50.715930+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:13:50.715930+0000","last_undegraded":"2024-09-21T09:13:50.715930+0000","last_fullsized":"2024-09-21T09:13:50.715930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-21T09:13:50.715772+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-21T09:13:50.715772+0000","last_clean_scrub_stamp":"2024-09-21T09:13:50.715772+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:58.220031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"91'17","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.782084+0000","last_change":"2024-09-21T09:14:00.782236+0000","last_active":"2024-09-21T09:14:00.782084+0000","last_peered":"2024-09-21T09:14:00.782084+0000","last_clean":"2024-09-21T09:14:00.782084+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:14:00.782084+0000","last_undegraded":"2024-09-21T09:14:00.782084+0000","last_fullsized":"2024-09-21T09:14:00.782084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'17","last_scrub_stamp":"2024-09-21T09:14:00.781799+0000","last_deep_scrub":"91'17","last_deep_scrub_stamp":"2024-09-21T09:14:00.781799+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.781799+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:48.074789+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1596,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"91'105","reported_seq":323,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.837424+0000","last_change":"2024-09-21T09:14:02.837562+0000","last_active":"2024-09-21T09:14:02.837424+0000","last_peered":"2024-09-21T09:14:02.837424+0000","last_clean":"2024-09-21T09:14:02.837424+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:14:02.837424+0000","last_undegraded":"2024-09-21T09:14:02.837424+0000","last_fullsized":"2024-09-21T09:14:02.837424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:14:02.837178+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:14:02.837178+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.837178+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:34.195267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'2","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.808407+0000","last_change":"2024-09-21T09:14:06.808465+0000","last_active":"2024-09-21T09:14:06.808407+0000","last_peered":"2024-09-21T09:14:06.808407+0000","last_clean":"2024-09-21T09:14:06.808407+0000","last_became_active":"2024-09-21T09:13:19.139533+0000","last_became_peered":"2024-09-21T09:13:19.139533+0000","last_unstale":"2024-09-21T09:14:06.808407+0000","last_undegraded":"2024-09-21T09:14:06.808407+0000","last_fullsized":"2024-09-21T09:14:06.808407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:06.808207+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:06.808207+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.808207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:13.930727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.824089+0000","last_change":"2024-09-21T09:14:01.824155+0000","last_active":"2024-09-21T09:14:01.824089+0000","last_peered":"2024-09-21T09:14:01.824089+0000","last_clean":"2024-09-21T09:14:01.824089+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:14:01.824089+0000","last_undegraded":"2024-09-21T09:14:01.824089+0000","last_fullsized":"2024-09-21T09:14:01.824089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:01.823894+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:01.823894+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.823894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:08:20.790560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"91'4","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.472101+0000","last_change":"2024-09-21T09:14:14.472170+0000","last_active":"2024-09-21T09:14:14.472101+0000","last_peered":"2024-09-21T09:14:14.472101+0000","last_clean":"2024-09-21T09:14:14.472101+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:14:14.472101+0000","last_undegraded":"2024-09-21T09:14:14.472101+0000","last_fullsized":"2024-09-21T09:14:14.472101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-21T09:14:14.471884+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-21T09:14:14.471884+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.471884+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:07.377522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.389587+0000","last_change":"2024-09-21T09:14:15.389642+0000","last_active":"2024-09-21T09:14:15.389587+0000","last_peered":"2024-09-21T09:14:15.389587+0000","last_clean":"2024-09-21T09:14:15.389587+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:14:15.389587+0000","last_undegraded":"2024-09-21T09:14:15.389587+0000","last_fullsized":"2024-09-21T09:14:15.389587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:15.389388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:15.389388+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.389388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:49.673039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"91'33","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.758757+0000","last_change":"2024-09-21T09:14:00.758928+0000","last_active":"2024-09-21T09:14:00.758757+0000","last_peered":"2024-09-21T09:14:00.758757+0000","last_clean":"2024-09-21T09:14:00.758757+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:14:00.758757+0000","last_undegraded":"2024-09-21T09:14:00.758757+0000","last_fullsized":"2024-09-21T09:14:00.758757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33","last_scrub_stamp":"2024-09-21T09:14:00.758562+0000","last_deep_scrub":"91'33","last_deep_scrub_stamp":"2024-09-21T09:14:00.758562+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.758562+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:33.898135+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.678959+0000","last_change":"2024-09-21T09:13:58.679013+0000","last_active":"2024-09-21T09:13:58.678959+0000","last_peered":"2024-09-21T09:13:58.678959+0000","last_clean":"2024-09-21T09:13:58.678959+0000","last_became_active":"2024-09-21T09:13:19.164969+0000","last_became_peered":"2024-09-21T09:13:19.164969+0000","last_unstale":"2024-09-21T09:13:58.678959+0000","last_undegraded":"2024-09-21T09:13:58.678959+0000","last_fullsized":"2024-09-21T09:13:58.678959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.678760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.678760+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.678760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:07.210122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"62'12","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.721905+0000","last_change":"2024-09-21T09:14:13.721971+0000","last_active":"2024-09-21T09:14:13.721905+0000","last_peered":"2024-09-21T09:14:13.721905+0000","last_clean":"2024-09-21T09:14:13.721905+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:14:13.721905+0000","last_undegraded":"2024-09-21T09:14:13.721905+0000","last_fullsized":"2024-09-21T09:14:13.721905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-09-21T09:14:13.721706+0000","last_deep_scrub":"62'12","last_deep_scrub_stamp":"2024-09-21T09:14:13.721706+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.721706+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:52.121147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.294842+0000","last_change":"2024-09-21T09:14:08.294906+0000","last_active":"2024-09-21T09:14:08.294842+0000","last_peered":"2024-09-21T09:14:08.294842+0000","last_clean":"2024-09-21T09:14:08.294842+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:14:08.294842+0000","last_undegraded":"2024-09-21T09:14:08.294842+0000","last_fullsized":"2024-09-21T09:14:08.294842+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:08.294621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:08.294621+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.294621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:48.048960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"91'119","reported_seq":315,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.840778+0000","last_change":"2024-09-21T09:14:04.840858+0000","last_active":"2024-09-21T09:14:04.840778+0000","last_peered":"2024-09-21T09:14:04.840778+0000","last_clean":"2024-09-21T09:14:04.840778+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:14:04.840778+0000","last_undegraded":"2024-09-21T09:14:04.840778+0000","last_fullsized":"2024-09-21T09:14:04.840778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'119","last_scrub_stamp":"2024-09-21T09:14:04.840584+0000","last_deep_scrub":"91'119","last_deep_scrub_stamp":"2024-09-21T09:14:04.840584+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.840584+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.986986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"91'2","reported_seq":182,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:32.094143+0000","last_change":"2024-09-21T09:14:32.094223+0000","last_active":"2024-09-21T09:14:32.094143+0000","last_peered":"2024-09-21T09:14:32.094143+0000","last_clean":"2024-09-21T09:14:32.094143+0000","last_became_active":"2024-09-21T09:13:19.155065+0000","last_became_peered":"2024-09-21T09:13:19.155065+0000","last_unstale":"2024-09-21T09:14:32.094143+0000","last_undegraded":"2024-09-21T09:14:32.094143+0000","last_fullsized":"2024-09-21T09:14:32.094143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-21T09:14:32.093942+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-21T09:14:32.093942+0000","last_clean_scrub_stamp":"2024-09-21T09:14:32.093942+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:09.519524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"91'18","reported_seq":221,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:24.514947+0000","last_change":"2024-09-21T09:14:24.515006+0000","last_active":"2024-09-21T09:14:24.514947+0000","last_peered":"2024-09-21T09:14:24.514947+0000","last_clean":"2024-09-21T09:14:24.514947+0000","last_became_active":"2024-09-21T09:13:19.152677+0000","last_became_peered":"2024-09-21T09:13:19.152677+0000","last_unstale":"2024-09-21T09:14:24.514947+0000","last_undegraded":"2024-09-21T09:14:24.514947+0000","last_fullsized":"2024-09-21T09:14:24.514947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:24.514751+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:24.514751+0000","last_clean_scrub_stamp":"2024-09-21T09:14:24.514751+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:12.813161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.123811+0000","last_change":"2024-09-21T09:13:51.123831+0000","last_active":"2024-09-21T09:13:51.123811+0000","last_peered":"2024-09-21T09:13:51.123811+0000","last_clean":"2024-09-21T09:13:51.123811+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:13:51.123811+0000","last_undegraded":"2024-09-21T09:13:51.123811+0000","last_fullsized":"2024-09-21T09:13:51.123811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:51.123724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:51.123724+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.123724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:13.536863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"91'45","reported_seq":208,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.211089+0000","last_change":"2024-09-21T09:14:03.211164+0000","last_active":"2024-09-21T09:14:03.211089+0000","last_peered":"2024-09-21T09:14:03.211089+0000","last_clean":"2024-09-21T09:14:03.211089+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:14:03.211089+0000","last_undegraded":"2024-09-21T09:14:03.211089+0000","last_fullsized":"2024-09-21T09:14:03.211089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'45","last_scrub_stamp":"2024-09-21T09:14:03.210893+0000","last_deep_scrub":"91'45","last_deep_scrub_stamp":"2024-09-21T09:14:03.210893+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.210893+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:23.844266+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":48,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.917866+0000","last_change":"2024-09-21T09:13:56.917919+0000","last_active":"2024-09-21T09:13:56.917866+0000","last_peered":"2024-09-21T09:13:56.917866+0000","last_clean":"2024-09-21T09:13:56.917866+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:13:56.917866+0000","last_undegraded":"2024-09-21T09:13:56.917866+0000","last_fullsized":"2024-09-21T09:13:56.917866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.917676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.917676+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.917676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:28.275766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"71'6","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.991851+0000","last_change":"2024-09-21T09:14:12.991911+0000","last_active":"2024-09-21T09:14:12.991851+0000","last_peered":"2024-09-21T09:14:12.991851+0000","last_clean":"2024-09-21T09:14:12.991851+0000","last_became_active":"2024-09-21T09:13:19.153438+0000","last_became_peered":"2024-09-21T09:13:19.153438+0000","last_unstale":"2024-09-21T09:14:12.991851+0000","last_undegraded":"2024-09-21T09:14:12.991851+0000","last_fullsized":"2024-09-21T09:14:12.991851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-09-21T09:14:12.991610+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-09-21T09:14:12.991610+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.991610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:13.414677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":422,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.962302+0000","last_change":"2024-09-21T09:13:59.962359+0000","last_active":"2024-09-21T09:13:59.962302+0000","last_peered":"2024-09-21T09:13:59.962302+0000","last_clean":"2024-09-21T09:13:59.962302+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:13:59.962302+0000","last_undegraded":"2024-09-21T09:13:59.962302+0000","last_fullsized":"2024-09-21T09:13:59.962302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:59.962111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:59.962111+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.962111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:13.104139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:24.156681+0000","last_change":"2024-09-21T09:14:24.156840+0000","last_active":"2024-09-21T09:14:24.156681+0000","last_peered":"2024-09-21T09:14:24.156681+0000","last_clean":"2024-09-21T09:14:24.156681+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:14:24.156681+0000","last_undegraded":"2024-09-21T09:14:24.156681+0000","last_fullsized":"2024-09-21T09:14:24.156681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:24.156436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:24.156436+0000","last_clean_scrub_stamp":"2024-09-21T09:14:24.156436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.357283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"91'14","reported_seq":204,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.905006+0000","last_change":"2024-09-21T09:14:17.905065+0000","last_active":"2024-09-21T09:14:17.905006+0000","last_peered":"2024-09-21T09:14:17.905006+0000","last_clean":"2024-09-21T09:14:17.905006+0000","last_became_active":"2024-09-21T09:13:19.142666+0000","last_became_peered":"2024-09-21T09:13:19.142666+0000","last_unstale":"2024-09-21T09:14:17.905006+0000","last_undegraded":"2024-09-21T09:14:17.905006+0000","last_fullsized":"2024-09-21T09:14:17.905006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:17.904813+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:17.904813+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.904813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:48.828770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:19.285999+0000","last_change":"2024-09-21T09:14:19.286056+0000","last_active":"2024-09-21T09:14:19.285999+0000","last_peered":"2024-09-21T09:14:19.285999+0000","last_clean":"2024-09-21T09:14:19.285999+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:14:19.285999+0000","last_undegraded":"2024-09-21T09:14:19.285999+0000","last_fullsized":"2024-09-21T09:14:19.285999+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:19.285802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:19.285802+0000","last_clean_scrub_stamp":"2024-09-21T09:14:19.285802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:05.519428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"91'127","reported_seq":360,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.867422+0000","last_change":"2024-09-21T09:13:56.867596+0000","last_active":"2024-09-21T09:13:56.867422+0000","last_peered":"2024-09-21T09:13:56.867422+0000","last_clean":"2024-09-21T09:13:56.867422+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:13:56.867422+0000","last_undegraded":"2024-09-21T09:13:56.867422+0000","last_fullsized":"2024-09-21T09:13:56.867422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'127","last_scrub_stamp":"2024-09-21T09:13:56.867163+0000","last_deep_scrub":"91'127","last_deep_scrub_stamp":"2024-09-21T09:13:56.867163+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.867163+0000","objects_scrubbed":10,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:19.280301+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":167,"num_read_kb":270,"num_write":36,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.164777+0000","last_change":"2024-09-21T09:13:56.164832+0000","last_active":"2024-09-21T09:13:56.164777+0000","last_peered":"2024-09-21T09:13:56.164777+0000","last_clean":"2024-09-21T09:13:56.164777+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:56.164777+0000","last_undegraded":"2024-09-21T09:13:56.164777+0000","last_fullsized":"2024-09-21T09:13:56.164777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.164543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.164543+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.164543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:47.093093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"58'2","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.956648+0000","last_change":"2024-09-21T09:13:55.956775+0000","last_active":"2024-09-21T09:13:55.956648+0000","last_peered":"2024-09-21T09:13:55.956648+0000","last_clean":"2024-09-21T09:13:55.956648+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:13:55.956648+0000","last_undegraded":"2024-09-21T09:13:55.956648+0000","last_fullsized":"2024-09-21T09:13:55.956648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:55.956369+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:55.956369+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.956369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:12.472496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.731873+0000","last_change":"2024-09-21T09:14:03.731924+0000","last_active":"2024-09-21T09:14:03.731873+0000","last_peered":"2024-09-21T09:14:03.731873+0000","last_clean":"2024-09-21T09:14:03.731873+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:14:03.731873+0000","last_undegraded":"2024-09-21T09:14:03.731873+0000","last_fullsized":"2024-09-21T09:14:03.731873+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:03.731674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:03.731674+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.731674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:16.654827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.811619+0000","last_change":"2024-09-21T09:14:02.811680+0000","last_active":"2024-09-21T09:14:02.811619+0000","last_peered":"2024-09-21T09:14:02.811619+0000","last_clean":"2024-09-21T09:14:02.811619+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:14:02.811619+0000","last_undegraded":"2024-09-21T09:14:02.811619+0000","last_fullsized":"2024-09-21T09:14:02.811619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:02.811374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:02.811374+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.811374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:55.934130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"91'22","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.034133+0000","last_change":"2024-09-21T09:14:11.034193+0000","last_active":"2024-09-21T09:14:11.034133+0000","last_peered":"2024-09-21T09:14:11.034133+0000","last_clean":"2024-09-21T09:14:11.034133+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:14:11.034133+0000","last_undegraded":"2024-09-21T09:14:11.034133+0000","last_fullsized":"2024-09-21T09:14:11.034133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:11.033946+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:11.033946+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.033946+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:08.559486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"91'4","reported_seq":215,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.858779+0000","last_change":"2024-09-21T09:13:57.858847+0000","last_active":"2024-09-21T09:13:57.858779+0000","last_peered":"2024-09-21T09:13:57.858779+0000","last_clean":"2024-09-21T09:13:57.858779+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:13:57.858779+0000","last_undegraded":"2024-09-21T09:13:57.858779+0000","last_fullsized":"2024-09-21T09:13:57.858779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-21T09:13:57.858583+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-21T09:13:57.858583+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.858583+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:02.455161+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"91'24","reported_seq":200,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.994123+0000","last_change":"2024-09-21T09:14:09.994205+0000","last_active":"2024-09-21T09:14:09.994123+0000","last_peered":"2024-09-21T09:14:09.994123+0000","last_clean":"2024-09-21T09:14:09.994123+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:14:09.994123+0000","last_undegraded":"2024-09-21T09:14:09.994123+0000","last_fullsized":"2024-09-21T09:14:09.994123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:09.993923+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:09.993923+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.993923+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:16.273297+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.348585+0000","last_change":"2024-09-21T09:13:52.348703+0000","last_active":"2024-09-21T09:13:52.348585+0000","last_peered":"2024-09-21T09:13:52.348585+0000","last_clean":"2024-09-21T09:13:52.348585+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:13:52.348585+0000","last_undegraded":"2024-09-21T09:13:52.348585+0000","last_fullsized":"2024-09-21T09:13:52.348585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:52.348233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:52.348233+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.348233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:35.531424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.417194+0000","last_change":"2024-09-21T09:13:54.417254+0000","last_active":"2024-09-21T09:13:54.417194+0000","last_peered":"2024-09-21T09:13:54.417194+0000","last_clean":"2024-09-21T09:13:54.417194+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:13:54.417194+0000","last_undegraded":"2024-09-21T09:13:54.417194+0000","last_fullsized":"2024-09-21T09:13:54.417194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:54.417003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:54.417003+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.417003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:37.375359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"58'2","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.740070+0000","last_change":"2024-09-21T09:13:59.740131+0000","last_active":"2024-09-21T09:13:59.740070+0000","last_peered":"2024-09-21T09:13:59.740070+0000","last_clean":"2024-09-21T09:13:59.740070+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:13:59.740070+0000","last_undegraded":"2024-09-21T09:13:59.740070+0000","last_fullsized":"2024-09-21T09:13:59.740070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:59.739869+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:59.739869+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.739869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:10.243493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'3","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:23.205932+0000","last_change":"2024-09-21T09:14:23.206003+0000","last_active":"2024-09-21T09:14:23.205932+0000","last_peered":"2024-09-21T09:14:23.205932+0000","last_clean":"2024-09-21T09:14:23.205932+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:14:23.205932+0000","last_undegraded":"2024-09-21T09:14:23.205932+0000","last_fullsized":"2024-09-21T09:14:23.205932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-21T09:14:23.205746+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-21T09:14:23.205746+0000","last_clean_scrub_stamp":"2024-09-21T09:14:23.205746+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:14.424064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"91'14","reported_seq":207,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.018064+0000","last_change":"2024-09-21T09:14:14.018215+0000","last_active":"2024-09-21T09:14:14.018064+0000","last_peered":"2024-09-21T09:14:14.018064+0000","last_clean":"2024-09-21T09:14:14.018064+0000","last_became_active":"2024-09-21T09:13:19.153710+0000","last_became_peered":"2024-09-21T09:13:19.153710+0000","last_unstale":"2024-09-21T09:14:14.018064+0000","last_undegraded":"2024-09-21T09:14:14.018064+0000","last_fullsized":"2024-09-21T09:14:14.018064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:14.017803+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:14.017803+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.017803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:42.779022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.843226+0000","last_change":"2024-09-21T09:13:53.843283+0000","last_active":"2024-09-21T09:13:53.843226+0000","last_peered":"2024-09-21T09:13:53.843226+0000","last_clean":"2024-09-21T09:13:53.843226+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:13:53.843226+0000","last_undegraded":"2024-09-21T09:13:53.843226+0000","last_fullsized":"2024-09-21T09:13:53.843226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.843025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.843025+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.843025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:37.219600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"91'18","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.004929+0000","last_change":"2024-09-21T09:14:10.005009+0000","last_active":"2024-09-21T09:14:10.004929+0000","last_peered":"2024-09-21T09:14:10.004929+0000","last_clean":"2024-09-21T09:14:10.004929+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:14:10.004929+0000","last_undegraded":"2024-09-21T09:14:10.004929+0000","last_fullsized":"2024-09-21T09:14:10.004929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:10.004733+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:10.004733+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.004733+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:36.172204+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.170518+0000","last_change":"2024-09-21T09:14:00.170569+0000","last_active":"2024-09-21T09:14:00.170518+0000","last_peered":"2024-09-21T09:14:00.170518+0000","last_clean":"2024-09-21T09:14:00.170518+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:14:00.170518+0000","last_undegraded":"2024-09-21T09:14:00.170518+0000","last_fullsized":"2024-09-21T09:14:00.170518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.170286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.170286+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.170286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:57:07.718054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"62'4","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.858693+0000","last_change":"2024-09-21T09:14:16.858759+0000","last_active":"2024-09-21T09:14:16.858693+0000","last_peered":"2024-09-21T09:14:16.858693+0000","last_clean":"2024-09-21T09:14:16.858693+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:14:16.858693+0000","last_undegraded":"2024-09-21T09:14:16.858693+0000","last_fullsized":"2024-09-21T09:14:16.858693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:16.858497+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:16.858497+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.858497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:14.384038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"71'12","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.686630+0000","last_change":"2024-09-21T09:13:57.686695+0000","last_active":"2024-09-21T09:13:57.686630+0000","last_peered":"2024-09-21T09:13:57.686630+0000","last_clean":"2024-09-21T09:13:57.686630+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:13:57.686630+0000","last_undegraded":"2024-09-21T09:13:57.686630+0000","last_fullsized":"2024-09-21T09:13:57.686630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'12","last_scrub_stamp":"2024-09-21T09:13:57.686428+0000","last_deep_scrub":"71'12","last_deep_scrub_stamp":"2024-09-21T09:13:57.686428+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.686428+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:21.833709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"91'20","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.701292+0000","last_change":"2024-09-21T09:13:52.701391+0000","last_active":"2024-09-21T09:13:52.701292+0000","last_peered":"2024-09-21T09:13:52.701292+0000","last_clean":"2024-09-21T09:13:52.701292+0000","last_became_active":"2024-09-21T09:13:19.142534+0000","last_became_peered":"2024-09-21T09:13:19.142534+0000","last_unstale":"2024-09-21T09:13:52.701292+0000","last_undegraded":"2024-09-21T09:13:52.701292+0000","last_fullsized":"2024-09-21T09:13:52.701292+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:13:52.701105+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:13:52.701105+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.701105+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:45.823860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.057742+0000","last_change":"2024-09-21T09:14:14.057867+0000","last_active":"2024-09-21T09:14:14.057742+0000","last_peered":"2024-09-21T09:14:14.057742+0000","last_clean":"2024-09-21T09:14:14.057742+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:14:14.057742+0000","last_undegraded":"2024-09-21T09:14:14.057742+0000","last_fullsized":"2024-09-21T09:14:14.057742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:14.057509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:14.057509+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.057509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:59.842475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.386691+0000","last_change":"2024-09-21T09:13:58.386804+0000","last_active":"2024-09-21T09:13:58.386691+0000","last_peered":"2024-09-21T09:13:58.386691+0000","last_clean":"2024-09-21T09:13:58.386691+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:13:58.386691+0000","last_undegraded":"2024-09-21T09:13:58.386691+0000","last_fullsized":"2024-09-21T09:13:58.386691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.386389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.386389+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.386389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:18.298819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"91'42","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.859358+0000","last_change":"2024-09-21T09:13:52.859456+0000","last_active":"2024-09-21T09:13:52.859358+0000","last_peered":"2024-09-21T09:13:52.859358+0000","last_clean":"2024-09-21T09:13:52.859358+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:13:52.859358+0000","last_undegraded":"2024-09-21T09:13:52.859358+0000","last_fullsized":"2024-09-21T09:13:52.859358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'42","last_scrub_stamp":"2024-09-21T09:13:52.859171+0000","last_deep_scrub":"91'42","last_deep_scrub_stamp":"2024-09-21T09:13:52.859171+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.859171+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:10.155729+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.751230+0000","last_change":"2024-09-21T09:14:04.751361+0000","last_active":"2024-09-21T09:14:04.751230+0000","last_peered":"2024-09-21T09:14:04.751230+0000","last_clean":"2024-09-21T09:14:04.751230+0000","last_became_active":"2024-09-21T09:13:19.145677+0000","last_became_peered":"2024-09-21T09:13:19.145677+0000","last_unstale":"2024-09-21T09:14:04.751230+0000","last_undegraded":"2024-09-21T09:14:04.751230+0000","last_fullsized":"2024-09-21T09:14:04.751230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:04.750975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:04.750975+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.750975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:37.585793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"62'4","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:24.077280+0000","last_change":"2024-09-21T09:14:24.077346+0000","last_active":"2024-09-21T09:14:24.077280+0000","last_peered":"2024-09-21T09:14:24.077280+0000","last_clean":"2024-09-21T09:14:24.077280+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:14:24.077280+0000","last_undegraded":"2024-09-21T09:14:24.077280+0000","last_fullsized":"2024-09-21T09:14:24.077280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:24.077083+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:24.077083+0000","last_clean_scrub_stamp":"2024-09-21T09:14:24.077083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:55.910709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"61'2","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.892349+0000","last_change":"2024-09-21T09:14:10.892480+0000","last_active":"2024-09-21T09:14:10.892349+0000","last_peered":"2024-09-21T09:14:10.892349+0000","last_clean":"2024-09-21T09:14:10.892349+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:14:10.892349+0000","last_undegraded":"2024-09-21T09:14:10.892349+0000","last_fullsized":"2024-09-21T09:14:10.892349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-21T09:14:10.892096+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-21T09:14:10.892096+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.892096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:18.014615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"91'20","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.759091+0000","last_change":"2024-09-21T09:14:05.759150+0000","last_active":"2024-09-21T09:14:05.759091+0000","last_peered":"2024-09-21T09:14:05.759091+0000","last_clean":"2024-09-21T09:14:05.759091+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:14:05.759091+0000","last_undegraded":"2024-09-21T09:14:05.759091+0000","last_fullsized":"2024-09-21T09:14:05.759091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:14:05.758902+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:14:05.758902+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.758902+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:32.501862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:25.171066+0000","last_change":"2024-09-21T09:14:25.171119+0000","last_active":"2024-09-21T09:14:25.171066+0000","last_peered":"2024-09-21T09:14:25.171066+0000","last_clean":"2024-09-21T09:14:25.171066+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:14:25.171066+0000","last_undegraded":"2024-09-21T09:14:25.171066+0000","last_fullsized":"2024-09-21T09:14:25.171066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:25.170867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:25.170867+0000","last_clean_scrub_stamp":"2024-09-21T09:14:25.170867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:31.234300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.172169+0000","last_change":"2024-09-21T09:13:53.172223+0000","last_active":"2024-09-21T09:13:53.172169+0000","last_peered":"2024-09-21T09:13:53.172169+0000","last_clean":"2024-09-21T09:13:53.172169+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:13:53.172169+0000","last_undegraded":"2024-09-21T09:13:53.172169+0000","last_fullsized":"2024-09-21T09:13:53.172169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.171979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.171979+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.171979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:07.384344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"91'21","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.646202+0000","last_change":"2024-09-21T09:13:56.646284+0000","last_active":"2024-09-21T09:13:56.646202+0000","last_peered":"2024-09-21T09:13:56.646202+0000","last_clean":"2024-09-21T09:13:56.646202+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:13:56.646202+0000","last_undegraded":"2024-09-21T09:13:56.646202+0000","last_fullsized":"2024-09-21T09:13:56.646202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'21","last_scrub_stamp":"2024-09-21T09:13:56.646017+0000","last_deep_scrub":"91'21","last_deep_scrub_stamp":"2024-09-21T09:13:56.646017+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.646017+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:30.090553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"91'105","reported_seq":275,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.937050+0000","last_change":"2024-09-21T09:14:14.937120+0000","last_active":"2024-09-21T09:14:14.937050+0000","last_peered":"2024-09-21T09:14:14.937050+0000","last_clean":"2024-09-21T09:14:14.937050+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:14:14.937050+0000","last_undegraded":"2024-09-21T09:14:14.937050+0000","last_fullsized":"2024-09-21T09:14:14.937050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:14:14.936862+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:14:14.936862+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.936862+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:43.698081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"71'4","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.749177+0000","last_change":"2024-09-21T09:14:12.749240+0000","last_active":"2024-09-21T09:14:12.749177+0000","last_peered":"2024-09-21T09:14:12.749177+0000","last_clean":"2024-09-21T09:14:12.749177+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:14:12.749177+0000","last_undegraded":"2024-09-21T09:14:12.749177+0000","last_fullsized":"2024-09-21T09:14:12.749177+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:14:12.748923+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:14:12.748923+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.748923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:50.691179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.566849+0000","last_change":"2024-09-21T09:14:07.566908+0000","last_active":"2024-09-21T09:14:07.566849+0000","last_peered":"2024-09-21T09:14:07.566849+0000","last_clean":"2024-09-21T09:14:07.566849+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:14:07.566849+0000","last_undegraded":"2024-09-21T09:14:07.566849+0000","last_fullsized":"2024-09-21T09:14:07.566849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:07.566625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:07.566625+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.566625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:17.707996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"91'8","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.486506+0000","last_change":"2024-09-21T09:14:17.486566+0000","last_active":"2024-09-21T09:14:17.486506+0000","last_peered":"2024-09-21T09:14:17.486506+0000","last_clean":"2024-09-21T09:14:17.486506+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:14:17.486506+0000","last_undegraded":"2024-09-21T09:14:17.486506+0000","last_fullsized":"2024-09-21T09:14:17.486506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-09-21T09:14:17.486265+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-09-21T09:14:17.486265+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.486265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:06.161521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.503334+0000","last_change":"2024-09-21T09:14:12.503475+0000","last_active":"2024-09-21T09:14:12.503334+0000","last_peered":"2024-09-21T09:14:12.503334+0000","last_clean":"2024-09-21T09:14:12.503334+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:14:12.503334+0000","last_undegraded":"2024-09-21T09:14:12.503334+0000","last_fullsized":"2024-09-21T09:14:12.503334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:12.503093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:12.503093+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.503093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:25.941287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:21.245673+0000","last_change":"2024-09-21T09:14:21.245730+0000","last_active":"2024-09-21T09:14:21.245673+0000","last_peered":"2024-09-21T09:14:21.245673+0000","last_clean":"2024-09-21T09:14:21.245673+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:14:21.245673+0000","last_undegraded":"2024-09-21T09:14:21.245673+0000","last_fullsized":"2024-09-21T09:14:21.245673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:21.245485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:21.245485+0000","last_clean_scrub_stamp":"2024-09-21T09:14:21.245485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:52.325633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"91'16","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.258104+0000","last_change":"2024-09-21T09:14:06.258177+0000","last_active":"2024-09-21T09:14:06.258104+0000","last_peered":"2024-09-21T09:14:06.258104+0000","last_clean":"2024-09-21T09:14:06.258104+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:14:06.258104+0000","last_undegraded":"2024-09-21T09:14:06.258104+0000","last_fullsized":"2024-09-21T09:14:06.258104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:06.257920+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:06.257920+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.257920+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:15.871331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"91'110","reported_seq":300,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:28.967375+0000","last_change":"2024-09-21T09:14:28.967445+0000","last_active":"2024-09-21T09:14:28.967375+0000","last_peered":"2024-09-21T09:14:28.967375+0000","last_clean":"2024-09-21T09:14:28.967375+0000","last_became_active":"2024-09-21T09:13:22.164964+0000","last_became_peered":"2024-09-21T09:13:22.164964+0000","last_unstale":"2024-09-21T09:14:28.967375+0000","last_undegraded":"2024-09-21T09:14:28.967375+0000","last_fullsized":"2024-09-21T09:14:28.967375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'110","last_scrub_stamp":"2024-09-21T09:14:28.967180+0000","last_deep_scrub":"91'110","last_deep_scrub_stamp":"2024-09-21T09:14:28.967180+0000","last_clean_scrub_stamp":"2024-09-21T09:14:28.967180+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:25.578585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"62'2","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.954714+0000","last_change":"2024-09-21T09:13:52.954779+0000","last_active":"2024-09-21T09:13:52.954714+0000","last_peered":"2024-09-21T09:13:52.954714+0000","last_clean":"2024-09-21T09:13:52.954714+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:13:52.954714+0000","last_undegraded":"2024-09-21T09:13:52.954714+0000","last_fullsized":"2024-09-21T09:13:52.954714+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:52.954481+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:52.954481+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.954481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:17.101762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.757036+0000","last_change":"2024-09-21T09:14:08.757091+0000","last_active":"2024-09-21T09:14:08.757036+0000","last_peered":"2024-09-21T09:14:08.757036+0000","last_clean":"2024-09-21T09:14:08.757036+0000","last_became_active":"2024-09-21T09:13:19.158513+0000","last_became_peered":"2024-09-21T09:13:19.158513+0000","last_unstale":"2024-09-21T09:14:08.757036+0000","last_undegraded":"2024-09-21T09:14:08.757036+0000","last_fullsized":"2024-09-21T09:14:08.757036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:08.756832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:08.756832+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.756832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:09.179899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"91'12","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.504720+0000","last_change":"2024-09-21T09:14:15.504779+0000","last_active":"2024-09-21T09:14:15.504720+0000","last_peered":"2024-09-21T09:14:15.504720+0000","last_clean":"2024-09-21T09:14:15.504720+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:14:15.504720+0000","last_undegraded":"2024-09-21T09:14:15.504720+0000","last_fullsized":"2024-09-21T09:14:15.504720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-21T09:14:15.504520+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-21T09:14:15.504520+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.504520+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:11.748618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:26.160950+0000","last_change":"2024-09-21T09:14:26.161003+0000","last_active":"2024-09-21T09:14:26.160950+0000","last_peered":"2024-09-21T09:14:26.160950+0000","last_clean":"2024-09-21T09:14:26.160950+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:14:26.160950+0000","last_undegraded":"2024-09-21T09:14:26.160950+0000","last_fullsized":"2024-09-21T09:14:26.160950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:26.160748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:26.160748+0000","last_clean_scrub_stamp":"2024-09-21T09:14:26.160748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:05.168260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:22.454564+0000","last_change":"2024-09-21T09:14:22.454629+0000","last_active":"2024-09-21T09:14:22.454564+0000","last_peered":"2024-09-21T09:14:22.454564+0000","last_clean":"2024-09-21T09:14:22.454564+0000","last_became_active":"2024-09-21T09:13:19.152735+0000","last_became_peered":"2024-09-21T09:13:19.152735+0000","last_unstale":"2024-09-21T09:14:22.454564+0000","last_undegraded":"2024-09-21T09:14:22.454564+0000","last_fullsized":"2024-09-21T09:14:22.454564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:22.454366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:22.454366+0000","last_clean_scrub_stamp":"2024-09-21T09:14:22.454366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:57.221333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"91'51","reported_seq":219,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.202033+0000","last_change":"2024-09-21T09:13:55.202110+0000","last_active":"2024-09-21T09:13:55.202033+0000","last_peered":"2024-09-21T09:13:55.202033+0000","last_clean":"2024-09-21T09:13:55.202033+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:13:55.202033+0000","last_undegraded":"2024-09-21T09:13:55.202033+0000","last_fullsized":"2024-09-21T09:13:55.202033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'51","last_scrub_stamp":"2024-09-21T09:13:55.201857+0000","last_deep_scrub":"91'51","last_deep_scrub_stamp":"2024-09-21T09:13:55.201857+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.201857+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:49.637255+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.394550+0000","last_change":"2024-09-21T09:13:53.394609+0000","last_active":"2024-09-21T09:13:53.394550+0000","last_peered":"2024-09-21T09:13:53.394550+0000","last_clean":"2024-09-21T09:13:53.394550+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:13:53.394550+0000","last_undegraded":"2024-09-21T09:13:53.394550+0000","last_fullsized":"2024-09-21T09:13:53.394550+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.394338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.394338+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.394338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:38.938159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"71'2","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.703982+0000","last_change":"2024-09-21T09:13:54.704208+0000","last_active":"2024-09-21T09:13:54.703982+0000","last_peered":"2024-09-21T09:13:54.703982+0000","last_clean":"2024-09-21T09:13:54.703982+0000","last_became_active":"2024-09-21T09:13:19.140926+0000","last_became_peered":"2024-09-21T09:13:19.140926+0000","last_unstale":"2024-09-21T09:13:54.703982+0000","last_undegraded":"2024-09-21T09:13:54.703982+0000","last_fullsized":"2024-09-21T09:13:54.703982+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:13:54.703715+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:13:54.703715+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.703715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:43.202883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":426,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:21.407237+0000","last_change":"2024-09-21T09:14:21.407293+0000","last_active":"2024-09-21T09:14:21.407237+0000","last_peered":"2024-09-21T09:14:21.407237+0000","last_clean":"2024-09-21T09:14:21.407237+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:14:21.407237+0000","last_undegraded":"2024-09-21T09:14:21.407237+0000","last_fullsized":"2024-09-21T09:14:21.407237+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:21.407012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:21.407012+0000","last_clean_scrub_stamp":"2024-09-21T09:14:21.407012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:00.913093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"71'4","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.675739+0000","last_change":"2024-09-21T09:13:51.675798+0000","last_active":"2024-09-21T09:13:51.675739+0000","last_peered":"2024-09-21T09:13:51.675739+0000","last_clean":"2024-09-21T09:13:51.675739+0000","last_became_active":"2024-09-21T09:13:19.158305+0000","last_became_peered":"2024-09-21T09:13:19.158305+0000","last_unstale":"2024-09-21T09:13:51.675739+0000","last_undegraded":"2024-09-21T09:13:51.675739+0000","last_fullsized":"2024-09-21T09:13:51.675739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:51.675546+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:51.675546+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.675546+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:44.873979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"91'16","reported_seq":203,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.500567+0000","last_change":"2024-09-21T09:13:21.278992+0000","last_active":"2024-09-21T09:13:45.500567+0000","last_peered":"2024-09-21T09:13:45.500567+0000","last_clean":"2024-09-21T09:13:45.500567+0000","last_became_active":"2024-09-21T09:13:19.168562+0000","last_became_peered":"2024-09-21T09:13:19.168562+0000","last_unstale":"2024-09-21T09:13:45.500567+0000","last_undegraded":"2024-09-21T09:13:45.500567+0000","last_fullsized":"2024-09-21T09:13:45.500567+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.640276+0000","last_change":"2024-09-21T09:13:53.640428+0000","last_active":"2024-09-21T09:13:53.640276+0000","last_peered":"2024-09-21T09:13:53.640276+0000","last_clean":"2024-09-21T09:13:53.640276+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:13:53.640276+0000","last_undegraded":"2024-09-21T09:13:53.640276+0000","last_fullsized":"2024-09-21T09:13:53.640276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.640034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.640034+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.640034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:54.097218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"91'26","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.721123+0000","last_change":"2024-09-21T09:13:58.721193+0000","last_active":"2024-09-21T09:13:58.721123+0000","last_peered":"2024-09-21T09:13:58.721123+0000","last_clean":"2024-09-21T09:13:58.721123+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:13:58.721123+0000","last_undegraded":"2024-09-21T09:13:58.721123+0000","last_fullsized":"2024-09-21T09:13:58.721123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:13:58.720936+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:13:58.720936+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.720936+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:47.220103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":40,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.821127+0000","last_change":"2024-09-21T09:14:10.821180+0000","last_active":"2024-09-21T09:14:10.821127+0000","last_peered":"2024-09-21T09:14:10.821127+0000","last_clean":"2024-09-21T09:14:10.821127+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:14:10.821127+0000","last_undegraded":"2024-09-21T09:14:10.821127+0000","last_fullsized":"2024-09-21T09:14:10.821127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:10.820920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:10.820920+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.820920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:32.967322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"61'16","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.754318+0000","last_change":"2024-09-21T09:14:15.754381+0000","last_active":"2024-09-21T09:14:15.754318+0000","last_peered":"2024-09-21T09:14:15.754318+0000","last_clean":"2024-09-21T09:14:15.754318+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:14:15.754318+0000","last_undegraded":"2024-09-21T09:14:15.754318+0000","last_fullsized":"2024-09-21T09:14:15.754318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'16","last_scrub_stamp":"2024-09-21T09:14:15.754114+0000","last_deep_scrub":"61'16","last_deep_scrub_stamp":"2024-09-21T09:14:15.754114+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.754114+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:49.108804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"62'6","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.571510+0000","last_change":"2024-09-21T09:14:05.571575+0000","last_active":"2024-09-21T09:14:05.571510+0000","last_peered":"2024-09-21T09:14:05.571510+0000","last_clean":"2024-09-21T09:14:05.571510+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:14:05.571510+0000","last_undegraded":"2024-09-21T09:14:05.571510+0000","last_fullsized":"2024-09-21T09:14:05.571510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-09-21T09:14:05.571300+0000","last_deep_scrub":"62'6","last_deep_scrub_stamp":"2024-09-21T09:14:05.571300+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.571300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:07.501896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"91'16","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.986041+0000","last_change":"2024-09-21T09:14:07.986109+0000","last_active":"2024-09-21T09:14:07.986041+0000","last_peered":"2024-09-21T09:14:07.986041+0000","last_clean":"2024-09-21T09:14:07.986041+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:14:07.986041+0000","last_undegraded":"2024-09-21T09:14:07.986041+0000","last_fullsized":"2024-09-21T09:14:07.986041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:07.985822+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:07.985822+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.985822+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:53.134912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.396996+0000","last_change":"2024-09-21T09:13:57.397053+0000","last_active":"2024-09-21T09:13:57.396996+0000","last_peered":"2024-09-21T09:13:57.396996+0000","last_clean":"2024-09-21T09:13:57.396996+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:13:57.396996+0000","last_undegraded":"2024-09-21T09:13:57.396996+0000","last_fullsized":"2024-09-21T09:13:57.396996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:57.396794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:57.396794+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.396794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:48.120616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"91'8","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:27.519512+0000","last_change":"2024-09-21T09:14:27.519583+0000","last_active":"2024-09-21T09:14:27.519512+0000","last_peered":"2024-09-21T09:14:27.519512+0000","last_clean":"2024-09-21T09:14:27.519512+0000","last_became_active":"2024-09-21T09:13:19.154000+0000","last_became_peered":"2024-09-21T09:13:19.154000+0000","last_unstale":"2024-09-21T09:14:27.519512+0000","last_undegraded":"2024-09-21T09:14:27.519512+0000","last_fullsized":"2024-09-21T09:14:27.519512+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-09-21T09:14:27.519314+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-09-21T09:14:27.519314+0000","last_clean_scrub_stamp":"2024-09-21T09:14:27.519314+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:39.941071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.788437+0000","last_change":"2024-09-21T09:14:07.788490+0000","last_active":"2024-09-21T09:14:07.788437+0000","last_peered":"2024-09-21T09:14:07.788437+0000","last_clean":"2024-09-21T09:14:07.788437+0000","last_became_active":"2024-09-21T09:13:19.157523+0000","last_became_peered":"2024-09-21T09:13:19.157523+0000","last_unstale":"2024-09-21T09:14:07.788437+0000","last_undegraded":"2024-09-21T09:14:07.788437+0000","last_fullsized":"2024-09-21T09:14:07.788437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:07.788239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:07.788239+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.788239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:10.459985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.906568+0000","last_change":"2024-09-21T09:14:13.906626+0000","last_active":"2024-09-21T09:14:13.906568+0000","last_peered":"2024-09-21T09:14:13.906568+0000","last_clean":"2024-09-21T09:14:13.906568+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:14:13.906568+0000","last_undegraded":"2024-09-21T09:14:13.906568+0000","last_fullsized":"2024-09-21T09:14:13.906568+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:13.906374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:13.906374+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.906374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:18:01.622451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:19.451727+0000","last_change":"2024-09-21T09:14:19.451832+0000","last_active":"2024-09-21T09:14:19.451727+0000","last_peered":"2024-09-21T09:14:19.451727+0000","last_clean":"2024-09-21T09:14:19.451727+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:14:19.451727+0000","last_undegraded":"2024-09-21T09:14:19.451727+0000","last_fullsized":"2024-09-21T09:14:19.451727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:19.451429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:19.451429+0000","last_clean_scrub_stamp":"2024-09-21T09:14:19.451429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:34.392239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"91'24","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.752707+0000","last_change":"2024-09-21T09:14:09.752840+0000","last_active":"2024-09-21T09:14:09.752707+0000","last_peered":"2024-09-21T09:14:09.752707+0000","last_clean":"2024-09-21T09:14:09.752707+0000","last_became_active":"2024-09-21T09:13:19.160370+0000","last_became_peered":"2024-09-21T09:13:19.160370+0000","last_unstale":"2024-09-21T09:14:09.752707+0000","last_undegraded":"2024-09-21T09:14:09.752707+0000","last_fullsized":"2024-09-21T09:14:09.752707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:09.752476+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:09.752476+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.752476+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:38.513695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.712188+0000","last_change":"2024-09-21T09:14:03.712240+0000","last_active":"2024-09-21T09:14:03.712188+0000","last_peered":"2024-09-21T09:14:03.712188+0000","last_clean":"2024-09-21T09:14:03.712188+0000","last_became_active":"2024-09-21T09:13:19.142672+0000","last_became_peered":"2024-09-21T09:13:19.142672+0000","last_unstale":"2024-09-21T09:14:03.712188+0000","last_undegraded":"2024-09-21T09:14:03.712188+0000","last_fullsized":"2024-09-21T09:14:03.712188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:03.711998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:03.711998+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.711998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:48.861088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"91'24","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.855899+0000","last_change":"2024-09-21T09:13:54.855982+0000","last_active":"2024-09-21T09:13:54.855899+0000","last_peered":"2024-09-21T09:13:54.855899+0000","last_clean":"2024-09-21T09:13:54.855899+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:13:54.855899+0000","last_undegraded":"2024-09-21T09:13:54.855899+0000","last_fullsized":"2024-09-21T09:13:54.855899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:13:54.855688+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:13:54.855688+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.855688+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:13.221656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.946140+0000","last_change":"2024-09-21T09:14:13.946199+0000","last_active":"2024-09-21T09:14:13.946140+0000","last_peered":"2024-09-21T09:14:13.946140+0000","last_clean":"2024-09-21T09:14:13.946140+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:14:13.946140+0000","last_undegraded":"2024-09-21T09:14:13.946140+0000","last_fullsized":"2024-09-21T09:14:13.946140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:13.945950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:13.945950+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.945950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:14.369017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"71'7","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:37.380840+0000","last_change":"2024-09-21T09:13:21.128242+0000","last_active":"2024-09-21T09:13:37.380840+0000","last_peered":"2024-09-21T09:13:37.380840+0000","last_clean":"2024-09-21T09:13:37.380840+0000","last_became_active":"2024-09-21T09:13:19.167169+0000","last_became_peered":"2024-09-21T09:13:19.167169+0000","last_unstale":"2024-09-21T09:13:37.380840+0000","last_undegraded":"2024-09-21T09:13:37.380840+0000","last_fullsized":"2024-09-21T09:13:37.380840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:05.843867+0000","last_clean_scrub_stamp":"2024-09-21T09:11:05.843867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.818363+0000","last_change":"2024-09-21T09:14:08.818422+0000","last_active":"2024-09-21T09:14:08.818363+0000","last_peered":"2024-09-21T09:14:08.818363+0000","last_clean":"2024-09-21T09:14:08.818363+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:14:08.818363+0000","last_undegraded":"2024-09-21T09:14:08.818363+0000","last_fullsized":"2024-09-21T09:14:08.818363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:08.818156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:08.818156+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.818156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:01.320634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'18","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.073913+0000","last_change":"2024-09-21T09:14:15.073977+0000","last_active":"2024-09-21T09:14:15.073913+0000","last_peered":"2024-09-21T09:14:15.073913+0000","last_clean":"2024-09-21T09:14:15.073913+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:14:15.073913+0000","last_undegraded":"2024-09-21T09:14:15.073913+0000","last_fullsized":"2024-09-21T09:14:15.073913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:15.073708+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:15.073708+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.073708+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:12.740626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.129722+0000","last_change":"2024-09-21T09:13:57.129779+0000","last_active":"2024-09-21T09:13:57.129722+0000","last_peered":"2024-09-21T09:13:57.129722+0000","last_clean":"2024-09-21T09:13:57.129722+0000","last_became_active":"2024-09-21T09:13:19.152722+0000","last_became_peered":"2024-09-21T09:13:19.152722+0000","last_unstale":"2024-09-21T09:13:57.129722+0000","last_undegraded":"2024-09-21T09:13:57.129722+0000","last_fullsized":"2024-09-21T09:13:57.129722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:57.129492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:57.129492+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.129492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:05:20.856713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"91'22","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.996434+0000","last_change":"2024-09-21T09:14:08.996509+0000","last_active":"2024-09-21T09:14:08.996434+0000","last_peered":"2024-09-21T09:14:08.996434+0000","last_clean":"2024-09-21T09:14:08.996434+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:14:08.996434+0000","last_undegraded":"2024-09-21T09:14:08.996434+0000","last_fullsized":"2024-09-21T09:14:08.996434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:08.996243+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:08.996243+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.996243+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:41.831061+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.732185+0000","last_change":"2024-09-21T09:14:16.732238+0000","last_active":"2024-09-21T09:14:16.732185+0000","last_peered":"2024-09-21T09:14:16.732185+0000","last_clean":"2024-09-21T09:14:16.732185+0000","last_became_active":"2024-09-21T09:13:19.143577+0000","last_became_peered":"2024-09-21T09:13:19.143577+0000","last_unstale":"2024-09-21T09:14:16.732185+0000","last_undegraded":"2024-09-21T09:14:16.732185+0000","last_fullsized":"2024-09-21T09:14:16.732185+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:16.731983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:16.731983+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.731983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:13.970493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"61'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.264898+0000","last_change":"2024-09-21T09:14:07.264966+0000","last_active":"2024-09-21T09:14:07.264898+0000","last_peered":"2024-09-21T09:14:07.264898+0000","last_clean":"2024-09-21T09:14:07.264898+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:14:07.264898+0000","last_undegraded":"2024-09-21T09:14:07.264898+0000","last_fullsized":"2024-09-21T09:14:07.264898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-21T09:14:07.264688+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-21T09:14:07.264688+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.264688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:02.039746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"91'18","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.018370+0000","last_change":"2024-09-21T09:14:13.018428+0000","last_active":"2024-09-21T09:14:13.018370+0000","last_peered":"2024-09-21T09:14:13.018370+0000","last_clean":"2024-09-21T09:14:13.018370+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:14:13.018370+0000","last_undegraded":"2024-09-21T09:14:13.018370+0000","last_fullsized":"2024-09-21T09:14:13.018370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:13.018185+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:13.018185+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.018185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:50.804706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.642143+0000","last_change":"2024-09-21T09:13:52.642236+0000","last_active":"2024-09-21T09:13:52.642143+0000","last_peered":"2024-09-21T09:13:52.642143+0000","last_clean":"2024-09-21T09:13:52.642143+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:13:52.642143+0000","last_undegraded":"2024-09-21T09:13:52.642143+0000","last_fullsized":"2024-09-21T09:13:52.642143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:52.641939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:52.641939+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.641939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:06.854304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"91'33","reported_seq":188,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.942951+0000","last_change":"2024-09-21T09:14:12.943117+0000","last_active":"2024-09-21T09:14:12.942951+0000","last_peered":"2024-09-21T09:14:12.942951+0000","last_clean":"2024-09-21T09:14:12.942951+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:14:12.942951+0000","last_undegraded":"2024-09-21T09:14:12.942951+0000","last_fullsized":"2024-09-21T09:14:12.942951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33","last_scrub_stamp":"2024-09-21T09:14:12.942702+0000","last_deep_scrub":"91'33","last_deep_scrub_stamp":"2024-09-21T09:14:12.942702+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.942702+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:26.118072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.699873+0000","last_change":"2024-09-21T09:13:56.699926+0000","last_active":"2024-09-21T09:13:56.699873+0000","last_peered":"2024-09-21T09:13:56.699873+0000","last_clean":"2024-09-21T09:13:56.699873+0000","last_became_active":"2024-09-21T09:13:19.165859+0000","last_became_peered":"2024-09-21T09:13:19.165859+0000","last_unstale":"2024-09-21T09:13:56.699873+0000","last_undegraded":"2024-09-21T09:13:56.699873+0000","last_fullsized":"2024-09-21T09:13:56.699873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.699679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.699679+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.699679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:13.215807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:23.071255+0000","last_change":"2024-09-21T09:14:23.071400+0000","last_active":"2024-09-21T09:14:23.071255+0000","last_peered":"2024-09-21T09:14:23.071255+0000","last_clean":"2024-09-21T09:14:23.071255+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:14:23.071255+0000","last_undegraded":"2024-09-21T09:14:23.071255+0000","last_fullsized":"2024-09-21T09:14:23.071255+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:23.071029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:23.071029+0000","last_clean_scrub_stamp":"2024-09-21T09:14:23.071029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:22.877642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"71'10","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.510259+0000","last_change":"2024-09-21T09:14:03.510421+0000","last_active":"2024-09-21T09:14:03.510259+0000","last_peered":"2024-09-21T09:14:03.510259+0000","last_clean":"2024-09-21T09:14:03.510259+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:14:03.510259+0000","last_undegraded":"2024-09-21T09:14:03.510259+0000","last_fullsized":"2024-09-21T09:14:03.510259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:14:03.509980+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:14:03.509980+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.509980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:56.009549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"91'10","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.464829+0000","last_change":"2024-09-21T09:14:13.464897+0000","last_active":"2024-09-21T09:14:13.464829+0000","last_peered":"2024-09-21T09:14:13.464829+0000","last_clean":"2024-09-21T09:14:13.464829+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:14:13.464829+0000","last_undegraded":"2024-09-21T09:14:13.464829+0000","last_fullsized":"2024-09-21T09:14:13.464829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-21T09:14:13.464613+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-21T09:14:13.464613+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.464613+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.234660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.795572+0000","last_change":"2024-09-21T09:14:05.795627+0000","last_active":"2024-09-21T09:14:05.795572+0000","last_peered":"2024-09-21T09:14:05.795572+0000","last_clean":"2024-09-21T09:14:05.795572+0000","last_became_active":"2024-09-21T09:13:19.158652+0000","last_became_peered":"2024-09-21T09:13:19.158652+0000","last_unstale":"2024-09-21T09:14:05.795572+0000","last_undegraded":"2024-09-21T09:14:05.795572+0000","last_fullsized":"2024-09-21T09:14:05.795572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:05.795378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:05.795378+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.795378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:12.074752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"91'25","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.405482+0000","last_change":"2024-09-21T09:13:21.165572+0000","last_active":"2024-09-21T09:13:45.405482+0000","last_peered":"2024-09-21T09:13:45.405482+0000","last_clean":"2024-09-21T09:13:45.405482+0000","last_became_active":"2024-09-21T09:13:19.167344+0000","last_became_peered":"2024-09-21T09:13:19.167344+0000","last_unstale":"2024-09-21T09:13:45.405482+0000","last_undegraded":"2024-09-21T09:13:45.405482+0000","last_fullsized":"2024-09-21T09:13:45.405482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.043595+0000","last_change":"2024-09-21T09:14:12.043651+0000","last_active":"2024-09-21T09:14:12.043595+0000","last_peered":"2024-09-21T09:14:12.043595+0000","last_clean":"2024-09-21T09:14:12.043595+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:14:12.043595+0000","last_undegraded":"2024-09-21T09:14:12.043595+0000","last_fullsized":"2024-09-21T09:14:12.043595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:12.043399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:12.043399+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.043399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:20.820974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"71'2","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.193736+0000","last_change":"2024-09-21T09:13:52.193764+0000","last_active":"2024-09-21T09:13:52.193736+0000","last_peered":"2024-09-21T09:13:52.193736+0000","last_clean":"2024-09-21T09:13:52.193736+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:13:52.193736+0000","last_undegraded":"2024-09-21T09:13:52.193736+0000","last_fullsized":"2024-09-21T09:13:52.193736+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:13:52.193636+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:13:52.193636+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.193636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:37.470983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"62'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.833452+0000","last_change":"2024-09-21T09:14:05.833512+0000","last_active":"2024-09-21T09:14:05.833452+0000","last_peered":"2024-09-21T09:14:05.833452+0000","last_clean":"2024-09-21T09:14:05.833452+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:14:05.833452+0000","last_undegraded":"2024-09-21T09:14:05.833452+0000","last_fullsized":"2024-09-21T09:14:05.833452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:05.833245+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:05.833245+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.833245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:16.336869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"91'20","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.846236+0000","last_change":"2024-09-21T09:14:09.846299+0000","last_active":"2024-09-21T09:14:09.846236+0000","last_peered":"2024-09-21T09:14:09.846236+0000","last_clean":"2024-09-21T09:14:09.846236+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:14:09.846236+0000","last_undegraded":"2024-09-21T09:14:09.846236+0000","last_fullsized":"2024-09-21T09:14:09.846236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:14:09.846044+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:14:09.846044+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.846044+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:42.680862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"91'2","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.778729+0000","last_change":"2024-09-21T09:14:16.778794+0000","last_active":"2024-09-21T09:14:16.778729+0000","last_peered":"2024-09-21T09:14:16.778729+0000","last_clean":"2024-09-21T09:14:16.778729+0000","last_became_active":"2024-09-21T09:13:19.165929+0000","last_became_peered":"2024-09-21T09:13:19.165929+0000","last_unstale":"2024-09-21T09:14:16.778729+0000","last_undegraded":"2024-09-21T09:14:16.778729+0000","last_fullsized":"2024-09-21T09:14:16.778729+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-21T09:14:16.778533+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-21T09:14:16.778533+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.778533+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:18.318541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"91'24","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.759353+0000","last_change":"2024-09-21T09:14:02.759443+0000","last_active":"2024-09-21T09:14:02.759353+0000","last_peered":"2024-09-21T09:14:02.759353+0000","last_clean":"2024-09-21T09:14:02.759353+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:14:02.759353+0000","last_undegraded":"2024-09-21T09:14:02.759353+0000","last_fullsized":"2024-09-21T09:14:02.759353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:02.759160+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:02.759160+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.759160+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:55.261638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.843099+0000","last_change":"2024-09-21T09:14:00.843157+0000","last_active":"2024-09-21T09:14:00.843099+0000","last_peered":"2024-09-21T09:14:00.843099+0000","last_clean":"2024-09-21T09:14:00.843099+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:14:00.843099+0000","last_undegraded":"2024-09-21T09:14:00.843099+0000","last_fullsized":"2024-09-21T09:14:00.843099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.842897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.842897+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.842897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:37.126044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"62'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.144792+0000","last_change":"2024-09-21T09:13:51.144825+0000","last_active":"2024-09-21T09:13:51.144792+0000","last_peered":"2024-09-21T09:13:51.144792+0000","last_clean":"2024-09-21T09:13:51.144792+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:13:51.144792+0000","last_undegraded":"2024-09-21T09:13:51.144792+0000","last_fullsized":"2024-09-21T09:13:51.144792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-09-21T09:13:51.144678+0000","last_deep_scrub":"62'10","last_deep_scrub_stamp":"2024-09-21T09:13:51.144678+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.144678+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:19.905897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":39,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.534284+0000","last_change":"2024-09-21T09:14:09.534342+0000","last_active":"2024-09-21T09:14:09.534284+0000","last_peered":"2024-09-21T09:14:09.534284+0000","last_clean":"2024-09-21T09:14:09.534284+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:14:09.534284+0000","last_undegraded":"2024-09-21T09:14:09.534284+0000","last_fullsized":"2024-09-21T09:14:09.534284+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:09.534080+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:09.534080+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.534080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:36.639543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"91'24","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.484076+0000","last_change":"2024-09-21T09:14:16.484148+0000","last_active":"2024-09-21T09:14:16.484076+0000","last_peered":"2024-09-21T09:14:16.484076+0000","last_clean":"2024-09-21T09:14:16.484076+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:14:16.484076+0000","last_undegraded":"2024-09-21T09:14:16.484076+0000","last_fullsized":"2024-09-21T09:14:16.484076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:16.483880+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:16.483880+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.483880+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:09.794271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.453959+0000","last_change":"2024-09-21T09:14:00.454139+0000","last_active":"2024-09-21T09:14:00.453959+0000","last_peered":"2024-09-21T09:14:00.453959+0000","last_clean":"2024-09-21T09:14:00.453959+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:14:00.453959+0000","last_undegraded":"2024-09-21T09:14:00.453959+0000","last_fullsized":"2024-09-21T09:14:00.453959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.453712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.453712+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.453712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:03.275108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"74'14","reported_seq":190,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:34.483050+0000","last_change":"2024-09-21T09:13:21.153990+0000","last_active":"2024-09-21T09:13:34.483050+0000","last_peered":"2024-09-21T09:13:34.483050+0000","last_clean":"2024-09-21T09:13:34.483050+0000","last_became_active":"2024-09-21T09:13:19.167321+0000","last_became_peered":"2024-09-21T09:13:19.167321+0000","last_unstale":"2024-09-21T09:13:34.483050+0000","last_undegraded":"2024-09-21T09:13:34.483050+0000","last_fullsized":"2024-09-21T09:13:34.483050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:11:01.814359+0000","last_clean_scrub_stamp":"2024-09-21T09:11:01.814359+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"91'105","reported_seq":283,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.984999+0000","last_change":"2024-09-21T09:14:10.985061+0000","last_active":"2024-09-21T09:14:10.984999+0000","last_peered":"2024-09-21T09:14:10.984999+0000","last_clean":"2024-09-21T09:14:10.984999+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:14:10.984999+0000","last_undegraded":"2024-09-21T09:14:10.984999+0000","last_fullsized":"2024-09-21T09:14:10.984999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:14:10.984812+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:14:10.984812+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.984812+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:18.107331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"58'2","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.191989+0000","last_change":"2024-09-21T09:13:54.192051+0000","last_active":"2024-09-21T09:13:54.191989+0000","last_peered":"2024-09-21T09:13:54.191989+0000","last_clean":"2024-09-21T09:13:54.191989+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:13:54.191989+0000","last_undegraded":"2024-09-21T09:13:54.191989+0000","last_fullsized":"2024-09-21T09:13:54.191989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:54.191786+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:54.191786+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.191786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:02.969361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"71'10","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.677726+0000","last_change":"2024-09-21T09:13:53.677785+0000","last_active":"2024-09-21T09:13:53.677726+0000","last_peered":"2024-09-21T09:13:53.677726+0000","last_clean":"2024-09-21T09:13:53.677726+0000","last_became_active":"2024-09-21T09:13:19.159904+0000","last_became_peered":"2024-09-21T09:13:19.159904+0000","last_unstale":"2024-09-21T09:13:53.677726+0000","last_undegraded":"2024-09-21T09:13:53.677726+0000","last_fullsized":"2024-09-21T09:13:53.677726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:13:53.677529+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:13:53.677529+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.677529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:17.824810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"91'22","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.867232+0000","last_change":"2024-09-21T09:14:08.867353+0000","last_active":"2024-09-21T09:14:08.867232+0000","last_peered":"2024-09-21T09:14:08.867232+0000","last_clean":"2024-09-21T09:14:08.867232+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:14:08.867232+0000","last_undegraded":"2024-09-21T09:14:08.867232+0000","last_fullsized":"2024-09-21T09:14:08.867232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:08.866992+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:08.866992+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.866992+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:54.016082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.808379+0000","last_change":"2024-09-21T09:13:54.808438+0000","last_active":"2024-09-21T09:13:54.808379+0000","last_peered":"2024-09-21T09:13:54.808379+0000","last_clean":"2024-09-21T09:13:54.808379+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:13:54.808379+0000","last_undegraded":"2024-09-21T09:13:54.808379+0000","last_fullsized":"2024-09-21T09:13:54.808379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:54.808158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:54.808158+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.808158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:12.602854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"91'31","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.145113+0000","last_change":"2024-09-21T09:13:57.145195+0000","last_active":"2024-09-21T09:13:57.145113+0000","last_peered":"2024-09-21T09:13:57.145113+0000","last_clean":"2024-09-21T09:13:57.145113+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:13:57.145113+0000","last_undegraded":"2024-09-21T09:13:57.145113+0000","last_fullsized":"2024-09-21T09:13:57.145113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'31","last_scrub_stamp":"2024-09-21T09:13:57.144916+0000","last_deep_scrub":"91'31","last_deep_scrub_stamp":"2024-09-21T09:13:57.144916+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.144916+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:50.267672+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.430683+0000","last_change":"2024-09-21T09:13:55.430833+0000","last_active":"2024-09-21T09:13:55.430683+0000","last_peered":"2024-09-21T09:13:55.430683+0000","last_clean":"2024-09-21T09:13:55.430683+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:13:55.430683+0000","last_undegraded":"2024-09-21T09:13:55.430683+0000","last_fullsized":"2024-09-21T09:13:55.430683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:55.430438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:55.430438+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.430438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:15.880700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"71'10","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.814870+0000","last_change":"2024-09-21T09:14:17.814930+0000","last_active":"2024-09-21T09:14:17.814870+0000","last_peered":"2024-09-21T09:14:17.814870+0000","last_clean":"2024-09-21T09:14:17.814870+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:14:17.814870+0000","last_undegraded":"2024-09-21T09:14:17.814870+0000","last_fullsized":"2024-09-21T09:14:17.814870+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:14:17.814659+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:14:17.814659+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.814659+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.592234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.736545+0000","last_change":"2024-09-21T09:14:02.736598+0000","last_active":"2024-09-21T09:14:02.736545+0000","last_peered":"2024-09-21T09:14:02.736545+0000","last_clean":"2024-09-21T09:14:02.736545+0000","last_became_active":"2024-09-21T09:13:19.143746+0000","last_became_peered":"2024-09-21T09:13:19.143746+0000","last_unstale":"2024-09-21T09:14:02.736545+0000","last_undegraded":"2024-09-21T09:14:02.736545+0000","last_fullsized":"2024-09-21T09:14:02.736545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:02.736334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:02.736334+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.736334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:06.609424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"91'30","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.227457+0000","last_change":"2024-09-21T09:13:53.227523+0000","last_active":"2024-09-21T09:13:53.227457+0000","last_peered":"2024-09-21T09:13:53.227457+0000","last_clean":"2024-09-21T09:13:53.227457+0000","last_became_active":"2024-09-21T09:11:34.170599+0000","last_became_peered":"2024-09-21T09:11:34.170599+0000","last_unstale":"2024-09-21T09:13:53.227457+0000","last_undegraded":"2024-09-21T09:13:53.227457+0000","last_fullsized":"2024-09-21T09:13:53.227457+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'30","last_scrub_stamp":"2024-09-21T09:13:53.227240+0000","last_deep_scrub":"91'30","last_deep_scrub_stamp":"2024-09-21T09:13:53.227240+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.227240+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:50.752780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.691148+0000","last_change":"2024-09-21T09:14:01.691205+0000","last_active":"2024-09-21T09:14:01.691148+0000","last_peered":"2024-09-21T09:14:01.691148+0000","last_clean":"2024-09-21T09:14:01.691148+0000","last_became_active":"2024-09-21T09:13:19.141404+0000","last_became_peered":"2024-09-21T09:13:19.141404+0000","last_unstale":"2024-09-21T09:14:01.691148+0000","last_undegraded":"2024-09-21T09:14:01.691148+0000","last_fullsized":"2024-09-21T09:14:01.691148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.690948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.690948+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.690948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:39.633204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.471406+0000","last_change":"2024-09-21T09:14:02.471502+0000","last_active":"2024-09-21T09:14:02.471406+0000","last_peered":"2024-09-21T09:14:02.471406+0000","last_clean":"2024-09-21T09:14:02.471406+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:14:02.471406+0000","last_undegraded":"2024-09-21T09:14:02.471406+0000","last_fullsized":"2024-09-21T09:14:02.471406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:02.471144+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:02.471144+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.471144+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:11.892110+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.134742+0000","last_change":"2024-09-21T09:13:59.134849+0000","last_active":"2024-09-21T09:13:59.134742+0000","last_peered":"2024-09-21T09:13:59.134742+0000","last_clean":"2024-09-21T09:13:59.134742+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:13:59.134742+0000","last_undegraded":"2024-09-21T09:13:59.134742+0000","last_fullsized":"2024-09-21T09:13:59.134742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:59.134483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:59.134483+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.134483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:40.830729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:25.060563+0000","last_change":"2024-09-21T09:14:25.060698+0000","last_active":"2024-09-21T09:14:25.060563+0000","last_peered":"2024-09-21T09:14:25.060563+0000","last_clean":"2024-09-21T09:14:25.060563+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:14:25.060563+0000","last_undegraded":"2024-09-21T09:14:25.060563+0000","last_fullsized":"2024-09-21T09:14:25.060563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:25.060262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:25.060262+0000","last_clean_scrub_stamp":"2024-09-21T09:14:25.060262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.673673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.847984+0000","last_change":"2024-09-21T09:14:06.848035+0000","last_active":"2024-09-21T09:14:06.847984+0000","last_peered":"2024-09-21T09:14:06.847984+0000","last_clean":"2024-09-21T09:14:06.847984+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:14:06.847984+0000","last_undegraded":"2024-09-21T09:14:06.847984+0000","last_fullsized":"2024-09-21T09:14:06.847984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:06.847793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:06.847793+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.847793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:54.140783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"91'22","reported_seq":230,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:26.985041+0000","last_change":"2024-09-21T09:14:26.985103+0000","last_active":"2024-09-21T09:14:26.985041+0000","last_peered":"2024-09-21T09:14:26.985041+0000","last_clean":"2024-09-21T09:14:26.985041+0000","last_became_active":"2024-09-21T09:13:19.169569+0000","last_became_peered":"2024-09-21T09:13:19.169569+0000","last_unstale":"2024-09-21T09:14:26.985041+0000","last_undegraded":"2024-09-21T09:14:26.985041+0000","last_fullsized":"2024-09-21T09:14:26.985041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:26.984826+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:26.984826+0000","last_clean_scrub_stamp":"2024-09-21T09:14:26.984826+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:06.739164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:49.711655+0000","last_change":"2024-09-21T09:13:49.711711+0000","last_active":"2024-09-21T09:13:49.711655+0000","last_peered":"2024-09-21T09:13:49.711655+0000","last_clean":"2024-09-21T09:13:49.711655+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:13:49.711655+0000","last_undegraded":"2024-09-21T09:13:49.711655+0000","last_fullsized":"2024-09-21T09:13:49.711655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:49.711547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:49.711547+0000","last_clean_scrub_stamp":"2024-09-21T09:13:49.711547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:08.077515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"91'16","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:18.929143+0000","last_change":"2024-09-21T09:14:18.929213+0000","last_active":"2024-09-21T09:14:18.929143+0000","last_peered":"2024-09-21T09:14:18.929143+0000","last_clean":"2024-09-21T09:14:18.929143+0000","last_became_active":"2024-09-21T09:13:19.150207+0000","last_became_peered":"2024-09-21T09:13:19.150207+0000","last_unstale":"2024-09-21T09:14:18.929143+0000","last_undegraded":"2024-09-21T09:14:18.929143+0000","last_fullsized":"2024-09-21T09:14:18.929143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:18.928398+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:18.928398+0000","last_clean_scrub_stamp":"2024-09-21T09:14:18.928398+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:09.856947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.159493+0000","last_change":"2024-09-21T09:13:58.159551+0000","last_active":"2024-09-21T09:13:58.159493+0000","last_peered":"2024-09-21T09:13:58.159493+0000","last_clean":"2024-09-21T09:13:58.159493+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:13:58.159493+0000","last_undegraded":"2024-09-21T09:13:58.159493+0000","last_fullsized":"2024-09-21T09:13:58.159493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.159293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.159293+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.159293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:00.285955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.140566+0000","last_change":"2024-09-21T09:14:01.140618+0000","last_active":"2024-09-21T09:14:01.140566+0000","last_peered":"2024-09-21T09:14:01.140566+0000","last_clean":"2024-09-21T09:14:01.140566+0000","last_became_active":"2024-09-21T09:13:19.157306+0000","last_became_peered":"2024-09-21T09:13:19.157306+0000","last_unstale":"2024-09-21T09:14:01.140566+0000","last_undegraded":"2024-09-21T09:14:01.140566+0000","last_fullsized":"2024-09-21T09:14:01.140566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.140359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.140359+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.140359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:42.381193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"71'4","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.716046+0000","last_change":"2024-09-21T09:13:59.716197+0000","last_active":"2024-09-21T09:13:59.716046+0000","last_peered":"2024-09-21T09:13:59.716046+0000","last_clean":"2024-09-21T09:13:59.716046+0000","last_became_active":"2024-09-21T09:13:19.161496+0000","last_became_peered":"2024-09-21T09:13:19.161496+0000","last_unstale":"2024-09-21T09:13:59.716046+0000","last_undegraded":"2024-09-21T09:13:59.716046+0000","last_fullsized":"2024-09-21T09:13:59.716046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:59.715805+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:59.715805+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.715805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.862207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"91'8","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.072526+0000","last_change":"2024-09-21T09:14:16.072589+0000","last_active":"2024-09-21T09:14:16.072526+0000","last_peered":"2024-09-21T09:14:16.072526+0000","last_clean":"2024-09-21T09:14:16.072526+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:14:16.072526+0000","last_undegraded":"2024-09-21T09:14:16.072526+0000","last_fullsized":"2024-09-21T09:14:16.072526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-09-21T09:14:16.072291+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-09-21T09:14:16.072291+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.072291+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:17.612299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"91'2","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.415530+0000","last_change":"2024-09-21T09:13:59.415662+0000","last_active":"2024-09-21T09:13:59.415530+0000","last_peered":"2024-09-21T09:13:59.415530+0000","last_clean":"2024-09-21T09:13:59.415530+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:13:59.415530+0000","last_undegraded":"2024-09-21T09:13:59.415530+0000","last_fullsized":"2024-09-21T09:13:59.415530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-21T09:13:59.415299+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-21T09:13:59.415299+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.415299+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:12.290157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"91'24","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.190973+0000","last_change":"2024-09-21T09:14:02.191055+0000","last_active":"2024-09-21T09:14:02.190973+0000","last_peered":"2024-09-21T09:14:02.190973+0000","last_clean":"2024-09-21T09:14:02.190973+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:14:02.190973+0000","last_undegraded":"2024-09-21T09:14:02.190973+0000","last_fullsized":"2024-09-21T09:14:02.190973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:02.190779+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:02.190779+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.190779+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:09.648803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":155,"num_write":18,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.362314+0000","last_change":"2024-09-21T09:13:51.362369+0000","last_active":"2024-09-21T09:13:51.362314+0000","last_peered":"2024-09-21T09:13:51.362314+0000","last_clean":"2024-09-21T09:13:51.362314+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:13:51.362314+0000","last_undegraded":"2024-09-21T09:13:51.362314+0000","last_fullsized":"2024-09-21T09:13:51.362314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:51.362073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:51.362073+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.362073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:33.156385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'2","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.985468+0000","last_change":"2024-09-21T09:14:14.985542+0000","last_active":"2024-09-21T09:14:14.985468+0000","last_peered":"2024-09-21T09:14:14.985468+0000","last_clean":"2024-09-21T09:14:14.985468+0000","last_became_active":"2024-09-21T09:13:19.153765+0000","last_became_peered":"2024-09-21T09:13:19.153765+0000","last_unstale":"2024-09-21T09:14:14.985468+0000","last_undegraded":"2024-09-21T09:14:14.985468+0000","last_fullsized":"2024-09-21T09:14:14.985468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:14.985207+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:14.985207+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.985207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:41.152678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'6","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.503346+0000","last_change":"2024-09-21T09:14:11.503406+0000","last_active":"2024-09-21T09:14:11.503346+0000","last_peered":"2024-09-21T09:14:11.503346+0000","last_clean":"2024-09-21T09:14:11.503346+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:14:11.503346+0000","last_undegraded":"2024-09-21T09:14:11.503346+0000","last_fullsized":"2024-09-21T09:14:11.503346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-09-21T09:14:11.503143+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-09-21T09:14:11.503143+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.503143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:59.824868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"91'14","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:50.681288+0000","last_change":"2024-09-21T09:13:50.681323+0000","last_active":"2024-09-21T09:13:50.681288+0000","last_peered":"2024-09-21T09:13:50.681288+0000","last_clean":"2024-09-21T09:13:50.681288+0000","last_became_active":"2024-09-21T09:13:19.143052+0000","last_became_peered":"2024-09-21T09:13:19.143052+0000","last_unstale":"2024-09-21T09:13:50.681288+0000","last_undegraded":"2024-09-21T09:13:50.681288+0000","last_fullsized":"2024-09-21T09:13:50.681288+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:13:50.681171+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:13:50.681171+0000","last_clean_scrub_stamp":"2024-09-21T09:13:50.681171+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:45.116569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"71'8","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.803558+0000","last_change":"2024-09-21T09:14:09.803621+0000","last_active":"2024-09-21T09:14:09.803558+0000","last_peered":"2024-09-21T09:14:09.803558+0000","last_clean":"2024-09-21T09:14:09.803558+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:14:09.803558+0000","last_undegraded":"2024-09-21T09:14:09.803558+0000","last_fullsized":"2024-09-21T09:14:09.803558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'8","last_scrub_stamp":"2024-09-21T09:14:09.803351+0000","last_deep_scrub":"71'8","last_deep_scrub_stamp":"2024-09-21T09:14:09.803351+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.803351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:22.726504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"91'16","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.828782+0000","last_change":"2024-09-21T09:14:03.828841+0000","last_active":"2024-09-21T09:14:03.828782+0000","last_peered":"2024-09-21T09:14:03.828782+0000","last_clean":"2024-09-21T09:14:03.828782+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:14:03.828782+0000","last_undegraded":"2024-09-21T09:14:03.828782+0000","last_fullsized":"2024-09-21T09:14:03.828782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:03.828580+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:03.828580+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.828580+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:27.975861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.326876+0000","last_change":"2024-09-21T09:14:12.326945+0000","last_active":"2024-09-21T09:14:12.326876+0000","last_peered":"2024-09-21T09:14:12.326876+0000","last_clean":"2024-09-21T09:14:12.326876+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:14:12.326876+0000","last_undegraded":"2024-09-21T09:14:12.326876+0000","last_fullsized":"2024-09-21T09:14:12.326876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:12.326655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:12.326655+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.326655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:32.984164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.343011+0000","last_change":"2024-09-21T09:14:16.343071+0000","last_active":"2024-09-21T09:14:16.343011+0000","last_peered":"2024-09-21T09:14:16.343011+0000","last_clean":"2024-09-21T09:14:16.343011+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:14:16.343011+0000","last_undegraded":"2024-09-21T09:14:16.343011+0000","last_fullsized":"2024-09-21T09:14:16.343011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:16.342810+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:16.342810+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.342810+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.019749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"58'4","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:27.951107+0000","last_change":"2024-09-21T09:14:27.951140+0000","last_active":"2024-09-21T09:14:27.951107+0000","last_peered":"2024-09-21T09:14:27.951107+0000","last_clean":"2024-09-21T09:14:27.951107+0000","last_became_active":"2024-09-21T09:13:19.169698+0000","last_became_peered":"2024-09-21T09:13:19.169698+0000","last_unstale":"2024-09-21T09:14:27.951107+0000","last_undegraded":"2024-09-21T09:14:27.951107+0000","last_fullsized":"2024-09-21T09:14:27.951107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'4","last_scrub_stamp":"2024-09-21T09:14:27.950996+0000","last_deep_scrub":"58'4","last_deep_scrub_stamp":"2024-09-21T09:14:27.950996+0000","last_clean_scrub_stamp":"2024-09-21T09:14:27.950996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:06.279478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"91'12","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.950158+0000","last_change":"2024-09-21T09:14:08.950286+0000","last_active":"2024-09-21T09:14:08.950158+0000","last_peered":"2024-09-21T09:14:08.950158+0000","last_clean":"2024-09-21T09:14:08.950158+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:14:08.950158+0000","last_undegraded":"2024-09-21T09:14:08.950158+0000","last_fullsized":"2024-09-21T09:14:08.950158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-21T09:14:08.949916+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-21T09:14:08.949916+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.949916+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:37.711136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"58'6","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.991436+0000","last_change":"2024-09-21T09:14:00.991495+0000","last_active":"2024-09-21T09:14:00.991436+0000","last_peered":"2024-09-21T09:14:00.991436+0000","last_clean":"2024-09-21T09:14:00.991436+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:14:00.991436+0000","last_undegraded":"2024-09-21T09:14:00.991436+0000","last_fullsized":"2024-09-21T09:14:00.991436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'6","last_scrub_stamp":"2024-09-21T09:14:00.991188+0000","last_deep_scrub":"58'6","last_deep_scrub_stamp":"2024-09-21T09:14:00.991188+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.991188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:38.933444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"91'16","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.808170+0000","last_change":"2024-09-21T09:14:07.808227+0000","last_active":"2024-09-21T09:14:07.808170+0000","last_peered":"2024-09-21T09:14:07.808170+0000","last_clean":"2024-09-21T09:14:07.808170+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:14:07.808170+0000","last_undegraded":"2024-09-21T09:14:07.808170+0000","last_fullsized":"2024-09-21T09:14:07.808170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:07.807970+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:07.807970+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.807970+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:52.957059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"71'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.178229+0000","last_change":"2024-09-21T09:13:56.178383+0000","last_active":"2024-09-21T09:13:56.178229+0000","last_peered":"2024-09-21T09:13:56.178229+0000","last_clean":"2024-09-21T09:13:56.178229+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:13:56.178229+0000","last_undegraded":"2024-09-21T09:13:56.178229+0000","last_fullsized":"2024-09-21T09:13:56.178229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:56.177990+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:56.177990+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.177990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:49.376423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"91'16","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.851375+0000","last_change":"2024-09-21T09:14:09.851439+0000","last_active":"2024-09-21T09:14:09.851375+0000","last_peered":"2024-09-21T09:14:09.851375+0000","last_clean":"2024-09-21T09:14:09.851375+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:14:09.851375+0000","last_undegraded":"2024-09-21T09:14:09.851375+0000","last_fullsized":"2024-09-21T09:14:09.851375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:09.851186+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:09.851186+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.851186+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:16.130560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"62'2","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.915466+0000","last_change":"2024-09-21T09:14:11.915637+0000","last_active":"2024-09-21T09:14:11.915466+0000","last_peered":"2024-09-21T09:14:11.915466+0000","last_clean":"2024-09-21T09:14:11.915466+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:14:11.915466+0000","last_undegraded":"2024-09-21T09:14:11.915466+0000","last_fullsized":"2024-09-21T09:14:11.915466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:11.915220+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:11.915220+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.915220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:14.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"91'18","reported_seq":78,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.731811+0000","last_change":"2024-09-21T09:14:10.731967+0000","last_active":"2024-09-21T09:14:10.731811+0000","last_peered":"2024-09-21T09:14:10.731811+0000","last_clean":"2024-09-21T09:14:10.731811+0000","last_became_active":"2024-09-21T09:13:19.161214+0000","last_became_peered":"2024-09-21T09:13:19.161214+0000","last_unstale":"2024-09-21T09:14:10.731811+0000","last_undegraded":"2024-09-21T09:14:10.731811+0000","last_fullsized":"2024-09-21T09:14:10.731811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:10.731581+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:10.731581+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.731581+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:36.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"62'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.736604+0000","last_change":"2024-09-21T09:13:51.736626+0000","last_active":"2024-09-21T09:13:51.736604+0000","last_peered":"2024-09-21T09:13:51.736604+0000","last_clean":"2024-09-21T09:13:51.736604+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:13:51.736604+0000","last_undegraded":"2024-09-21T09:13:51.736604+0000","last_fullsized":"2024-09-21T09:13:51.736604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:51.736518+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:51.736518+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.736518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:14.149656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"91'18","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:18.059723+0000","last_change":"2024-09-21T09:14:18.059791+0000","last_active":"2024-09-21T09:14:18.059723+0000","last_peered":"2024-09-21T09:14:18.059723+0000","last_clean":"2024-09-21T09:14:18.059723+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:14:18.059723+0000","last_undegraded":"2024-09-21T09:14:18.059723+0000","last_fullsized":"2024-09-21T09:14:18.059723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:18.059533+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:18.059533+0000","last_clean_scrub_stamp":"2024-09-21T09:14:18.059533+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:53.020993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"71'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.856039+0000","last_change":"2024-09-21T09:14:07.856104+0000","last_active":"2024-09-21T09:14:07.856039+0000","last_peered":"2024-09-21T09:14:07.856039+0000","last_clean":"2024-09-21T09:14:07.856039+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:14:07.856039+0000","last_undegraded":"2024-09-21T09:14:07.856039+0000","last_fullsized":"2024-09-21T09:14:07.856039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:14:07.855831+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:14:07.855831+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.855831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:24.371959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"91'14","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:20.280021+0000","last_change":"2024-09-21T09:14:20.280079+0000","last_active":"2024-09-21T09:14:20.280021+0000","last_peered":"2024-09-21T09:14:20.280021+0000","last_clean":"2024-09-21T09:14:20.280021+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:14:20.280021+0000","last_undegraded":"2024-09-21T09:14:20.280021+0000","last_fullsized":"2024-09-21T09:14:20.280021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:20.279832+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:20.279832+0000","last_clean_scrub_stamp":"2024-09-21T09:14:20.279832+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:15.343840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"62'2","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.135852+0000","last_change":"2024-09-21T09:13:52.135885+0000","last_active":"2024-09-21T09:13:52.135852+0000","last_peered":"2024-09-21T09:13:52.135852+0000","last_clean":"2024-09-21T09:13:52.135852+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:13:52.135852+0000","last_undegraded":"2024-09-21T09:13:52.135852+0000","last_fullsized":"2024-09-21T09:13:52.135852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:52.135752+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:52.135752+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.135752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:56.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"91'24","reported_seq":236,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:26.022884+0000","last_change":"2024-09-21T09:14:26.022947+0000","last_active":"2024-09-21T09:14:26.022884+0000","last_peered":"2024-09-21T09:14:26.022884+0000","last_clean":"2024-09-21T09:14:26.022884+0000","last_became_active":"2024-09-21T09:13:19.169480+0000","last_became_peered":"2024-09-21T09:13:19.169480+0000","last_unstale":"2024-09-21T09:14:26.022884+0000","last_undegraded":"2024-09-21T09:14:26.022884+0000","last_fullsized":"2024-09-21T09:14:26.022884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:26.022690+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:26.022690+0000","last_clean_scrub_stamp":"2024-09-21T09:14:26.022690+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:20.797748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.946506+0000","last_change":"2024-09-21T09:14:02.946557+0000","last_active":"2024-09-21T09:14:02.946506+0000","last_peered":"2024-09-21T09:14:02.946506+0000","last_clean":"2024-09-21T09:14:02.946506+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:14:02.946506+0000","last_undegraded":"2024-09-21T09:14:02.946506+0000","last_fullsized":"2024-09-21T09:14:02.946506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:02.946351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:02.946351+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.946351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:48.095441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.885130+0000","last_change":"2024-09-21T09:14:05.885193+0000","last_active":"2024-09-21T09:14:05.885130+0000","last_peered":"2024-09-21T09:14:05.885130+0000","last_clean":"2024-09-21T09:14:05.885130+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:14:05.885130+0000","last_undegraded":"2024-09-21T09:14:05.885130+0000","last_fullsized":"2024-09-21T09:14:05.885130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-21T09:14:05.884933+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-21T09:14:05.884933+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.884933+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:19.026961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.775875+0000","last_change":"2024-09-21T09:13:53.775933+0000","last_active":"2024-09-21T09:13:53.775875+0000","last_peered":"2024-09-21T09:13:53.775875+0000","last_clean":"2024-09-21T09:13:53.775875+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:13:53.775875+0000","last_undegraded":"2024-09-21T09:13:53.775875+0000","last_fullsized":"2024-09-21T09:13:53.775875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:53.775675+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:53.775675+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.775675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:07.988041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'26","reported_seq":244,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:25.502071+0000","last_change":"2024-09-21T09:14:25.502130+0000","last_active":"2024-09-21T09:14:25.502071+0000","last_peered":"2024-09-21T09:14:25.502071+0000","last_clean":"2024-09-21T09:14:25.502071+0000","last_became_active":"2024-09-21T09:13:19.153073+0000","last_became_peered":"2024-09-21T09:13:19.153073+0000","last_unstale":"2024-09-21T09:14:25.502071+0000","last_undegraded":"2024-09-21T09:14:25.502071+0000","last_fullsized":"2024-09-21T09:14:25.502071+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:25.501877+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:25.501877+0000","last_clean_scrub_stamp":"2024-09-21T09:14:25.501877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:04.290812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.828058+0000","last_change":"2024-09-21T09:13:55.828116+0000","last_active":"2024-09-21T09:13:55.828058+0000","last_peered":"2024-09-21T09:13:55.828058+0000","last_clean":"2024-09-21T09:13:55.828058+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:13:55.828058+0000","last_undegraded":"2024-09-21T09:13:55.828058+0000","last_fullsized":"2024-09-21T09:13:55.828058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:55.827822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:55.827822+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.827822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:50.263220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"91'26","reported_seq":177,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.093705+0000","last_change":"2024-09-21T09:14:01.093772+0000","last_active":"2024-09-21T09:14:01.093705+0000","last_peered":"2024-09-21T09:14:01.093705+0000","last_clean":"2024-09-21T09:14:01.093705+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:14:01.093705+0000","last_undegraded":"2024-09-21T09:14:01.093705+0000","last_fullsized":"2024-09-21T09:14:01.093705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:01.093485+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:01.093485+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.093485+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:17.609612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.863628+0000","last_change":"2024-09-21T09:13:59.863692+0000","last_active":"2024-09-21T09:13:59.863628+0000","last_peered":"2024-09-21T09:13:59.863628+0000","last_clean":"2024-09-21T09:13:59.863628+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:13:59.863628+0000","last_undegraded":"2024-09-21T09:13:59.863628+0000","last_fullsized":"2024-09-21T09:13:59.863628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-21T09:13:59.863431+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-21T09:13:59.863431+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.863431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:00.320615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"91'10","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:29.134328+0000","last_change":"2024-09-21T09:14:29.134390+0000","last_active":"2024-09-21T09:14:29.134328+0000","last_peered":"2024-09-21T09:14:29.134328+0000","last_clean":"2024-09-21T09:14:29.134328+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:14:29.134328+0000","last_undegraded":"2024-09-21T09:14:29.134328+0000","last_fullsized":"2024-09-21T09:14:29.134328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-21T09:14:29.134141+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-21T09:14:29.134141+0000","last_clean_scrub_stamp":"2024-09-21T09:14:29.134141+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:15.001650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"71'4","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:18.466107+0000","last_change":"2024-09-21T09:14:18.466171+0000","last_active":"2024-09-21T09:14:18.466107+0000","last_peered":"2024-09-21T09:14:18.466107+0000","last_clean":"2024-09-21T09:14:18.466107+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:14:18.466107+0000","last_undegraded":"2024-09-21T09:14:18.466107+0000","last_fullsized":"2024-09-21T09:14:18.466107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:14:18.465902+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:14:18.465902+0000","last_clean_scrub_stamp":"2024-09-21T09:14:18.465902+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:10:06.223698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"91'18","reported_seq":219,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.734470+0000","last_change":"2024-09-21T09:14:17.734528+0000","last_active":"2024-09-21T09:14:17.734470+0000","last_peered":"2024-09-21T09:14:17.734470+0000","last_clean":"2024-09-21T09:14:17.734470+0000","last_became_active":"2024-09-21T09:13:19.159408+0000","last_became_peered":"2024-09-21T09:13:19.159408+0000","last_unstale":"2024-09-21T09:14:17.734470+0000","last_undegraded":"2024-09-21T09:14:17.734470+0000","last_fullsized":"2024-09-21T09:14:17.734470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:17.734276+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:17.734276+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.734276+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:50:48.160931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.792880+0000","last_change":"2024-09-21T09:13:59.793061+0000","last_active":"2024-09-21T09:13:59.792880+0000","last_peered":"2024-09-21T09:13:59.792880+0000","last_clean":"2024-09-21T09:13:59.792880+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:13:59.792880+0000","last_undegraded":"2024-09-21T09:13:59.792880+0000","last_fullsized":"2024-09-21T09:13:59.792880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-09-21T09:13:59.792653+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-09-21T09:13:59.792653+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.792653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:48.291820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:22.251171+0000","last_change":"2024-09-21T09:14:22.251257+0000","last_active":"2024-09-21T09:14:22.251171+0000","last_peered":"2024-09-21T09:14:22.251171+0000","last_clean":"2024-09-21T09:14:22.251171+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:14:22.251171+0000","last_undegraded":"2024-09-21T09:14:22.251171+0000","last_fullsized":"2024-09-21T09:14:22.251171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:22.250962+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:22.250962+0000","last_clean_scrub_stamp":"2024-09-21T09:14:22.250962+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:09.182054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"91'16","reported_seq":203,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:45.566496+0000","last_change":"2024-09-21T09:13:20.828458+0000","last_active":"2024-09-21T09:13:45.566496+0000","last_peered":"2024-09-21T09:13:45.566496+0000","last_clean":"2024-09-21T09:13:45.566496+0000","last_became_active":"2024-09-21T09:13:19.155182+0000","last_became_peered":"2024-09-21T09:13:19.155182+0000","last_unstale":"2024-09-21T09:13:45.566496+0000","last_undegraded":"2024-09-21T09:13:45.566496+0000","last_fullsized":"2024-09-21T09:13:45.566496+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:10:55.793241+0000","last_clean_scrub_stamp":"2024-09-21T09:10:55.793241+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.450792+0000","last_change":"2024-09-21T09:14:01.450850+0000","last_active":"2024-09-21T09:14:01.450792+0000","last_peered":"2024-09-21T09:14:01.450792+0000","last_clean":"2024-09-21T09:14:01.450792+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:14:01.450792+0000","last_undegraded":"2024-09-21T09:14:01.450792+0000","last_fullsized":"2024-09-21T09:14:01.450792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.450595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.450595+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.450595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:47.258642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"91'20","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:19.039322+0000","last_change":"2024-09-21T09:14:19.039383+0000","last_active":"2024-09-21T09:14:19.039322+0000","last_peered":"2024-09-21T09:14:19.039322+0000","last_clean":"2024-09-21T09:14:19.039322+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:14:19.039322+0000","last_undegraded":"2024-09-21T09:14:19.039322+0000","last_fullsized":"2024-09-21T09:14:19.039322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:14:19.039101+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:14:19.039101+0000","last_clean_scrub_stamp":"2024-09-21T09:14:19.039101+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:34.090036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"62'4","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.879373+0000","last_change":"2024-09-21T09:14:10.879439+0000","last_active":"2024-09-21T09:14:10.879373+0000","last_peered":"2024-09-21T09:14:10.879373+0000","last_clean":"2024-09-21T09:14:10.879373+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:14:10.879373+0000","last_undegraded":"2024-09-21T09:14:10.879373+0000","last_fullsized":"2024-09-21T09:14:10.879373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:10.879175+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:10.879175+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.879175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:17.158549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":233,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":848,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":845,"ondisk_log_size":845,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1023,"num_read_kb":1069,"num_write":533,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":660,"num_keys_recovered":24,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3062,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":909,"ondisk_log_size":909,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":250,"num_read_kb":250,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":545,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":23,"num_write":1216,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":1149239296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1110016,"data_stored":600664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335416,"statfs":{"total":96636764160,"available":96599465984,"internally_reserved":0,"allocated":1105920,"data_stored":599726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41164,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330676,"statfs":{"total":96636764160,"available":96594612224,"internally_reserved":0,"allocated":1699840,"data_stored":1190185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335420,"statfs":{"total":96636764160,"available":96599470080,"internally_reserved":0,"allocated":1101824,"data_stored":599552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40564,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331276,"statfs":{"total":96636764160,"available":96595226624,"internally_reserved":0,"allocated":1085440,"data_stored":599593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41188,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330652,"statfs":{"total":96636764160,"available":96594587648,"internally_reserved":0,"allocated":1724416,"data_stored":1190679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509490,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1134592,"data_stored":601322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40592,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331248,"statfs":{"total":96636764160,"available":96595197952,"internally_reserved":0,"allocated":1114112,"data_stored":600299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:14:33.316 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:33.317 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:33.318 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-21T09:11:05.843867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:33.318 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:33.318 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-21T09:11:01.814359+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:33.319 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-21T09:10:55.793241+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=9, tm_min=13, tm_sec=47, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T09:14:33.319 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T09:14:53.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T09:14:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T09:14:53.696 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T09:14:53.711 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-21T09:14:53.062874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615632,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":2792,"num_read_kb":2220,"num_write":2385,"num_write_kb":2368156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":1149241676,"num_keys_recovered":26,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5468,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3393,"ondisk_log_size":3393,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309232,"kb_used_data":9840,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754665488,"statfs":{"total":773094113280,"available":772777459712,"internally_reserved":0,"allocated":10076160,"data_stored":5982020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006618"},"pg_stats":[{"pgid":"3.3f","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.061384+0000","last_change":"2024-09-21T09:14:03.061447+0000","last_active":"2024-09-21T09:14:03.061384+0000","last_peered":"2024-09-21T09:14:03.061384+0000","last_clean":"2024-09-21T09:14:03.061384+0000","last_became_active":"2024-09-21T09:10:56.845675+0000","last_became_peered":"2024-09-21T09:10:56.845675+0000","last_unstale":"2024-09-21T09:14:03.061384+0000","last_undegraded":"2024-09-21T09:14:03.061384+0000","last_fullsized":"2024-09-21T09:14:03.061384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:03.061173+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:03.061173+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.061173+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:11.592534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"58'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.847654+0000","last_change":"2024-09-21T09:14:03.847717+0000","last_active":"2024-09-21T09:14:03.847654+0000","last_peered":"2024-09-21T09:14:03.847654+0000","last_clean":"2024-09-21T09:14:03.847654+0000","last_became_active":"2024-09-21T09:10:58.836611+0000","last_became_peered":"2024-09-21T09:10:58.836611+0000","last_unstale":"2024-09-21T09:14:03.847654+0000","last_undegraded":"2024-09-21T09:14:03.847654+0000","last_fullsized":"2024-09-21T09:14:03.847654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:03.847431+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:03.847431+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.847431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:12.378793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"91'26","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:21.086497+0000","last_change":"2024-09-21T09:14:21.086645+0000","last_active":"2024-09-21T09:14:21.086497+0000","last_peered":"2024-09-21T09:14:21.086497+0000","last_clean":"2024-09-21T09:14:21.086497+0000","last_became_active":"2024-09-21T09:10:56.863213+0000","last_became_peered":"2024-09-21T09:10:56.863213+0000","last_unstale":"2024-09-21T09:14:21.086497+0000","last_undegraded":"2024-09-21T09:14:21.086497+0000","last_fullsized":"2024-09-21T09:14:21.086497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:21.086242+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:21.086242+0000","last_clean_scrub_stamp":"2024-09-21T09:14:21.086242+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:28.544266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"58'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.394742+0000","last_change":"2024-09-21T09:14:14.394805+0000","last_active":"2024-09-21T09:14:14.394742+0000","last_peered":"2024-09-21T09:14:14.394742+0000","last_clean":"2024-09-21T09:14:14.394742+0000","last_became_active":"2024-09-21T09:10:58.834872+0000","last_became_peered":"2024-09-21T09:10:58.834872+0000","last_unstale":"2024-09-21T09:14:14.394742+0000","last_undegraded":"2024-09-21T09:14:14.394742+0000","last_fullsized":"2024-09-21T09:14:14.394742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:14.394501+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:14.394501+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.394501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:26.771945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"91'26","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.035293+0000","last_change":"2024-09-21T09:14:17.035357+0000","last_active":"2024-09-21T09:14:17.035293+0000","last_peered":"2024-09-21T09:14:17.035293+0000","last_clean":"2024-09-21T09:14:17.035293+0000","last_became_active":"2024-09-21T09:10:56.860793+0000","last_became_peered":"2024-09-21T09:10:56.860793+0000","last_unstale":"2024-09-21T09:14:17.035293+0000","last_undegraded":"2024-09-21T09:14:17.035293+0000","last_fullsized":"2024-09-21T09:14:17.035293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:17.035106+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:17.035106+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.035106+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:20.467139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.267569+0000","last_change":"2024-09-21T09:14:05.267629+0000","last_active":"2024-09-21T09:14:05.267569+0000","last_peered":"2024-09-21T09:14:05.267569+0000","last_clean":"2024-09-21T09:14:05.267569+0000","last_became_active":"2024-09-21T09:13:19.153424+0000","last_became_peered":"2024-09-21T09:13:19.153424+0000","last_unstale":"2024-09-21T09:14:05.267569+0000","last_undegraded":"2024-09-21T09:14:05.267569+0000","last_fullsized":"2024-09-21T09:14:05.267569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:05.267355+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:05.267355+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.267355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:37.100982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"91'26","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.731202+0000","last_change":"2024-09-21T09:14:15.731264+0000","last_active":"2024-09-21T09:14:15.731202+0000","last_peered":"2024-09-21T09:14:15.731202+0000","last_clean":"2024-09-21T09:14:15.731202+0000","last_became_active":"2024-09-21T09:13:19.165441+0000","last_became_peered":"2024-09-21T09:13:19.165441+0000","last_unstale":"2024-09-21T09:14:15.731202+0000","last_undegraded":"2024-09-21T09:14:15.731202+0000","last_fullsized":"2024-09-21T09:14:15.731202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:15.731002+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:15.731002+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.731002+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:13.397919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"58'4","reported_seq":180,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:26.475060+0000","last_change":"2024-09-21T09:14:26.475130+0000","last_active":"2024-09-21T09:14:26.475060+0000","last_peered":"2024-09-21T09:14:26.475060+0000","last_clean":"2024-09-21T09:14:26.475060+0000","last_became_active":"2024-09-21T09:13:19.153875+0000","last_became_peered":"2024-09-21T09:13:19.153875+0000","last_unstale":"2024-09-21T09:14:26.475060+0000","last_undegraded":"2024-09-21T09:14:26.475060+0000","last_fullsized":"2024-09-21T09:14:26.475060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'4","last_scrub_stamp":"2024-09-21T09:14:26.474828+0000","last_deep_scrub":"58'4","last_deep_scrub_stamp":"2024-09-21T09:14:26.474828+0000","last_clean_scrub_stamp":"2024-09-21T09:14:26.474828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:01.650953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.138277+0000","last_change":"2024-09-21T09:14:00.138467+0000","last_active":"2024-09-21T09:14:00.138277+0000","last_peered":"2024-09-21T09:14:00.138277+0000","last_clean":"2024-09-21T09:14:00.138277+0000","last_became_active":"2024-09-21T09:10:56.862864+0000","last_became_peered":"2024-09-21T09:10:56.862864+0000","last_unstale":"2024-09-21T09:14:00.138277+0000","last_undegraded":"2024-09-21T09:14:00.138277+0000","last_fullsized":"2024-09-21T09:14:00.138277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:00.138047+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:00.138047+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.138047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:33.277620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"62'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.152966+0000","last_change":"2024-09-21T09:13:54.153056+0000","last_active":"2024-09-21T09:13:54.152966+0000","last_peered":"2024-09-21T09:13:54.152966+0000","last_clean":"2024-09-21T09:13:54.152966+0000","last_became_active":"2024-09-21T09:10:58.850997+0000","last_became_peered":"2024-09-21T09:10:58.850997+0000","last_unstale":"2024-09-21T09:13:54.152966+0000","last_undegraded":"2024-09-21T09:13:54.152966+0000","last_fullsized":"2024-09-21T09:13:54.152966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:13:54.152764+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:13:54.152764+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.152764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:11.947460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"91'12","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.677538+0000","last_change":"2024-09-21T09:13:57.677688+0000","last_active":"2024-09-21T09:13:57.677538+0000","last_peered":"2024-09-21T09:13:57.677538+0000","last_clean":"2024-09-21T09:13:57.677538+0000","last_became_active":"2024-09-21T09:13:19.160915+0000","last_became_peered":"2024-09-21T09:13:19.160915+0000","last_unstale":"2024-09-21T09:13:57.677538+0000","last_undegraded":"2024-09-21T09:13:57.677538+0000","last_fullsized":"2024-09-21T09:13:57.677538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-21T09:13:57.677253+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-21T09:13:57.677253+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.677253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:29.035343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"58'2","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.096228+0000","last_change":"2024-09-21T09:13:58.096313+0000","last_active":"2024-09-21T09:13:58.096228+0000","last_peered":"2024-09-21T09:13:58.096228+0000","last_clean":"2024-09-21T09:13:58.096228+0000","last_became_active":"2024-09-21T09:10:58.824702+0000","last_became_peered":"2024-09-21T09:10:58.824702+0000","last_unstale":"2024-09-21T09:13:58.096228+0000","last_undegraded":"2024-09-21T09:13:58.096228+0000","last_fullsized":"2024-09-21T09:13:58.096228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:58.095982+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:58.095982+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.095982+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:22.243263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"91'10","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.974433+0000","last_change":"2024-09-21T09:14:04.974493+0000","last_active":"2024-09-21T09:14:04.974433+0000","last_peered":"2024-09-21T09:14:04.974433+0000","last_clean":"2024-09-21T09:14:04.974433+0000","last_became_active":"2024-09-21T09:10:56.848132+0000","last_became_peered":"2024-09-21T09:10:56.848132+0000","last_unstale":"2024-09-21T09:14:04.974433+0000","last_undegraded":"2024-09-21T09:14:04.974433+0000","last_fullsized":"2024-09-21T09:14:04.974433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-21T09:14:04.974240+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-21T09:14:04.974240+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.974240+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:18.116269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"62'4","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.743301+0000","last_change":"2024-09-21T09:14:13.743489+0000","last_active":"2024-09-21T09:14:13.743301+0000","last_peered":"2024-09-21T09:14:13.743301+0000","last_clean":"2024-09-21T09:14:13.743301+0000","last_became_active":"2024-09-21T09:13:19.164775+0000","last_became_peered":"2024-09-21T09:13:19.164775+0000","last_unstale":"2024-09-21T09:14:13.743301+0000","last_undegraded":"2024-09-21T09:14:13.743301+0000","last_fullsized":"2024-09-21T09:14:13.743301+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:13.743066+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:13.743066+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.743066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:51.529587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"91'22","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:20.057163+0000","last_change":"2024-09-21T09:14:20.057227+0000","last_active":"2024-09-21T09:14:20.057163+0000","last_peered":"2024-09-21T09:14:20.057163+0000","last_clean":"2024-09-21T09:14:20.057163+0000","last_became_active":"2024-09-21T09:10:56.860925+0000","last_became_peered":"2024-09-21T09:10:56.860925+0000","last_unstale":"2024-09-21T09:14:20.057163+0000","last_undegraded":"2024-09-21T09:14:20.057163+0000","last_fullsized":"2024-09-21T09:14:20.057163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:20.056974+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:20.056974+0000","last_clean_scrub_stamp":"2024-09-21T09:14:20.056974+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:24.843232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"62'4","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.981636+0000","last_change":"2024-09-21T09:14:06.981706+0000","last_active":"2024-09-21T09:14:06.981636+0000","last_peered":"2024-09-21T09:14:06.981636+0000","last_clean":"2024-09-21T09:14:06.981636+0000","last_became_active":"2024-09-21T09:10:58.836241+0000","last_became_peered":"2024-09-21T09:10:58.836241+0000","last_unstale":"2024-09-21T09:14:06.981636+0000","last_undegraded":"2024-09-21T09:14:06.981636+0000","last_fullsized":"2024-09-21T09:14:06.981636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:06.981436+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:06.981436+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.981436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:09.653181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"61'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.365294+0000","last_change":"2024-09-21T09:14:13.365384+0000","last_active":"2024-09-21T09:14:13.365294+0000","last_peered":"2024-09-21T09:14:13.365294+0000","last_clean":"2024-09-21T09:14:13.365294+0000","last_became_active":"2024-09-21T09:10:58.852948+0000","last_became_peered":"2024-09-21T09:10:58.852948+0000","last_unstale":"2024-09-21T09:14:13.365294+0000","last_undegraded":"2024-09-21T09:14:13.365294+0000","last_fullsized":"2024-09-21T09:14:13.365294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-21T09:14:13.365083+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-21T09:14:13.365083+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.365083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:01:20.956269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.878513+0000","last_change":"2024-09-21T09:14:06.878576+0000","last_active":"2024-09-21T09:14:06.878513+0000","last_peered":"2024-09-21T09:14:06.878513+0000","last_clean":"2024-09-21T09:14:06.878513+0000","last_became_active":"2024-09-21T09:10:56.838641+0000","last_became_peered":"2024-09-21T09:10:56.838641+0000","last_unstale":"2024-09-21T09:14:06.878513+0000","last_undegraded":"2024-09-21T09:14:06.878513+0000","last_fullsized":"2024-09-21T09:14:06.878513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:06.878320+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:06.878320+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.878320+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:44.820576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"71'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:50.084198+0000","last_change":"2024-09-21T09:13:50.084263+0000","last_active":"2024-09-21T09:13:50.084198+0000","last_peered":"2024-09-21T09:13:50.084198+0000","last_clean":"2024-09-21T09:13:50.084198+0000","last_became_active":"2024-09-21T09:10:58.868936+0000","last_became_peered":"2024-09-21T09:10:58.868936+0000","last_unstale":"2024-09-21T09:13:50.084198+0000","last_undegraded":"2024-09-21T09:13:50.084198+0000","last_fullsized":"2024-09-21T09:13:50.084198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:50.083977+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:50.083977+0000","last_clean_scrub_stamp":"2024-09-21T09:13:50.083977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:57.588236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"91'14","reported_seq":207,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.978319+0000","last_change":"2024-09-21T09:14:15.978466+0000","last_active":"2024-09-21T09:14:15.978319+0000","last_peered":"2024-09-21T09:14:15.978319+0000","last_clean":"2024-09-21T09:14:15.978319+0000","last_became_active":"2024-09-21T09:13:19.154413+0000","last_became_peered":"2024-09-21T09:13:19.154413+0000","last_unstale":"2024-09-21T09:14:15.978319+0000","last_undegraded":"2024-09-21T09:14:15.978319+0000","last_fullsized":"2024-09-21T09:14:15.978319+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:15.978087+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:15.978087+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.978087+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:13.503628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"71'8","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.796959+0000","last_change":"2024-09-21T09:13:57.797029+0000","last_active":"2024-09-21T09:13:57.796959+0000","last_peered":"2024-09-21T09:13:57.796959+0000","last_clean":"2024-09-21T09:13:57.796959+0000","last_became_active":"2024-09-21T09:10:58.840352+0000","last_became_peered":"2024-09-21T09:10:58.840352+0000","last_unstale":"2024-09-21T09:13:57.796959+0000","last_undegraded":"2024-09-21T09:13:57.796959+0000","last_fullsized":"2024-09-21T09:13:57.796959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'8","last_scrub_stamp":"2024-09-21T09:13:57.796750+0000","last_deep_scrub":"71'8","last_deep_scrub_stamp":"2024-09-21T09:13:57.796750+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.796750+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:50.919506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"91'18","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.990012+0000","last_change":"2024-09-21T09:14:05.990075+0000","last_active":"2024-09-21T09:14:05.990012+0000","last_peered":"2024-09-21T09:14:05.990012+0000","last_clean":"2024-09-21T09:14:05.990012+0000","last_became_active":"2024-09-21T09:10:56.852349+0000","last_became_peered":"2024-09-21T09:10:56.852349+0000","last_unstale":"2024-09-21T09:14:05.990012+0000","last_undegraded":"2024-09-21T09:14:05.990012+0000","last_fullsized":"2024-09-21T09:14:05.990012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:05.989826+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:05.989826+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.989826+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:43.932082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.744391+0000","last_change":"2024-09-21T09:14:01.744445+0000","last_active":"2024-09-21T09:14:01.744391+0000","last_peered":"2024-09-21T09:14:01.744391+0000","last_clean":"2024-09-21T09:14:01.744391+0000","last_became_active":"2024-09-21T09:10:58.837182+0000","last_became_peered":"2024-09-21T09:10:58.837182+0000","last_unstale":"2024-09-21T09:14:01.744391+0000","last_undegraded":"2024-09-21T09:14:01.744391+0000","last_fullsized":"2024-09-21T09:14:01.744391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.744166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.744166+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.744166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:18:14.274322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'20","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.046344+0000","last_change":"2024-09-21T09:14:02.046475+0000","last_active":"2024-09-21T09:14:02.046344+0000","last_peered":"2024-09-21T09:14:02.046344+0000","last_clean":"2024-09-21T09:14:02.046344+0000","last_became_active":"2024-09-21T09:10:56.845215+0000","last_became_peered":"2024-09-21T09:10:56.845215+0000","last_unstale":"2024-09-21T09:14:02.046344+0000","last_undegraded":"2024-09-21T09:14:02.046344+0000","last_fullsized":"2024-09-21T09:14:02.046344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:14:02.046101+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:14:02.046101+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.046101+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:33.404191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"62'8","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.974708+0000","last_change":"2024-09-21T09:13:58.974768+0000","last_active":"2024-09-21T09:13:58.974708+0000","last_peered":"2024-09-21T09:13:58.974708+0000","last_clean":"2024-09-21T09:13:58.974708+0000","last_became_active":"2024-09-21T09:10:58.847540+0000","last_became_peered":"2024-09-21T09:10:58.847540+0000","last_unstale":"2024-09-21T09:13:58.974708+0000","last_undegraded":"2024-09-21T09:13:58.974708+0000","last_fullsized":"2024-09-21T09:13:58.974708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-09-21T09:13:58.974520+0000","last_deep_scrub":"62'8","last_deep_scrub_stamp":"2024-09-21T09:13:58.974520+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.974520+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.120923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.800436+0000","last_change":"2024-09-21T09:14:06.800570+0000","last_active":"2024-09-21T09:14:06.800436+0000","last_peered":"2024-09-21T09:14:06.800436+0000","last_clean":"2024-09-21T09:14:06.800436+0000","last_became_active":"2024-09-21T09:10:56.858343+0000","last_became_peered":"2024-09-21T09:10:56.858343+0000","last_unstale":"2024-09-21T09:14:06.800436+0000","last_undegraded":"2024-09-21T09:14:06.800436+0000","last_fullsized":"2024-09-21T09:14:06.800436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:06.800170+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:06.800170+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.800170+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:10.673261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"62'4","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.909849+0000","last_change":"2024-09-21T09:14:11.909989+0000","last_active":"2024-09-21T09:14:11.909849+0000","last_peered":"2024-09-21T09:14:11.909849+0000","last_clean":"2024-09-21T09:14:11.909849+0000","last_became_active":"2024-09-21T09:10:58.829527+0000","last_became_peered":"2024-09-21T09:10:58.829527+0000","last_unstale":"2024-09-21T09:14:11.909849+0000","last_undegraded":"2024-09-21T09:14:11.909849+0000","last_fullsized":"2024-09-21T09:14:11.909849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:11.909588+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:11.909588+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.909588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:19.032107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"91'14","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.833412+0000","last_change":"2024-09-21T09:14:08.833503+0000","last_active":"2024-09-21T09:14:08.833412+0000","last_peered":"2024-09-21T09:14:08.833412+0000","last_clean":"2024-09-21T09:14:08.833412+0000","last_became_active":"2024-09-21T09:10:56.862135+0000","last_became_peered":"2024-09-21T09:10:56.862135+0000","last_unstale":"2024-09-21T09:14:08.833412+0000","last_undegraded":"2024-09-21T09:14:08.833412+0000","last_fullsized":"2024-09-21T09:14:08.833412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:08.833170+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:08.833170+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.833170+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:12.948905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":131,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.967482+0000","last_change":"2024-09-21T09:14:11.967544+0000","last_active":"2024-09-21T09:14:11.967482+0000","last_peered":"2024-09-21T09:14:11.967482+0000","last_clean":"2024-09-21T09:14:11.967482+0000","last_became_active":"2024-09-21T09:11:06.898048+0000","last_became_peered":"2024-09-21T09:11:06.898048+0000","last_unstale":"2024-09-21T09:14:11.967482+0000","last_undegraded":"2024-09-21T09:14:11.967482+0000","last_fullsized":"2024-09-21T09:14:11.967482+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:11.967286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:11.967286+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.967286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:14.639031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"62'4","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.614063+0000","last_change":"2024-09-21T09:13:55.614128+0000","last_active":"2024-09-21T09:13:55.614063+0000","last_peered":"2024-09-21T09:13:55.614063+0000","last_clean":"2024-09-21T09:13:55.614063+0000","last_became_active":"2024-09-21T09:10:58.875310+0000","last_became_peered":"2024-09-21T09:10:58.875310+0000","last_unstale":"2024-09-21T09:13:55.614063+0000","last_undegraded":"2024-09-21T09:13:55.614063+0000","last_fullsized":"2024-09-21T09:13:55.614063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:13:55.613858+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:13:55.613858+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.613858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:08:14.580524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"91'8","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:18.304045+0000","last_change":"2024-09-21T09:14:18.304104+0000","last_active":"2024-09-21T09:14:18.304045+0000","last_peered":"2024-09-21T09:14:18.304045+0000","last_clean":"2024-09-21T09:14:18.304045+0000","last_became_active":"2024-09-21T09:10:56.848242+0000","last_became_peered":"2024-09-21T09:10:56.848242+0000","last_unstale":"2024-09-21T09:14:18.304045+0000","last_undegraded":"2024-09-21T09:14:18.304045+0000","last_fullsized":"2024-09-21T09:14:18.304045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-09-21T09:14:18.303842+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-09-21T09:14:18.303842+0000","last_clean_scrub_stamp":"2024-09-21T09:14:18.303842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:45.573508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.318705+0000","last_change":"2024-09-21T09:14:17.318817+0000","last_active":"2024-09-21T09:14:17.318705+0000","last_peered":"2024-09-21T09:14:17.318705+0000","last_clean":"2024-09-21T09:14:17.318705+0000","last_became_active":"2024-09-21T09:11:00.841244+0000","last_became_peered":"2024-09-21T09:11:00.841244+0000","last_unstale":"2024-09-21T09:14:17.318705+0000","last_undegraded":"2024-09-21T09:14:17.318705+0000","last_fullsized":"2024-09-21T09:14:17.318705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:17.318395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:17.318395+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.318395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:19.551614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"91'21","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.583587+0000","last_change":"2024-09-21T09:14:08.583773+0000","last_active":"2024-09-21T09:14:08.583587+0000","last_peered":"2024-09-21T09:14:08.583587+0000","last_clean":"2024-09-21T09:14:08.583587+0000","last_became_active":"2024-09-21T09:11:02.865371+0000","last_became_peered":"2024-09-21T09:11:02.865371+0000","last_unstale":"2024-09-21T09:14:08.583587+0000","last_undegraded":"2024-09-21T09:14:08.583587+0000","last_fullsized":"2024-09-21T09:14:08.583587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'21","last_scrub_stamp":"2024-09-21T09:14:08.583349+0000","last_deep_scrub":"91'21","last_deep_scrub_stamp":"2024-09-21T09:14:08.583349+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.583349+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:15.068598+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.905332+0000","last_change":"2024-09-21T09:14:15.905470+0000","last_active":"2024-09-21T09:14:15.905332+0000","last_peered":"2024-09-21T09:14:15.905332+0000","last_clean":"2024-09-21T09:14:15.905332+0000","last_became_active":"2024-09-21T09:11:04.893986+0000","last_became_peered":"2024-09-21T09:11:04.893986+0000","last_unstale":"2024-09-21T09:14:15.905332+0000","last_undegraded":"2024-09-21T09:14:15.905332+0000","last_fullsized":"2024-09-21T09:14:15.905332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:15.905105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:15.905105+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.905105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:01.182452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"58'2","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:18.827285+0000","last_change":"2024-09-21T09:14:18.827352+0000","last_active":"2024-09-21T09:14:18.827285+0000","last_peered":"2024-09-21T09:14:18.827285+0000","last_clean":"2024-09-21T09:14:18.827285+0000","last_became_active":"2024-09-21T09:11:06.884705+0000","last_became_peered":"2024-09-21T09:11:06.884705+0000","last_unstale":"2024-09-21T09:14:18.827285+0000","last_undegraded":"2024-09-21T09:14:18.827285+0000","last_fullsized":"2024-09-21T09:14:18.827285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:18.827081+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:18.827081+0000","last_clean_scrub_stamp":"2024-09-21T09:14:18.827081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:49.751039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"61'6","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.282780+0000","last_change":"2024-09-21T09:14:11.282841+0000","last_active":"2024-09-21T09:14:11.282780+0000","last_peered":"2024-09-21T09:14:11.282780+0000","last_clean":"2024-09-21T09:14:11.282780+0000","last_became_active":"2024-09-21T09:10:58.842388+0000","last_became_peered":"2024-09-21T09:10:58.842388+0000","last_unstale":"2024-09-21T09:14:11.282780+0000","last_undegraded":"2024-09-21T09:14:11.282780+0000","last_fullsized":"2024-09-21T09:14:11.282780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'6","last_scrub_stamp":"2024-09-21T09:14:11.282569+0000","last_deep_scrub":"61'6","last_deep_scrub_stamp":"2024-09-21T09:14:11.282569+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.282569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:17.696437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"91'18","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.759573+0000","last_change":"2024-09-21T09:14:04.759638+0000","last_active":"2024-09-21T09:14:04.759573+0000","last_peered":"2024-09-21T09:14:04.759573+0000","last_clean":"2024-09-21T09:14:04.759573+0000","last_became_active":"2024-09-21T09:10:56.848540+0000","last_became_peered":"2024-09-21T09:10:56.848540+0000","last_unstale":"2024-09-21T09:14:04.759573+0000","last_undegraded":"2024-09-21T09:14:04.759573+0000","last_fullsized":"2024-09-21T09:14:04.759573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:04.759348+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:04.759348+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.759348+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.905751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:23.492672+0000","last_change":"2024-09-21T09:14:23.492729+0000","last_active":"2024-09-21T09:14:23.492672+0000","last_peered":"2024-09-21T09:14:23.492672+0000","last_clean":"2024-09-21T09:14:23.492672+0000","last_became_active":"2024-09-21T09:13:19.153940+0000","last_became_peered":"2024-09-21T09:13:19.153940+0000","last_unstale":"2024-09-21T09:14:23.492672+0000","last_undegraded":"2024-09-21T09:14:23.492672+0000","last_fullsized":"2024-09-21T09:14:23.492672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:23.492448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:23.492448+0000","last_clean_scrub_stamp":"2024-09-21T09:14:23.492448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:23.469154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"91'9","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.843790+0000","last_change":"2024-09-21T09:13:58.843868+0000","last_active":"2024-09-21T09:13:58.843790+0000","last_peered":"2024-09-21T09:13:58.843790+0000","last_clean":"2024-09-21T09:13:58.843790+0000","last_became_active":"2024-09-21T09:11:02.860915+0000","last_became_peered":"2024-09-21T09:11:02.860915+0000","last_unstale":"2024-09-21T09:13:58.843790+0000","last_undegraded":"2024-09-21T09:13:58.843790+0000","last_fullsized":"2024-09-21T09:13:58.843790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2024-09-21T09:13:58.843552+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2024-09-21T09:13:58.843552+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.843552+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:22.990833+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.917586+0000","last_change":"2024-09-21T09:14:12.917647+0000","last_active":"2024-09-21T09:14:12.917586+0000","last_peered":"2024-09-21T09:14:12.917586+0000","last_clean":"2024-09-21T09:14:12.917586+0000","last_became_active":"2024-09-21T09:11:04.886512+0000","last_became_peered":"2024-09-21T09:11:04.886512+0000","last_unstale":"2024-09-21T09:14:12.917586+0000","last_undegraded":"2024-09-21T09:14:12.917586+0000","last_fullsized":"2024-09-21T09:14:12.917586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:12.917360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:12.917360+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.917360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:15.589106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.963626+0000","last_change":"2024-09-21T09:14:15.963681+0000","last_active":"2024-09-21T09:14:15.963626+0000","last_peered":"2024-09-21T09:14:15.963626+0000","last_clean":"2024-09-21T09:14:15.963626+0000","last_became_active":"2024-09-21T09:13:19.144143+0000","last_became_peered":"2024-09-21T09:13:19.144143+0000","last_unstale":"2024-09-21T09:14:15.963626+0000","last_undegraded":"2024-09-21T09:14:15.963626+0000","last_fullsized":"2024-09-21T09:14:15.963626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:15.963428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:15.963428+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.963428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:53.743232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"71'10","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.956231+0000","last_change":"2024-09-21T09:13:57.956292+0000","last_active":"2024-09-21T09:13:57.956231+0000","last_peered":"2024-09-21T09:13:57.956231+0000","last_clean":"2024-09-21T09:13:57.956231+0000","last_became_active":"2024-09-21T09:10:58.850373+0000","last_became_peered":"2024-09-21T09:10:58.850373+0000","last_unstale":"2024-09-21T09:13:57.956231+0000","last_undegraded":"2024-09-21T09:13:57.956231+0000","last_fullsized":"2024-09-21T09:13:57.956231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:13:57.956033+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:13:57.956033+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.956033+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:06.487395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'8","reported_seq":187,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:34.066545+0000","last_change":"2024-09-21T09:14:34.066617+0000","last_active":"2024-09-21T09:14:34.066545+0000","last_peered":"2024-09-21T09:14:34.066545+0000","last_clean":"2024-09-21T09:14:34.066545+0000","last_became_active":"2024-09-21T09:13:19.159398+0000","last_became_peered":"2024-09-21T09:13:19.159398+0000","last_unstale":"2024-09-21T09:14:34.066545+0000","last_undegraded":"2024-09-21T09:14:34.066545+0000","last_fullsized":"2024-09-21T09:14:34.066545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-09-21T09:14:34.066343+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-09-21T09:14:34.066343+0000","last_clean_scrub_stamp":"2024-09-21T09:14:34.066343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:58:23.826285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.400845+0000","last_change":"2024-09-21T09:13:56.400898+0000","last_active":"2024-09-21T09:13:56.400845+0000","last_peered":"2024-09-21T09:13:56.400845+0000","last_clean":"2024-09-21T09:13:56.400845+0000","last_became_active":"2024-09-21T09:11:00.844957+0000","last_became_peered":"2024-09-21T09:11:00.844957+0000","last_unstale":"2024-09-21T09:13:56.400845+0000","last_undegraded":"2024-09-21T09:13:56.400845+0000","last_fullsized":"2024-09-21T09:13:56.400845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.400601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.400601+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.400601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:48.207738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"91'15","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.552383+0000","last_change":"2024-09-21T09:14:04.552575+0000","last_active":"2024-09-21T09:14:04.552383+0000","last_peered":"2024-09-21T09:14:04.552383+0000","last_clean":"2024-09-21T09:14:04.552383+0000","last_became_active":"2024-09-21T09:11:02.851763+0000","last_became_peered":"2024-09-21T09:11:02.851763+0000","last_unstale":"2024-09-21T09:14:04.552383+0000","last_undegraded":"2024-09-21T09:14:04.552383+0000","last_fullsized":"2024-09-21T09:14:04.552383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'15","last_scrub_stamp":"2024-09-21T09:14:04.552134+0000","last_deep_scrub":"91'15","last_deep_scrub_stamp":"2024-09-21T09:14:04.552134+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.552134+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:24.444742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"91'105","reported_seq":341,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.150427+0000","last_change":"2024-09-21T09:13:55.150488+0000","last_active":"2024-09-21T09:13:55.150427+0000","last_peered":"2024-09-21T09:13:55.150427+0000","last_clean":"2024-09-21T09:13:55.150427+0000","last_became_active":"2024-09-21T09:11:04.894498+0000","last_became_peered":"2024-09-21T09:11:04.894498+0000","last_unstale":"2024-09-21T09:13:55.150427+0000","last_undegraded":"2024-09-21T09:13:55.150427+0000","last_fullsized":"2024-09-21T09:13:55.150427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:13:55.150231+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:13:55.150231+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.150231+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:26.074188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.671622+0000","last_change":"2024-09-21T09:14:00.671677+0000","last_active":"2024-09-21T09:14:00.671622+0000","last_peered":"2024-09-21T09:14:00.671622+0000","last_clean":"2024-09-21T09:14:00.671622+0000","last_became_active":"2024-09-21T09:13:19.161659+0000","last_became_peered":"2024-09-21T09:13:19.161659+0000","last_unstale":"2024-09-21T09:14:00.671622+0000","last_undegraded":"2024-09-21T09:14:00.671622+0000","last_fullsized":"2024-09-21T09:14:00.671622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.671424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.671424+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.671424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:13.813452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"71'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.962824+0000","last_change":"2024-09-21T09:14:04.962963+0000","last_active":"2024-09-21T09:14:04.962824+0000","last_peered":"2024-09-21T09:14:04.962824+0000","last_clean":"2024-09-21T09:14:04.962824+0000","last_became_active":"2024-09-21T09:10:58.836506+0000","last_became_peered":"2024-09-21T09:10:58.836506+0000","last_unstale":"2024-09-21T09:14:04.962824+0000","last_undegraded":"2024-09-21T09:14:04.962824+0000","last_fullsized":"2024-09-21T09:14:04.962824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:14:04.962501+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:14:04.962501+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.962501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:11.241875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"91'34","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.867545+0000","last_change":"2024-09-21T09:14:07.867607+0000","last_active":"2024-09-21T09:14:07.867545+0000","last_peered":"2024-09-21T09:14:07.867545+0000","last_clean":"2024-09-21T09:14:07.867545+0000","last_became_active":"2024-09-21T09:10:56.844047+0000","last_became_peered":"2024-09-21T09:10:56.844047+0000","last_unstale":"2024-09-21T09:14:07.867545+0000","last_undegraded":"2024-09-21T09:14:07.867545+0000","last_fullsized":"2024-09-21T09:14:07.867545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'34","last_scrub_stamp":"2024-09-21T09:14:07.867323+0000","last_deep_scrub":"91'34","last_deep_scrub_stamp":"2024-09-21T09:14:07.867323+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.867323+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:11.740413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:31.052668+0000","last_change":"2024-09-21T09:14:31.052767+0000","last_active":"2024-09-21T09:14:31.052668+0000","last_peered":"2024-09-21T09:14:31.052668+0000","last_clean":"2024-09-21T09:14:31.052668+0000","last_became_active":"2024-09-21T09:11:00.852478+0000","last_became_peered":"2024-09-21T09:11:00.852478+0000","last_unstale":"2024-09-21T09:14:31.052668+0000","last_undegraded":"2024-09-21T09:14:31.052668+0000","last_fullsized":"2024-09-21T09:14:31.052668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:31.052425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:31.052425+0000","last_clean_scrub_stamp":"2024-09-21T09:14:31.052425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:39.514734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"91'21","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.718293+0000","last_change":"2024-09-21T09:13:55.718374+0000","last_active":"2024-09-21T09:13:55.718293+0000","last_peered":"2024-09-21T09:13:55.718293+0000","last_clean":"2024-09-21T09:13:55.718293+0000","last_became_active":"2024-09-21T09:13:19.160798+0000","last_became_peered":"2024-09-21T09:13:19.160798+0000","last_unstale":"2024-09-21T09:13:55.718293+0000","last_undegraded":"2024-09-21T09:13:55.718293+0000","last_fullsized":"2024-09-21T09:13:55.718293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'21","last_scrub_stamp":"2024-09-21T09:13:55.718093+0000","last_deep_scrub":"91'21","last_deep_scrub_stamp":"2024-09-21T09:13:55.718093+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.718093+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:28.857666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"91'105","reported_seq":315,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.953756+0000","last_change":"2024-09-21T09:13:54.953820+0000","last_active":"2024-09-21T09:13:54.953756+0000","last_peered":"2024-09-21T09:13:54.953756+0000","last_clean":"2024-09-21T09:13:54.953756+0000","last_became_active":"2024-09-21T09:11:04.892284+0000","last_became_peered":"2024-09-21T09:11:04.892284+0000","last_unstale":"2024-09-21T09:13:54.953756+0000","last_undegraded":"2024-09-21T09:13:54.953756+0000","last_fullsized":"2024-09-21T09:13:54.953756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:13:54.953528+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:13:54.953528+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.953528+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:28.093101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"62'4","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.275759+0000","last_change":"2024-09-21T09:14:09.275824+0000","last_active":"2024-09-21T09:14:09.275759+0000","last_peered":"2024-09-21T09:14:09.275759+0000","last_clean":"2024-09-21T09:14:09.275759+0000","last_became_active":"2024-09-21T09:10:58.838626+0000","last_became_peered":"2024-09-21T09:10:58.838626+0000","last_unstale":"2024-09-21T09:14:09.275759+0000","last_undegraded":"2024-09-21T09:14:09.275759+0000","last_fullsized":"2024-09-21T09:14:09.275759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:09.275554+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:09.275554+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.275554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:15:47.604035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.015880+0000","last_change":"2024-09-21T09:14:04.015943+0000","last_active":"2024-09-21T09:14:04.015880+0000","last_peered":"2024-09-21T09:14:04.015880+0000","last_clean":"2024-09-21T09:14:04.015880+0000","last_became_active":"2024-09-21T09:10:56.846165+0000","last_became_peered":"2024-09-21T09:10:56.846165+0000","last_unstale":"2024-09-21T09:14:04.015880+0000","last_undegraded":"2024-09-21T09:14:04.015880+0000","last_fullsized":"2024-09-21T09:14:04.015880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:04.015654+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:04.015654+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.015654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.162056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.740425+0000","last_change":"2024-09-21T09:13:52.740536+0000","last_active":"2024-09-21T09:13:52.740425+0000","last_peered":"2024-09-21T09:13:52.740425+0000","last_clean":"2024-09-21T09:13:52.740425+0000","last_became_active":"2024-09-21T09:11:00.838283+0000","last_became_peered":"2024-09-21T09:11:00.838283+0000","last_unstale":"2024-09-21T09:13:52.740425+0000","last_undegraded":"2024-09-21T09:13:52.740425+0000","last_fullsized":"2024-09-21T09:13:52.740425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:52.740196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:52.740196+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.740196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:57.336774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"91'38","reported_seq":193,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.149459+0000","last_change":"2024-09-21T09:13:59.149554+0000","last_active":"2024-09-21T09:13:59.149459+0000","last_peered":"2024-09-21T09:13:59.149459+0000","last_clean":"2024-09-21T09:13:59.149459+0000","last_became_active":"2024-09-21T09:11:02.870531+0000","last_became_peered":"2024-09-21T09:11:02.870531+0000","last_unstale":"2024-09-21T09:13:59.149459+0000","last_undegraded":"2024-09-21T09:13:59.149459+0000","last_fullsized":"2024-09-21T09:13:59.149459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'38","last_scrub_stamp":"2024-09-21T09:13:59.149230+0000","last_deep_scrub":"91'38","last_deep_scrub_stamp":"2024-09-21T09:13:59.149230+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.149230+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:47.648398+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":48,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.924843+0000","last_change":"2024-09-21T09:14:16.924900+0000","last_active":"2024-09-21T09:14:16.924843+0000","last_peered":"2024-09-21T09:14:16.924843+0000","last_clean":"2024-09-21T09:14:16.924843+0000","last_became_active":"2024-09-21T09:13:19.149936+0000","last_became_peered":"2024-09-21T09:13:19.149936+0000","last_unstale":"2024-09-21T09:14:16.924843+0000","last_undegraded":"2024-09-21T09:14:16.924843+0000","last_fullsized":"2024-09-21T09:14:16.924843+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:16.924620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:16.924620+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.924620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:42:27.373314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"62'12","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.762480+0000","last_change":"2024-09-21T09:14:14.762546+0000","last_active":"2024-09-21T09:14:14.762480+0000","last_peered":"2024-09-21T09:14:14.762480+0000","last_clean":"2024-09-21T09:14:14.762480+0000","last_became_active":"2024-09-21T09:13:19.165108+0000","last_became_peered":"2024-09-21T09:13:19.165108+0000","last_unstale":"2024-09-21T09:14:14.762480+0000","last_undegraded":"2024-09-21T09:14:14.762480+0000","last_fullsized":"2024-09-21T09:14:14.762480+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-09-21T09:14:14.762277+0000","last_deep_scrub":"62'12","last_deep_scrub_stamp":"2024-09-21T09:14:14.762277+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.762277+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:16:00.547243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"58'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.798739+0000","last_change":"2024-09-21T09:14:01.798806+0000","last_active":"2024-09-21T09:14:01.798739+0000","last_peered":"2024-09-21T09:14:01.798739+0000","last_clean":"2024-09-21T09:14:01.798739+0000","last_became_active":"2024-09-21T09:10:58.839628+0000","last_became_peered":"2024-09-21T09:10:58.839628+0000","last_unstale":"2024-09-21T09:14:01.798739+0000","last_undegraded":"2024-09-21T09:14:01.798739+0000","last_fullsized":"2024-09-21T09:14:01.798739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:01.798538+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:01.798538+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.798538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:18.314665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'14","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.765462+0000","last_change":"2024-09-21T09:14:12.765484+0000","last_active":"2024-09-21T09:14:12.765462+0000","last_peered":"2024-09-21T09:14:12.765462+0000","last_clean":"2024-09-21T09:14:12.765462+0000","last_became_active":"2024-09-21T09:13:19.162605+0000","last_became_peered":"2024-09-21T09:13:19.162605+0000","last_unstale":"2024-09-21T09:14:12.765462+0000","last_undegraded":"2024-09-21T09:14:12.765462+0000","last_fullsized":"2024-09-21T09:14:12.765462+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:12.765392+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:12.765392+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.765392+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.542967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.649750+0000","last_change":"2024-09-21T09:13:54.649802+0000","last_active":"2024-09-21T09:13:54.649750+0000","last_peered":"2024-09-21T09:13:54.649750+0000","last_clean":"2024-09-21T09:13:54.649750+0000","last_became_active":"2024-09-21T09:11:00.852232+0000","last_became_peered":"2024-09-21T09:11:00.852232+0000","last_unstale":"2024-09-21T09:13:54.649750+0000","last_undegraded":"2024-09-21T09:13:54.649750+0000","last_fullsized":"2024-09-21T09:13:54.649750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:54.649547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:54.649547+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.649547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:30.932694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.596444+0000","last_change":"2024-09-21T09:14:06.596521+0000","last_active":"2024-09-21T09:14:06.596444+0000","last_peered":"2024-09-21T09:14:06.596444+0000","last_clean":"2024-09-21T09:14:06.596444+0000","last_became_active":"2024-09-21T09:11:02.864516+0000","last_became_peered":"2024-09-21T09:11:02.864516+0000","last_unstale":"2024-09-21T09:14:06.596444+0000","last_undegraded":"2024-09-21T09:14:06.596444+0000","last_fullsized":"2024-09-21T09:14:06.596444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:06.596240+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:06.596240+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.596240+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:33.779255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:20.448948+0000","last_change":"2024-09-21T09:14:20.449003+0000","last_active":"2024-09-21T09:14:20.448948+0000","last_peered":"2024-09-21T09:14:20.448948+0000","last_clean":"2024-09-21T09:14:20.448948+0000","last_became_active":"2024-09-21T09:11:04.871258+0000","last_became_peered":"2024-09-21T09:11:04.871258+0000","last_unstale":"2024-09-21T09:14:20.448948+0000","last_undegraded":"2024-09-21T09:14:20.448948+0000","last_fullsized":"2024-09-21T09:14:20.448948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:20.448754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:20.448754+0000","last_clean_scrub_stamp":"2024-09-21T09:14:20.448754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:15.811436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"58'2","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:19.831736+0000","last_change":"2024-09-21T09:14:19.831850+0000","last_active":"2024-09-21T09:14:19.831736+0000","last_peered":"2024-09-21T09:14:19.831736+0000","last_clean":"2024-09-21T09:14:19.831736+0000","last_became_active":"2024-09-21T09:13:19.167145+0000","last_became_peered":"2024-09-21T09:13:19.167145+0000","last_unstale":"2024-09-21T09:14:19.831736+0000","last_undegraded":"2024-09-21T09:14:19.831736+0000","last_fullsized":"2024-09-21T09:14:19.831736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:19.831405+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:19.831405+0000","last_clean_scrub_stamp":"2024-09-21T09:14:19.831405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:10.759954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"71'8","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:49.706810+0000","last_change":"2024-09-21T09:13:49.706837+0000","last_active":"2024-09-21T09:13:49.706810+0000","last_peered":"2024-09-21T09:13:49.706810+0000","last_clean":"2024-09-21T09:13:49.706810+0000","last_became_active":"2024-09-21T09:13:19.158113+0000","last_became_peered":"2024-09-21T09:13:19.158113+0000","last_unstale":"2024-09-21T09:13:49.706810+0000","last_undegraded":"2024-09-21T09:13:49.706810+0000","last_fullsized":"2024-09-21T09:13:49.706810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'8","last_scrub_stamp":"2024-09-21T09:13:49.706708+0000","last_deep_scrub":"71'8","last_deep_scrub_stamp":"2024-09-21T09:13:49.706708+0000","last_clean_scrub_stamp":"2024-09-21T09:13:49.706708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:07.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'36","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:28.176860+0000","last_change":"2024-09-21T09:14:28.177004+0000","last_active":"2024-09-21T09:14:28.176860+0000","last_peered":"2024-09-21T09:14:28.176860+0000","last_clean":"2024-09-21T09:14:28.176860+0000","last_became_active":"2024-09-21T09:10:56.841867+0000","last_became_peered":"2024-09-21T09:10:56.841867+0000","last_unstale":"2024-09-21T09:14:28.176860+0000","last_undegraded":"2024-09-21T09:14:28.176860+0000","last_fullsized":"2024-09-21T09:14:28.176860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'36","last_scrub_stamp":"2024-09-21T09:14:28.176570+0000","last_deep_scrub":"91'36","last_deep_scrub_stamp":"2024-09-21T09:14:28.176570+0000","last_clean_scrub_stamp":"2024-09-21T09:14:28.176570+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:13.625209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.986112+0000","last_change":"2024-09-21T09:14:05.986218+0000","last_active":"2024-09-21T09:14:05.986112+0000","last_peered":"2024-09-21T09:14:05.986112+0000","last_clean":"2024-09-21T09:14:05.986112+0000","last_became_active":"2024-09-21T09:11:00.851932+0000","last_became_peered":"2024-09-21T09:11:00.851932+0000","last_unstale":"2024-09-21T09:14:05.986112+0000","last_undegraded":"2024-09-21T09:14:05.986112+0000","last_fullsized":"2024-09-21T09:14:05.986112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:05.985892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:05.985892+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.985892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:13.108411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"91'30","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.260791+0000","last_change":"2024-09-21T09:14:04.260872+0000","last_active":"2024-09-21T09:14:04.260791+0000","last_peered":"2024-09-21T09:14:04.260791+0000","last_clean":"2024-09-21T09:14:04.260791+0000","last_became_active":"2024-09-21T09:11:02.858232+0000","last_became_peered":"2024-09-21T09:11:02.858232+0000","last_unstale":"2024-09-21T09:14:04.260791+0000","last_undegraded":"2024-09-21T09:14:04.260791+0000","last_fullsized":"2024-09-21T09:14:04.260791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'30","last_scrub_stamp":"2024-09-21T09:14:04.260605+0000","last_deep_scrub":"91'30","last_deep_scrub_stamp":"2024-09-21T09:14:04.260605+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.260605+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:04.067219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"91'105","reported_seq":270,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.981810+0000","last_change":"2024-09-21T09:13:53.981879+0000","last_active":"2024-09-21T09:13:53.981810+0000","last_peered":"2024-09-21T09:13:53.981810+0000","last_clean":"2024-09-21T09:13:53.981810+0000","last_became_active":"2024-09-21T09:11:04.895041+0000","last_became_peered":"2024-09-21T09:11:04.895041+0000","last_unstale":"2024-09-21T09:13:53.981810+0000","last_undegraded":"2024-09-21T09:13:53.981810+0000","last_fullsized":"2024-09-21T09:13:53.981810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:13:53.981621+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:13:53.981621+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.981621+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:42.480788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"62'4","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:19.964660+0000","last_change":"2024-09-21T09:14:19.964801+0000","last_active":"2024-09-21T09:14:19.964660+0000","last_peered":"2024-09-21T09:14:19.964660+0000","last_clean":"2024-09-21T09:14:19.964660+0000","last_became_active":"2024-09-21T09:13:19.159646+0000","last_became_peered":"2024-09-21T09:13:19.159646+0000","last_unstale":"2024-09-21T09:14:19.964660+0000","last_undegraded":"2024-09-21T09:14:19.964660+0000","last_fullsized":"2024-09-21T09:14:19.964660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:19.964383+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:19.964383+0000","last_clean_scrub_stamp":"2024-09-21T09:14:19.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:38.247326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"71'10","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.980919+0000","last_change":"2024-09-21T09:14:01.980982+0000","last_active":"2024-09-21T09:14:01.980919+0000","last_peered":"2024-09-21T09:14:01.980919+0000","last_clean":"2024-09-21T09:14:01.980919+0000","last_became_active":"2024-09-21T09:10:58.871278+0000","last_became_peered":"2024-09-21T09:10:58.871278+0000","last_unstale":"2024-09-21T09:14:01.980919+0000","last_undegraded":"2024-09-21T09:14:01.980919+0000","last_fullsized":"2024-09-21T09:14:01.980919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:14:01.980698+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:14:01.980698+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.980698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:05.853788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'14","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.992416+0000","last_change":"2024-09-21T09:14:06.992477+0000","last_active":"2024-09-21T09:14:06.992416+0000","last_peered":"2024-09-21T09:14:06.992416+0000","last_clean":"2024-09-21T09:14:06.992416+0000","last_became_active":"2024-09-21T09:10:56.854820+0000","last_became_peered":"2024-09-21T09:10:56.854820+0000","last_unstale":"2024-09-21T09:14:06.992416+0000","last_undegraded":"2024-09-21T09:14:06.992416+0000","last_fullsized":"2024-09-21T09:14:06.992416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:06.992229+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:06.992229+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.992229+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:10.865320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.658528+0000","last_change":"2024-09-21T09:13:51.658637+0000","last_active":"2024-09-21T09:13:51.658528+0000","last_peered":"2024-09-21T09:13:51.658528+0000","last_clean":"2024-09-21T09:13:51.658528+0000","last_became_active":"2024-09-21T09:11:00.844757+0000","last_became_peered":"2024-09-21T09:11:00.844757+0000","last_unstale":"2024-09-21T09:13:51.658528+0000","last_undegraded":"2024-09-21T09:13:51.658528+0000","last_fullsized":"2024-09-21T09:13:51.658528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:51.658295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:51.658295+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.658295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:56.254874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"91'33","reported_seq":192,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.531277+0000","last_change":"2024-09-21T09:14:10.531355+0000","last_active":"2024-09-21T09:14:10.531277+0000","last_peered":"2024-09-21T09:14:10.531277+0000","last_clean":"2024-09-21T09:14:10.531277+0000","last_became_active":"2024-09-21T09:11:02.867071+0000","last_became_peered":"2024-09-21T09:11:02.867071+0000","last_unstale":"2024-09-21T09:14:10.531277+0000","last_undegraded":"2024-09-21T09:14:10.531277+0000","last_fullsized":"2024-09-21T09:14:10.531277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33","last_scrub_stamp":"2024-09-21T09:14:10.531062+0000","last_deep_scrub":"91'33","last_deep_scrub_stamp":"2024-09-21T09:14:10.531062+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.531062+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:56.515750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:22.090160+0000","last_change":"2024-09-21T09:14:22.090213+0000","last_active":"2024-09-21T09:14:22.090160+0000","last_peered":"2024-09-21T09:14:22.090160+0000","last_clean":"2024-09-21T09:14:22.090160+0000","last_became_active":"2024-09-21T09:11:04.890073+0000","last_became_peered":"2024-09-21T09:11:04.890073+0000","last_unstale":"2024-09-21T09:14:22.090160+0000","last_undegraded":"2024-09-21T09:14:22.090160+0000","last_fullsized":"2024-09-21T09:14:22.090160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:22.089958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:22.089958+0000","last_clean_scrub_stamp":"2024-09-21T09:14:22.089958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:42.723331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.721315+0000","last_change":"2024-09-21T09:14:14.721372+0000","last_active":"2024-09-21T09:14:14.721315+0000","last_peered":"2024-09-21T09:14:14.721315+0000","last_clean":"2024-09-21T09:14:14.721315+0000","last_became_active":"2024-09-21T09:11:06.887346+0000","last_became_peered":"2024-09-21T09:11:06.887346+0000","last_unstale":"2024-09-21T09:14:14.721315+0000","last_undegraded":"2024-09-21T09:14:14.721315+0000","last_fullsized":"2024-09-21T09:14:14.721315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:14.721129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:14.721129+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.721129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:47.555947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"62'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:49.085649+0000","last_change":"2024-09-21T09:13:49.085691+0000","last_active":"2024-09-21T09:13:49.085649+0000","last_peered":"2024-09-21T09:13:49.085649+0000","last_clean":"2024-09-21T09:13:49.085649+0000","last_became_active":"2024-09-21T09:10:58.871500+0000","last_became_peered":"2024-09-21T09:10:58.871500+0000","last_unstale":"2024-09-21T09:13:49.085649+0000","last_undegraded":"2024-09-21T09:13:49.085649+0000","last_fullsized":"2024-09-21T09:13:49.085649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:13:49.085518+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:13:49.085518+0000","last_clean_scrub_stamp":"2024-09-21T09:13:49.085518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:07.451486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"91'14","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.876281+0000","last_change":"2024-09-21T09:14:04.876339+0000","last_active":"2024-09-21T09:14:04.876281+0000","last_peered":"2024-09-21T09:14:04.876281+0000","last_clean":"2024-09-21T09:14:04.876281+0000","last_became_active":"2024-09-21T09:10:56.854162+0000","last_became_peered":"2024-09-21T09:10:56.854162+0000","last_unstale":"2024-09-21T09:14:04.876281+0000","last_undegraded":"2024-09-21T09:14:04.876281+0000","last_fullsized":"2024-09-21T09:14:04.876281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:04.876085+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:04.876085+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.876085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:53.375253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.829115+0000","last_change":"2024-09-21T09:13:55.829174+0000","last_active":"2024-09-21T09:13:55.829115+0000","last_peered":"2024-09-21T09:13:55.829115+0000","last_clean":"2024-09-21T09:13:55.829115+0000","last_became_active":"2024-09-21T09:11:00.849559+0000","last_became_peered":"2024-09-21T09:11:00.849559+0000","last_unstale":"2024-09-21T09:13:55.829115+0000","last_undegraded":"2024-09-21T09:13:55.829115+0000","last_fullsized":"2024-09-21T09:13:55.829115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:55.828855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:55.828855+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.828855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:29:37.393939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"91'24","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.842420+0000","last_change":"2024-09-21T09:13:56.842511+0000","last_active":"2024-09-21T09:13:56.842420+0000","last_peered":"2024-09-21T09:13:56.842420+0000","last_clean":"2024-09-21T09:13:56.842420+0000","last_became_active":"2024-09-21T09:11:02.861808+0000","last_became_peered":"2024-09-21T09:11:02.861808+0000","last_unstale":"2024-09-21T09:13:56.842420+0000","last_undegraded":"2024-09-21T09:13:56.842420+0000","last_fullsized":"2024-09-21T09:13:56.842420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:13:56.842206+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:13:56.842206+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.842206+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:50.040639+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.853826+0000","last_change":"2024-09-21T09:13:58.853895+0000","last_active":"2024-09-21T09:13:58.853826+0000","last_peered":"2024-09-21T09:13:58.853826+0000","last_clean":"2024-09-21T09:13:58.853826+0000","last_became_active":"2024-09-21T09:11:04.879842+0000","last_became_peered":"2024-09-21T09:11:04.879842+0000","last_unstale":"2024-09-21T09:13:58.853826+0000","last_undegraded":"2024-09-21T09:13:58.853826+0000","last_fullsized":"2024-09-21T09:13:58.853826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.853632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.853632+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.853632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:13.065998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"71'4","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.924041+0000","last_change":"2024-09-21T09:13:51.924102+0000","last_active":"2024-09-21T09:13:51.924041+0000","last_peered":"2024-09-21T09:13:51.924041+0000","last_clean":"2024-09-21T09:13:51.924041+0000","last_became_active":"2024-09-21T09:11:06.888733+0000","last_became_peered":"2024-09-21T09:11:06.888733+0000","last_unstale":"2024-09-21T09:13:51.924041+0000","last_undegraded":"2024-09-21T09:13:51.924041+0000","last_fullsized":"2024-09-21T09:13:51.924041+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:51.923811+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:51.923811+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.923811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:45.046566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.232745+0000","last_change":"2024-09-21T09:14:10.232876+0000","last_active":"2024-09-21T09:14:10.232745+0000","last_peered":"2024-09-21T09:14:10.232745+0000","last_clean":"2024-09-21T09:14:10.232745+0000","last_became_active":"2024-09-21T09:10:58.837428+0000","last_became_peered":"2024-09-21T09:10:58.837428+0000","last_unstale":"2024-09-21T09:14:10.232745+0000","last_undegraded":"2024-09-21T09:14:10.232745+0000","last_fullsized":"2024-09-21T09:14:10.232745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:10.232476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:10.232476+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.232476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:06.843881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"91'12","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:27.146929+0000","last_change":"2024-09-21T09:14:27.146991+0000","last_active":"2024-09-21T09:14:27.146929+0000","last_peered":"2024-09-21T09:14:27.146929+0000","last_clean":"2024-09-21T09:14:27.146929+0000","last_became_active":"2024-09-21T09:10:56.837815+0000","last_became_peered":"2024-09-21T09:10:56.837815+0000","last_unstale":"2024-09-21T09:14:27.146929+0000","last_undegraded":"2024-09-21T09:14:27.146929+0000","last_fullsized":"2024-09-21T09:14:27.146929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-21T09:14:27.146736+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-21T09:14:27.146736+0000","last_clean_scrub_stamp":"2024-09-21T09:14:27.146736+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:28.770410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.914644+0000","last_change":"2024-09-21T09:14:03.914695+0000","last_active":"2024-09-21T09:14:03.914644+0000","last_peered":"2024-09-21T09:14:03.914644+0000","last_clean":"2024-09-21T09:14:03.914644+0000","last_became_active":"2024-09-21T09:11:00.840394+0000","last_became_peered":"2024-09-21T09:11:00.840394+0000","last_unstale":"2024-09-21T09:14:03.914644+0000","last_undegraded":"2024-09-21T09:14:03.914644+0000","last_fullsized":"2024-09-21T09:14:03.914644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:03.914453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:03.914453+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.914453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:36.749271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"91'33","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.007328+0000","last_change":"2024-09-21T09:14:08.007410+0000","last_active":"2024-09-21T09:14:08.007328+0000","last_peered":"2024-09-21T09:14:08.007328+0000","last_clean":"2024-09-21T09:14:08.007328+0000","last_became_active":"2024-09-21T09:11:02.849641+0000","last_became_peered":"2024-09-21T09:11:02.849641+0000","last_unstale":"2024-09-21T09:14:08.007328+0000","last_undegraded":"2024-09-21T09:14:08.007328+0000","last_fullsized":"2024-09-21T09:14:08.007328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33","last_scrub_stamp":"2024-09-21T09:14:08.007133+0000","last_deep_scrub":"91'33","last_deep_scrub_stamp":"2024-09-21T09:14:08.007133+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.007133+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:08.430200+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1216,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"91'105","reported_seq":309,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.790155+0000","last_change":"2024-09-21T09:14:11.790216+0000","last_active":"2024-09-21T09:14:11.790155+0000","last_peered":"2024-09-21T09:14:11.790155+0000","last_clean":"2024-09-21T09:14:11.790155+0000","last_became_active":"2024-09-21T09:11:04.891720+0000","last_became_peered":"2024-09-21T09:11:04.891720+0000","last_unstale":"2024-09-21T09:14:11.790155+0000","last_undegraded":"2024-09-21T09:14:11.790155+0000","last_fullsized":"2024-09-21T09:14:11.790155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:14:11.789958+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:14:11.789958+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.789958+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:24.931987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.944387+0000","last_change":"2024-09-21T09:14:14.944531+0000","last_active":"2024-09-21T09:14:14.944387+0000","last_peered":"2024-09-21T09:14:14.944387+0000","last_clean":"2024-09-21T09:14:14.944387+0000","last_became_active":"2024-09-21T09:11:06.883161+0000","last_became_peered":"2024-09-21T09:11:06.883161+0000","last_unstale":"2024-09-21T09:14:14.944387+0000","last_undegraded":"2024-09-21T09:14:14.944387+0000","last_fullsized":"2024-09-21T09:14:14.944387+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:14.944137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:14.944137+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.944137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:15.190350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"71'8","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.738791+0000","last_change":"2024-09-21T09:14:11.738849+0000","last_active":"2024-09-21T09:14:11.738791+0000","last_peered":"2024-09-21T09:14:11.738791+0000","last_clean":"2024-09-21T09:14:11.738791+0000","last_became_active":"2024-09-21T09:13:19.161819+0000","last_became_peered":"2024-09-21T09:13:19.161819+0000","last_unstale":"2024-09-21T09:14:11.738791+0000","last_undegraded":"2024-09-21T09:14:11.738791+0000","last_fullsized":"2024-09-21T09:14:11.738791+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'8","last_scrub_stamp":"2024-09-21T09:14:11.738592+0000","last_deep_scrub":"71'8","last_deep_scrub_stamp":"2024-09-21T09:14:11.738592+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.738592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:09.264133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:30.092034+0000","last_change":"2024-09-21T09:14:30.092100+0000","last_active":"2024-09-21T09:14:30.092034+0000","last_peered":"2024-09-21T09:14:30.092034+0000","last_clean":"2024-09-21T09:14:30.092034+0000","last_became_active":"2024-09-21T09:10:56.842185+0000","last_became_peered":"2024-09-21T09:10:56.842185+0000","last_unstale":"2024-09-21T09:14:30.092034+0000","last_undegraded":"2024-09-21T09:14:30.092034+0000","last_fullsized":"2024-09-21T09:14:30.092034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:30.091831+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:30.091831+0000","last_clean_scrub_stamp":"2024-09-21T09:14:30.091831+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:27:52.373341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"91'4","reported_seq":283,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:50.715930+0000","last_change":"2024-09-21T09:13:50.716004+0000","last_active":"2024-09-21T09:13:50.715930+0000","last_peered":"2024-09-21T09:13:50.715930+0000","last_clean":"2024-09-21T09:13:50.715930+0000","last_became_active":"2024-09-21T09:11:00.838225+0000","last_became_peered":"2024-09-21T09:11:00.838225+0000","last_unstale":"2024-09-21T09:13:50.715930+0000","last_undegraded":"2024-09-21T09:13:50.715930+0000","last_fullsized":"2024-09-21T09:13:50.715930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-21T09:13:50.715772+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-21T09:13:50.715772+0000","last_clean_scrub_stamp":"2024-09-21T09:13:50.715772+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:58.220031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"91'17","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.782084+0000","last_change":"2024-09-21T09:14:00.782236+0000","last_active":"2024-09-21T09:14:00.782084+0000","last_peered":"2024-09-21T09:14:00.782084+0000","last_clean":"2024-09-21T09:14:00.782084+0000","last_became_active":"2024-09-21T09:11:02.875789+0000","last_became_peered":"2024-09-21T09:11:02.875789+0000","last_unstale":"2024-09-21T09:14:00.782084+0000","last_undegraded":"2024-09-21T09:14:00.782084+0000","last_fullsized":"2024-09-21T09:14:00.782084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'17","last_scrub_stamp":"2024-09-21T09:14:00.781799+0000","last_deep_scrub":"91'17","last_deep_scrub_stamp":"2024-09-21T09:14:00.781799+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.781799+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:48.074789+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1596,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"91'105","reported_seq":323,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.837424+0000","last_change":"2024-09-21T09:14:02.837562+0000","last_active":"2024-09-21T09:14:02.837424+0000","last_peered":"2024-09-21T09:14:02.837424+0000","last_clean":"2024-09-21T09:14:02.837424+0000","last_became_active":"2024-09-21T09:11:04.883990+0000","last_became_peered":"2024-09-21T09:11:04.883990+0000","last_unstale":"2024-09-21T09:14:02.837424+0000","last_undegraded":"2024-09-21T09:14:02.837424+0000","last_fullsized":"2024-09-21T09:14:02.837424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:14:02.837178+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:14:02.837178+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.837178+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:34.195267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'2","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.808407+0000","last_change":"2024-09-21T09:14:06.808465+0000","last_active":"2024-09-21T09:14:06.808407+0000","last_peered":"2024-09-21T09:14:06.808407+0000","last_clean":"2024-09-21T09:14:06.808407+0000","last_became_active":"2024-09-21T09:13:19.139533+0000","last_became_peered":"2024-09-21T09:13:19.139533+0000","last_unstale":"2024-09-21T09:14:06.808407+0000","last_undegraded":"2024-09-21T09:14:06.808407+0000","last_fullsized":"2024-09-21T09:14:06.808407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:06.808207+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:06.808207+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.808207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:13.930727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"62'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.824089+0000","last_change":"2024-09-21T09:14:01.824155+0000","last_active":"2024-09-21T09:14:01.824089+0000","last_peered":"2024-09-21T09:14:01.824089+0000","last_clean":"2024-09-21T09:14:01.824089+0000","last_became_active":"2024-09-21T09:10:58.873090+0000","last_became_peered":"2024-09-21T09:10:58.873090+0000","last_unstale":"2024-09-21T09:14:01.824089+0000","last_undegraded":"2024-09-21T09:14:01.824089+0000","last_fullsized":"2024-09-21T09:14:01.824089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:01.823894+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:01.823894+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.823894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:08:20.790560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"91'4","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.472101+0000","last_change":"2024-09-21T09:14:14.472170+0000","last_active":"2024-09-21T09:14:14.472101+0000","last_peered":"2024-09-21T09:14:14.472101+0000","last_clean":"2024-09-21T09:14:14.472101+0000","last_became_active":"2024-09-21T09:10:56.848268+0000","last_became_peered":"2024-09-21T09:10:56.848268+0000","last_unstale":"2024-09-21T09:14:14.472101+0000","last_undegraded":"2024-09-21T09:14:14.472101+0000","last_fullsized":"2024-09-21T09:14:14.472101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-21T09:14:14.471884+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-21T09:14:14.471884+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.471884+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:07.377522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.389587+0000","last_change":"2024-09-21T09:14:15.389642+0000","last_active":"2024-09-21T09:14:15.389587+0000","last_peered":"2024-09-21T09:14:15.389587+0000","last_clean":"2024-09-21T09:14:15.389587+0000","last_became_active":"2024-09-21T09:11:00.841204+0000","last_became_peered":"2024-09-21T09:11:00.841204+0000","last_unstale":"2024-09-21T09:14:15.389587+0000","last_undegraded":"2024-09-21T09:14:15.389587+0000","last_fullsized":"2024-09-21T09:14:15.389587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:15.389388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:15.389388+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.389388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:49.673039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"91'33","reported_seq":185,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.758757+0000","last_change":"2024-09-21T09:14:00.758928+0000","last_active":"2024-09-21T09:14:00.758757+0000","last_peered":"2024-09-21T09:14:00.758757+0000","last_clean":"2024-09-21T09:14:00.758757+0000","last_became_active":"2024-09-21T09:11:02.867107+0000","last_became_peered":"2024-09-21T09:11:02.867107+0000","last_unstale":"2024-09-21T09:14:00.758757+0000","last_undegraded":"2024-09-21T09:14:00.758757+0000","last_fullsized":"2024-09-21T09:14:00.758757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33","last_scrub_stamp":"2024-09-21T09:14:00.758562+0000","last_deep_scrub":"91'33","last_deep_scrub_stamp":"2024-09-21T09:14:00.758562+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.758562+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:33.898135+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.678959+0000","last_change":"2024-09-21T09:13:58.679013+0000","last_active":"2024-09-21T09:13:58.678959+0000","last_peered":"2024-09-21T09:13:58.678959+0000","last_clean":"2024-09-21T09:13:58.678959+0000","last_became_active":"2024-09-21T09:13:19.164969+0000","last_became_peered":"2024-09-21T09:13:19.164969+0000","last_unstale":"2024-09-21T09:13:58.678959+0000","last_undegraded":"2024-09-21T09:13:58.678959+0000","last_fullsized":"2024-09-21T09:13:58.678959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.678760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.678760+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.678760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:19:07.210122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"62'12","reported_seq":147,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.721905+0000","last_change":"2024-09-21T09:14:13.721971+0000","last_active":"2024-09-21T09:14:13.721905+0000","last_peered":"2024-09-21T09:14:13.721905+0000","last_clean":"2024-09-21T09:14:13.721905+0000","last_became_active":"2024-09-21T09:11:06.883035+0000","last_became_peered":"2024-09-21T09:11:06.883035+0000","last_unstale":"2024-09-21T09:14:13.721905+0000","last_undegraded":"2024-09-21T09:14:13.721905+0000","last_fullsized":"2024-09-21T09:14:13.721905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'12","last_scrub_stamp":"2024-09-21T09:14:13.721706+0000","last_deep_scrub":"62'12","last_deep_scrub_stamp":"2024-09-21T09:14:13.721706+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.721706+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:52.121147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.294842+0000","last_change":"2024-09-21T09:14:08.294906+0000","last_active":"2024-09-21T09:14:08.294842+0000","last_peered":"2024-09-21T09:14:08.294842+0000","last_clean":"2024-09-21T09:14:08.294842+0000","last_became_active":"2024-09-21T09:10:58.837851+0000","last_became_peered":"2024-09-21T09:10:58.837851+0000","last_unstale":"2024-09-21T09:14:08.294842+0000","last_undegraded":"2024-09-21T09:14:08.294842+0000","last_fullsized":"2024-09-21T09:14:08.294842+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:08.294621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:08.294621+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.294621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:48.048960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"91'119","reported_seq":316,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.840858+0000","last_change":"2024-09-21T09:14:04.840858+0000","last_active":"2024-09-21T09:14:04.840858+0000","last_peered":"2024-09-21T09:14:04.840858+0000","last_clean":"2024-09-21T09:14:04.840858+0000","last_became_active":"2024-09-21T09:10:44.725884+0000","last_became_peered":"2024-09-21T09:10:44.725884+0000","last_unstale":"2024-09-21T09:14:04.840858+0000","last_undegraded":"2024-09-21T09:14:04.840858+0000","last_fullsized":"2024-09-21T09:14:04.840858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'119","last_scrub_stamp":"2024-09-21T09:14:04.840584+0000","last_deep_scrub":"91'119","last_deep_scrub_stamp":"2024-09-21T09:14:04.840584+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.840584+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.986986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"91'2","reported_seq":182,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:32.094143+0000","last_change":"2024-09-21T09:14:32.094223+0000","last_active":"2024-09-21T09:14:32.094143+0000","last_peered":"2024-09-21T09:14:32.094143+0000","last_clean":"2024-09-21T09:14:32.094143+0000","last_became_active":"2024-09-21T09:13:19.155065+0000","last_became_peered":"2024-09-21T09:13:19.155065+0000","last_unstale":"2024-09-21T09:14:32.094143+0000","last_undegraded":"2024-09-21T09:14:32.094143+0000","last_fullsized":"2024-09-21T09:14:32.094143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-21T09:14:32.093942+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-21T09:14:32.093942+0000","last_clean_scrub_stamp":"2024-09-21T09:14:32.093942+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:09.519524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001771758,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"91'18","reported_seq":221,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:24.514947+0000","last_change":"2024-09-21T09:14:24.515006+0000","last_active":"2024-09-21T09:14:24.514947+0000","last_peered":"2024-09-21T09:14:24.514947+0000","last_clean":"2024-09-21T09:14:24.514947+0000","last_became_active":"2024-09-21T09:13:19.152677+0000","last_became_peered":"2024-09-21T09:13:19.152677+0000","last_unstale":"2024-09-21T09:14:24.514947+0000","last_undegraded":"2024-09-21T09:14:24.514947+0000","last_fullsized":"2024-09-21T09:14:24.514947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:24.514751+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:24.514751+0000","last_clean_scrub_stamp":"2024-09-21T09:14:24.514751+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:12.813161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.123811+0000","last_change":"2024-09-21T09:13:51.123831+0000","last_active":"2024-09-21T09:13:51.123811+0000","last_peered":"2024-09-21T09:13:51.123811+0000","last_clean":"2024-09-21T09:13:51.123811+0000","last_became_active":"2024-09-21T09:11:00.844897+0000","last_became_peered":"2024-09-21T09:11:00.844897+0000","last_unstale":"2024-09-21T09:13:51.123811+0000","last_undegraded":"2024-09-21T09:13:51.123811+0000","last_fullsized":"2024-09-21T09:13:51.123811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:51.123724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:51.123724+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.123724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:13.536863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"91'45","reported_seq":208,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.211089+0000","last_change":"2024-09-21T09:14:03.211164+0000","last_active":"2024-09-21T09:14:03.211089+0000","last_peered":"2024-09-21T09:14:03.211089+0000","last_clean":"2024-09-21T09:14:03.211089+0000","last_became_active":"2024-09-21T09:11:02.862267+0000","last_became_peered":"2024-09-21T09:11:02.862267+0000","last_unstale":"2024-09-21T09:14:03.211089+0000","last_undegraded":"2024-09-21T09:14:03.211089+0000","last_fullsized":"2024-09-21T09:14:03.211089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'45","last_scrub_stamp":"2024-09-21T09:14:03.210893+0000","last_deep_scrub":"91'45","last_deep_scrub_stamp":"2024-09-21T09:14:03.210893+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.210893+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:23.844266+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":48,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.917866+0000","last_change":"2024-09-21T09:13:56.917919+0000","last_active":"2024-09-21T09:13:56.917866+0000","last_peered":"2024-09-21T09:13:56.917866+0000","last_clean":"2024-09-21T09:13:56.917866+0000","last_became_active":"2024-09-21T09:11:04.891737+0000","last_became_peered":"2024-09-21T09:11:04.891737+0000","last_unstale":"2024-09-21T09:13:56.917866+0000","last_undegraded":"2024-09-21T09:13:56.917866+0000","last_fullsized":"2024-09-21T09:13:56.917866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.917676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.917676+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.917676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:28.275766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"71'6","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.991851+0000","last_change":"2024-09-21T09:14:12.991911+0000","last_active":"2024-09-21T09:14:12.991851+0000","last_peered":"2024-09-21T09:14:12.991851+0000","last_clean":"2024-09-21T09:14:12.991851+0000","last_became_active":"2024-09-21T09:13:19.153438+0000","last_became_peered":"2024-09-21T09:13:19.153438+0000","last_unstale":"2024-09-21T09:14:12.991851+0000","last_undegraded":"2024-09-21T09:14:12.991851+0000","last_fullsized":"2024-09-21T09:14:12.991851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-09-21T09:14:12.991610+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-09-21T09:14:12.991610+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.991610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:13.414677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":422,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.962302+0000","last_change":"2024-09-21T09:13:59.962359+0000","last_active":"2024-09-21T09:13:59.962302+0000","last_peered":"2024-09-21T09:13:59.962302+0000","last_clean":"2024-09-21T09:13:59.962302+0000","last_became_active":"2024-09-21T09:10:58.854031+0000","last_became_peered":"2024-09-21T09:10:58.854031+0000","last_unstale":"2024-09-21T09:13:59.962302+0000","last_undegraded":"2024-09-21T09:13:59.962302+0000","last_fullsized":"2024-09-21T09:13:59.962302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:59.962111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:59.962111+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.962111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:13.104139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:24.156840+0000","last_change":"2024-09-21T09:14:24.156840+0000","last_active":"2024-09-21T09:14:24.156840+0000","last_peered":"2024-09-21T09:14:24.156840+0000","last_clean":"2024-09-21T09:14:24.156840+0000","last_became_active":"2024-09-21T09:10:48.765159+0000","last_became_peered":"2024-09-21T09:10:48.765159+0000","last_unstale":"2024-09-21T09:14:24.156840+0000","last_undegraded":"2024-09-21T09:14:24.156840+0000","last_fullsized":"2024-09-21T09:14:24.156840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:24.156436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:24.156436+0000","last_clean_scrub_stamp":"2024-09-21T09:14:24.156436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:15.357283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082005499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"91'14","reported_seq":204,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.905006+0000","last_change":"2024-09-21T09:14:17.905065+0000","last_active":"2024-09-21T09:14:17.905006+0000","last_peered":"2024-09-21T09:14:17.905006+0000","last_clean":"2024-09-21T09:14:17.905006+0000","last_became_active":"2024-09-21T09:13:19.142666+0000","last_became_peered":"2024-09-21T09:13:19.142666+0000","last_unstale":"2024-09-21T09:14:17.905006+0000","last_undegraded":"2024-09-21T09:14:17.905006+0000","last_fullsized":"2024-09-21T09:14:17.905006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:17.904813+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:17.904813+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.904813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:48.828770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:19.285999+0000","last_change":"2024-09-21T09:14:19.286056+0000","last_active":"2024-09-21T09:14:19.285999+0000","last_peered":"2024-09-21T09:14:19.285999+0000","last_clean":"2024-09-21T09:14:19.285999+0000","last_became_active":"2024-09-21T09:11:00.845114+0000","last_became_peered":"2024-09-21T09:11:00.845114+0000","last_unstale":"2024-09-21T09:14:19.285999+0000","last_undegraded":"2024-09-21T09:14:19.285999+0000","last_fullsized":"2024-09-21T09:14:19.285999+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:19.285802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:19.285802+0000","last_clean_scrub_stamp":"2024-09-21T09:14:19.285802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:05.519428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"91'127","reported_seq":360,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.867422+0000","last_change":"2024-09-21T09:13:56.867596+0000","last_active":"2024-09-21T09:13:56.867422+0000","last_peered":"2024-09-21T09:13:56.867422+0000","last_clean":"2024-09-21T09:13:56.867422+0000","last_became_active":"2024-09-21T09:11:02.870694+0000","last_became_peered":"2024-09-21T09:11:02.870694+0000","last_unstale":"2024-09-21T09:13:56.867422+0000","last_undegraded":"2024-09-21T09:13:56.867422+0000","last_fullsized":"2024-09-21T09:13:56.867422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'127","last_scrub_stamp":"2024-09-21T09:13:56.867163+0000","last_deep_scrub":"91'127","last_deep_scrub_stamp":"2024-09-21T09:13:56.867163+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.867163+0000","objects_scrubbed":10,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:19.280301+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":167,"num_read_kb":270,"num_write":36,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.164777+0000","last_change":"2024-09-21T09:13:56.164832+0000","last_active":"2024-09-21T09:13:56.164777+0000","last_peered":"2024-09-21T09:13:56.164777+0000","last_clean":"2024-09-21T09:13:56.164777+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:13:56.164777+0000","last_undegraded":"2024-09-21T09:13:56.164777+0000","last_fullsized":"2024-09-21T09:13:56.164777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.164543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.164543+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.164543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:47.093093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"58'2","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.956648+0000","last_change":"2024-09-21T09:13:55.956775+0000","last_active":"2024-09-21T09:13:55.956648+0000","last_peered":"2024-09-21T09:13:55.956648+0000","last_clean":"2024-09-21T09:13:55.956648+0000","last_became_active":"2024-09-21T09:11:06.894561+0000","last_became_peered":"2024-09-21T09:11:06.894561+0000","last_unstale":"2024-09-21T09:13:55.956648+0000","last_undegraded":"2024-09-21T09:13:55.956648+0000","last_fullsized":"2024-09-21T09:13:55.956648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:55.956369+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:55.956369+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.956369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:12.472496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.731873+0000","last_change":"2024-09-21T09:14:03.731924+0000","last_active":"2024-09-21T09:14:03.731873+0000","last_peered":"2024-09-21T09:14:03.731873+0000","last_clean":"2024-09-21T09:14:03.731873+0000","last_became_active":"2024-09-21T09:10:58.830772+0000","last_became_peered":"2024-09-21T09:10:58.830772+0000","last_unstale":"2024-09-21T09:14:03.731873+0000","last_undegraded":"2024-09-21T09:14:03.731873+0000","last_fullsized":"2024-09-21T09:14:03.731873+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:03.731674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:03.731674+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.731674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:16.654827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.811619+0000","last_change":"2024-09-21T09:14:02.811680+0000","last_active":"2024-09-21T09:14:02.811619+0000","last_peered":"2024-09-21T09:14:02.811619+0000","last_clean":"2024-09-21T09:14:02.811619+0000","last_became_active":"2024-09-21T09:10:48.767789+0000","last_became_peered":"2024-09-21T09:10:48.767789+0000","last_unstale":"2024-09-21T09:14:02.811619+0000","last_undegraded":"2024-09-21T09:14:02.811619+0000","last_fullsized":"2024-09-21T09:14:02.811619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:02.811374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:02.811374+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.811374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:55.934130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010999479999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"91'22","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.034133+0000","last_change":"2024-09-21T09:14:11.034193+0000","last_active":"2024-09-21T09:14:11.034133+0000","last_peered":"2024-09-21T09:14:11.034133+0000","last_clean":"2024-09-21T09:14:11.034133+0000","last_became_active":"2024-09-21T09:10:56.865305+0000","last_became_peered":"2024-09-21T09:10:56.865305+0000","last_unstale":"2024-09-21T09:14:11.034133+0000","last_undegraded":"2024-09-21T09:14:11.034133+0000","last_fullsized":"2024-09-21T09:14:11.034133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:11.033946+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:11.033946+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.033946+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:08.559486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"91'4","reported_seq":215,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.858779+0000","last_change":"2024-09-21T09:13:57.858847+0000","last_active":"2024-09-21T09:13:57.858779+0000","last_peered":"2024-09-21T09:13:57.858779+0000","last_clean":"2024-09-21T09:13:57.858779+0000","last_became_active":"2024-09-21T09:11:00.849303+0000","last_became_peered":"2024-09-21T09:11:00.849303+0000","last_unstale":"2024-09-21T09:13:57.858779+0000","last_undegraded":"2024-09-21T09:13:57.858779+0000","last_fullsized":"2024-09-21T09:13:57.858779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-09-21T09:13:57.858583+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-09-21T09:13:57.858583+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.858583+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:02.455161+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"91'24","reported_seq":200,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.994123+0000","last_change":"2024-09-21T09:14:09.994205+0000","last_active":"2024-09-21T09:14:09.994123+0000","last_peered":"2024-09-21T09:14:09.994123+0000","last_clean":"2024-09-21T09:14:09.994123+0000","last_became_active":"2024-09-21T09:11:02.872406+0000","last_became_peered":"2024-09-21T09:11:02.872406+0000","last_unstale":"2024-09-21T09:14:09.994123+0000","last_undegraded":"2024-09-21T09:14:09.994123+0000","last_fullsized":"2024-09-21T09:14:09.994123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:09.993923+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:09.993923+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.993923+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:16.273297+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.348585+0000","last_change":"2024-09-21T09:13:52.348703+0000","last_active":"2024-09-21T09:13:52.348585+0000","last_peered":"2024-09-21T09:13:52.348585+0000","last_clean":"2024-09-21T09:13:52.348585+0000","last_became_active":"2024-09-21T09:11:04.871711+0000","last_became_peered":"2024-09-21T09:11:04.871711+0000","last_unstale":"2024-09-21T09:13:52.348585+0000","last_undegraded":"2024-09-21T09:13:52.348585+0000","last_fullsized":"2024-09-21T09:13:52.348585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:52.348233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:52.348233+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.348233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:35.531424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.417194+0000","last_change":"2024-09-21T09:13:54.417254+0000","last_active":"2024-09-21T09:13:54.417194+0000","last_peered":"2024-09-21T09:13:54.417194+0000","last_clean":"2024-09-21T09:13:54.417194+0000","last_became_active":"2024-09-21T09:11:06.895586+0000","last_became_peered":"2024-09-21T09:11:06.895586+0000","last_unstale":"2024-09-21T09:13:54.417194+0000","last_undegraded":"2024-09-21T09:13:54.417194+0000","last_fullsized":"2024-09-21T09:13:54.417194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:54.417003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:54.417003+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.417003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:37.375359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"58'2","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.740070+0000","last_change":"2024-09-21T09:13:59.740131+0000","last_active":"2024-09-21T09:13:59.740070+0000","last_peered":"2024-09-21T09:13:59.740070+0000","last_clean":"2024-09-21T09:13:59.740070+0000","last_became_active":"2024-09-21T09:10:58.837804+0000","last_became_peered":"2024-09-21T09:10:58.837804+0000","last_unstale":"2024-09-21T09:13:59.740070+0000","last_undegraded":"2024-09-21T09:13:59.740070+0000","last_fullsized":"2024-09-21T09:13:59.740070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:59.739869+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:59.739869+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.739869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:10.243493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'3","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:23.205932+0000","last_change":"2024-09-21T09:14:23.206003+0000","last_active":"2024-09-21T09:14:23.205932+0000","last_peered":"2024-09-21T09:14:23.205932+0000","last_clean":"2024-09-21T09:14:23.205932+0000","last_became_active":"2024-09-21T09:10:48.763882+0000","last_became_peered":"2024-09-21T09:10:48.763882+0000","last_unstale":"2024-09-21T09:14:23.205932+0000","last_undegraded":"2024-09-21T09:14:23.205932+0000","last_fullsized":"2024-09-21T09:14:23.205932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-09-21T09:14:23.205746+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-09-21T09:14:23.205746+0000","last_clean_scrub_stamp":"2024-09-21T09:14:23.205746+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:14.424064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002413171,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"91'14","reported_seq":207,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.018064+0000","last_change":"2024-09-21T09:14:14.018215+0000","last_active":"2024-09-21T09:14:14.018064+0000","last_peered":"2024-09-21T09:14:14.018064+0000","last_clean":"2024-09-21T09:14:14.018064+0000","last_became_active":"2024-09-21T09:13:19.153710+0000","last_became_peered":"2024-09-21T09:13:19.153710+0000","last_unstale":"2024-09-21T09:14:14.018064+0000","last_undegraded":"2024-09-21T09:14:14.018064+0000","last_fullsized":"2024-09-21T09:14:14.018064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:14.017803+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:14.017803+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.017803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:42.779022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.843226+0000","last_change":"2024-09-21T09:13:53.843283+0000","last_active":"2024-09-21T09:13:53.843226+0000","last_peered":"2024-09-21T09:13:53.843226+0000","last_clean":"2024-09-21T09:13:53.843226+0000","last_became_active":"2024-09-21T09:11:00.852180+0000","last_became_peered":"2024-09-21T09:11:00.852180+0000","last_unstale":"2024-09-21T09:13:53.843226+0000","last_undegraded":"2024-09-21T09:13:53.843226+0000","last_fullsized":"2024-09-21T09:13:53.843226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.843025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.843025+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.843025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:37.219600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"91'18","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.004929+0000","last_change":"2024-09-21T09:14:10.005009+0000","last_active":"2024-09-21T09:14:10.004929+0000","last_peered":"2024-09-21T09:14:10.004929+0000","last_clean":"2024-09-21T09:14:10.004929+0000","last_became_active":"2024-09-21T09:11:02.855686+0000","last_became_peered":"2024-09-21T09:11:02.855686+0000","last_unstale":"2024-09-21T09:14:10.004929+0000","last_undegraded":"2024-09-21T09:14:10.004929+0000","last_fullsized":"2024-09-21T09:14:10.004929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:10.004733+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:10.004733+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.004733+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:36.172204+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.170518+0000","last_change":"2024-09-21T09:14:00.170569+0000","last_active":"2024-09-21T09:14:00.170518+0000","last_peered":"2024-09-21T09:14:00.170518+0000","last_clean":"2024-09-21T09:14:00.170518+0000","last_became_active":"2024-09-21T09:11:04.879818+0000","last_became_peered":"2024-09-21T09:11:04.879818+0000","last_unstale":"2024-09-21T09:14:00.170518+0000","last_undegraded":"2024-09-21T09:14:00.170518+0000","last_fullsized":"2024-09-21T09:14:00.170518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.170286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.170286+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.170286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:57:07.718054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"62'4","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.858693+0000","last_change":"2024-09-21T09:14:16.858759+0000","last_active":"2024-09-21T09:14:16.858693+0000","last_peered":"2024-09-21T09:14:16.858693+0000","last_clean":"2024-09-21T09:14:16.858693+0000","last_became_active":"2024-09-21T09:11:06.867999+0000","last_became_peered":"2024-09-21T09:11:06.867999+0000","last_unstale":"2024-09-21T09:14:16.858693+0000","last_undegraded":"2024-09-21T09:14:16.858693+0000","last_fullsized":"2024-09-21T09:14:16.858693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:16.858497+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:16.858497+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.858497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:14.384038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"71'12","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.686630+0000","last_change":"2024-09-21T09:13:57.686695+0000","last_active":"2024-09-21T09:13:57.686630+0000","last_peered":"2024-09-21T09:13:57.686630+0000","last_clean":"2024-09-21T09:13:57.686630+0000","last_became_active":"2024-09-21T09:10:58.846056+0000","last_became_peered":"2024-09-21T09:10:58.846056+0000","last_unstale":"2024-09-21T09:13:57.686630+0000","last_undegraded":"2024-09-21T09:13:57.686630+0000","last_fullsized":"2024-09-21T09:13:57.686630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'12","last_scrub_stamp":"2024-09-21T09:13:57.686428+0000","last_deep_scrub":"71'12","last_deep_scrub_stamp":"2024-09-21T09:13:57.686428+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.686428+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:21.833709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"91'20","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.701292+0000","last_change":"2024-09-21T09:13:52.701391+0000","last_active":"2024-09-21T09:13:52.701292+0000","last_peered":"2024-09-21T09:13:52.701292+0000","last_clean":"2024-09-21T09:13:52.701292+0000","last_became_active":"2024-09-21T09:13:19.142534+0000","last_became_peered":"2024-09-21T09:13:19.142534+0000","last_unstale":"2024-09-21T09:13:52.701292+0000","last_undegraded":"2024-09-21T09:13:52.701292+0000","last_fullsized":"2024-09-21T09:13:52.701292+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:13:52.701105+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:13:52.701105+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.701105+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:45.823860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.057742+0000","last_change":"2024-09-21T09:14:14.057867+0000","last_active":"2024-09-21T09:14:14.057742+0000","last_peered":"2024-09-21T09:14:14.057742+0000","last_clean":"2024-09-21T09:14:14.057742+0000","last_became_active":"2024-09-21T09:10:48.770552+0000","last_became_peered":"2024-09-21T09:10:48.770552+0000","last_unstale":"2024-09-21T09:14:14.057742+0000","last_undegraded":"2024-09-21T09:14:14.057742+0000","last_fullsized":"2024-09-21T09:14:14.057742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:14.057509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:14.057509+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.057509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:15:59.842475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00094581199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.386691+0000","last_change":"2024-09-21T09:13:58.386804+0000","last_active":"2024-09-21T09:13:58.386691+0000","last_peered":"2024-09-21T09:13:58.386691+0000","last_clean":"2024-09-21T09:13:58.386691+0000","last_became_active":"2024-09-21T09:11:00.854295+0000","last_became_peered":"2024-09-21T09:11:00.854295+0000","last_unstale":"2024-09-21T09:13:58.386691+0000","last_undegraded":"2024-09-21T09:13:58.386691+0000","last_fullsized":"2024-09-21T09:13:58.386691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.386389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.386389+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.386389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:18.298819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"91'42","reported_seq":202,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.859358+0000","last_change":"2024-09-21T09:13:52.859456+0000","last_active":"2024-09-21T09:13:52.859358+0000","last_peered":"2024-09-21T09:13:52.859358+0000","last_clean":"2024-09-21T09:13:52.859358+0000","last_became_active":"2024-09-21T09:11:02.863846+0000","last_became_peered":"2024-09-21T09:11:02.863846+0000","last_unstale":"2024-09-21T09:13:52.859358+0000","last_undegraded":"2024-09-21T09:13:52.859358+0000","last_fullsized":"2024-09-21T09:13:52.859358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'42","last_scrub_stamp":"2024-09-21T09:13:52.859171+0000","last_deep_scrub":"91'42","last_deep_scrub_stamp":"2024-09-21T09:13:52.859171+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.859171+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:10.155729+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:04.751230+0000","last_change":"2024-09-21T09:14:04.751361+0000","last_active":"2024-09-21T09:14:04.751230+0000","last_peered":"2024-09-21T09:14:04.751230+0000","last_clean":"2024-09-21T09:14:04.751230+0000","last_became_active":"2024-09-21T09:13:19.145677+0000","last_became_peered":"2024-09-21T09:13:19.145677+0000","last_unstale":"2024-09-21T09:14:04.751230+0000","last_undegraded":"2024-09-21T09:14:04.751230+0000","last_fullsized":"2024-09-21T09:14:04.751230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:04.750975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:04.750975+0000","last_clean_scrub_stamp":"2024-09-21T09:14:04.750975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:37.585793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"62'4","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:24.077280+0000","last_change":"2024-09-21T09:14:24.077346+0000","last_active":"2024-09-21T09:14:24.077280+0000","last_peered":"2024-09-21T09:14:24.077280+0000","last_clean":"2024-09-21T09:14:24.077280+0000","last_became_active":"2024-09-21T09:11:06.896069+0000","last_became_peered":"2024-09-21T09:11:06.896069+0000","last_unstale":"2024-09-21T09:14:24.077280+0000","last_undegraded":"2024-09-21T09:14:24.077280+0000","last_fullsized":"2024-09-21T09:14:24.077280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:24.077083+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:24.077083+0000","last_clean_scrub_stamp":"2024-09-21T09:14:24.077083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:55.910709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"61'2","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.892349+0000","last_change":"2024-09-21T09:14:10.892480+0000","last_active":"2024-09-21T09:14:10.892349+0000","last_peered":"2024-09-21T09:14:10.892349+0000","last_clean":"2024-09-21T09:14:10.892349+0000","last_became_active":"2024-09-21T09:10:58.825049+0000","last_became_peered":"2024-09-21T09:10:58.825049+0000","last_unstale":"2024-09-21T09:14:10.892349+0000","last_undegraded":"2024-09-21T09:14:10.892349+0000","last_fullsized":"2024-09-21T09:14:10.892349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-21T09:14:10.892096+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-21T09:14:10.892096+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.892096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:18.014615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"91'20","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.759091+0000","last_change":"2024-09-21T09:14:05.759150+0000","last_active":"2024-09-21T09:14:05.759091+0000","last_peered":"2024-09-21T09:14:05.759091+0000","last_clean":"2024-09-21T09:14:05.759091+0000","last_became_active":"2024-09-21T09:10:56.850911+0000","last_became_peered":"2024-09-21T09:10:56.850911+0000","last_unstale":"2024-09-21T09:14:05.759091+0000","last_undegraded":"2024-09-21T09:14:05.759091+0000","last_fullsized":"2024-09-21T09:14:05.759091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:14:05.758902+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:14:05.758902+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.758902+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:32.501862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:25.171066+0000","last_change":"2024-09-21T09:14:25.171119+0000","last_active":"2024-09-21T09:14:25.171066+0000","last_peered":"2024-09-21T09:14:25.171066+0000","last_clean":"2024-09-21T09:14:25.171066+0000","last_became_active":"2024-09-21T09:10:48.764739+0000","last_became_peered":"2024-09-21T09:10:48.764739+0000","last_unstale":"2024-09-21T09:14:25.171066+0000","last_undegraded":"2024-09-21T09:14:25.171066+0000","last_fullsized":"2024-09-21T09:14:25.171066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:25.170867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:25.170867+0000","last_clean_scrub_stamp":"2024-09-21T09:14:25.170867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:31.234300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.172169+0000","last_change":"2024-09-21T09:13:53.172223+0000","last_active":"2024-09-21T09:13:53.172169+0000","last_peered":"2024-09-21T09:13:53.172169+0000","last_clean":"2024-09-21T09:13:53.172169+0000","last_became_active":"2024-09-21T09:11:00.846427+0000","last_became_peered":"2024-09-21T09:11:00.846427+0000","last_unstale":"2024-09-21T09:13:53.172169+0000","last_undegraded":"2024-09-21T09:13:53.172169+0000","last_fullsized":"2024-09-21T09:13:53.172169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.171979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.171979+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.171979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:07.384344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"91'21","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.646202+0000","last_change":"2024-09-21T09:13:56.646284+0000","last_active":"2024-09-21T09:13:56.646202+0000","last_peered":"2024-09-21T09:13:56.646202+0000","last_clean":"2024-09-21T09:13:56.646202+0000","last_became_active":"2024-09-21T09:11:02.862164+0000","last_became_peered":"2024-09-21T09:11:02.862164+0000","last_unstale":"2024-09-21T09:13:56.646202+0000","last_undegraded":"2024-09-21T09:13:56.646202+0000","last_fullsized":"2024-09-21T09:13:56.646202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'21","last_scrub_stamp":"2024-09-21T09:13:56.646017+0000","last_deep_scrub":"91'21","last_deep_scrub_stamp":"2024-09-21T09:13:56.646017+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.646017+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:30.090553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"91'105","reported_seq":275,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.937050+0000","last_change":"2024-09-21T09:14:14.937120+0000","last_active":"2024-09-21T09:14:14.937050+0000","last_peered":"2024-09-21T09:14:14.937050+0000","last_clean":"2024-09-21T09:14:14.937050+0000","last_became_active":"2024-09-21T09:11:04.893453+0000","last_became_peered":"2024-09-21T09:11:04.893453+0000","last_unstale":"2024-09-21T09:14:14.937050+0000","last_undegraded":"2024-09-21T09:14:14.937050+0000","last_fullsized":"2024-09-21T09:14:14.937050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:14:14.936862+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:14:14.936862+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.936862+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:43.698081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"71'4","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.749177+0000","last_change":"2024-09-21T09:14:12.749240+0000","last_active":"2024-09-21T09:14:12.749177+0000","last_peered":"2024-09-21T09:14:12.749177+0000","last_clean":"2024-09-21T09:14:12.749177+0000","last_became_active":"2024-09-21T09:11:06.880411+0000","last_became_peered":"2024-09-21T09:11:06.880411+0000","last_unstale":"2024-09-21T09:14:12.749177+0000","last_undegraded":"2024-09-21T09:14:12.749177+0000","last_fullsized":"2024-09-21T09:14:12.749177+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:14:12.748923+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:14:12.748923+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.748923+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:50.691179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.566849+0000","last_change":"2024-09-21T09:14:07.566908+0000","last_active":"2024-09-21T09:14:07.566849+0000","last_peered":"2024-09-21T09:14:07.566849+0000","last_clean":"2024-09-21T09:14:07.566849+0000","last_became_active":"2024-09-21T09:10:58.868109+0000","last_became_peered":"2024-09-21T09:10:58.868109+0000","last_unstale":"2024-09-21T09:14:07.566849+0000","last_undegraded":"2024-09-21T09:14:07.566849+0000","last_fullsized":"2024-09-21T09:14:07.566849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:07.566625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:07.566625+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.566625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:17.707996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"91'8","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.486506+0000","last_change":"2024-09-21T09:14:17.486566+0000","last_active":"2024-09-21T09:14:17.486506+0000","last_peered":"2024-09-21T09:14:17.486506+0000","last_clean":"2024-09-21T09:14:17.486506+0000","last_became_active":"2024-09-21T09:10:56.852386+0000","last_became_peered":"2024-09-21T09:10:56.852386+0000","last_unstale":"2024-09-21T09:14:17.486506+0000","last_undegraded":"2024-09-21T09:14:17.486506+0000","last_fullsized":"2024-09-21T09:14:17.486506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-09-21T09:14:17.486265+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-09-21T09:14:17.486265+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.486265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:13:06.161521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.503334+0000","last_change":"2024-09-21T09:14:12.503475+0000","last_active":"2024-09-21T09:14:12.503334+0000","last_peered":"2024-09-21T09:14:12.503334+0000","last_clean":"2024-09-21T09:14:12.503334+0000","last_became_active":"2024-09-21T09:10:49.047204+0000","last_became_peered":"2024-09-21T09:10:49.047204+0000","last_unstale":"2024-09-21T09:14:12.503334+0000","last_undegraded":"2024-09-21T09:14:12.503334+0000","last_fullsized":"2024-09-21T09:14:12.503334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:12.503093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:12.503093+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.503093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:25.941287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091075300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:21.245673+0000","last_change":"2024-09-21T09:14:21.245730+0000","last_active":"2024-09-21T09:14:21.245673+0000","last_peered":"2024-09-21T09:14:21.245673+0000","last_clean":"2024-09-21T09:14:21.245673+0000","last_became_active":"2024-09-21T09:11:00.848327+0000","last_became_peered":"2024-09-21T09:11:00.848327+0000","last_unstale":"2024-09-21T09:14:21.245673+0000","last_undegraded":"2024-09-21T09:14:21.245673+0000","last_fullsized":"2024-09-21T09:14:21.245673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:21.245485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:21.245485+0000","last_clean_scrub_stamp":"2024-09-21T09:14:21.245485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:52.325633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"91'16","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.258104+0000","last_change":"2024-09-21T09:14:06.258177+0000","last_active":"2024-09-21T09:14:06.258104+0000","last_peered":"2024-09-21T09:14:06.258104+0000","last_clean":"2024-09-21T09:14:06.258104+0000","last_became_active":"2024-09-21T09:11:02.852043+0000","last_became_peered":"2024-09-21T09:11:02.852043+0000","last_unstale":"2024-09-21T09:14:06.258104+0000","last_undegraded":"2024-09-21T09:14:06.258104+0000","last_fullsized":"2024-09-21T09:14:06.258104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:06.257920+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:06.257920+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.257920+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:15.871331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"91'110","reported_seq":300,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:28.967375+0000","last_change":"2024-09-21T09:14:28.967445+0000","last_active":"2024-09-21T09:14:28.967375+0000","last_peered":"2024-09-21T09:14:28.967375+0000","last_clean":"2024-09-21T09:14:28.967375+0000","last_became_active":"2024-09-21T09:13:22.164964+0000","last_became_peered":"2024-09-21T09:13:22.164964+0000","last_unstale":"2024-09-21T09:14:28.967375+0000","last_undegraded":"2024-09-21T09:14:28.967375+0000","last_fullsized":"2024-09-21T09:14:28.967375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'110","last_scrub_stamp":"2024-09-21T09:14:28.967180+0000","last_deep_scrub":"91'110","last_deep_scrub_stamp":"2024-09-21T09:14:28.967180+0000","last_clean_scrub_stamp":"2024-09-21T09:14:28.967180+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:25.578585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"62'2","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.954714+0000","last_change":"2024-09-21T09:13:52.954779+0000","last_active":"2024-09-21T09:13:52.954714+0000","last_peered":"2024-09-21T09:13:52.954714+0000","last_clean":"2024-09-21T09:13:52.954714+0000","last_became_active":"2024-09-21T09:11:06.886663+0000","last_became_peered":"2024-09-21T09:11:06.886663+0000","last_unstale":"2024-09-21T09:13:52.954714+0000","last_undegraded":"2024-09-21T09:13:52.954714+0000","last_fullsized":"2024-09-21T09:13:52.954714+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:52.954481+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:52.954481+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.954481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:17.101762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.757036+0000","last_change":"2024-09-21T09:14:08.757091+0000","last_active":"2024-09-21T09:14:08.757036+0000","last_peered":"2024-09-21T09:14:08.757036+0000","last_clean":"2024-09-21T09:14:08.757036+0000","last_became_active":"2024-09-21T09:13:19.158513+0000","last_became_peered":"2024-09-21T09:13:19.158513+0000","last_unstale":"2024-09-21T09:14:08.757036+0000","last_undegraded":"2024-09-21T09:14:08.757036+0000","last_fullsized":"2024-09-21T09:14:08.757036+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:08.756832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:08.756832+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.756832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:09.179899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"91'12","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.504720+0000","last_change":"2024-09-21T09:14:15.504779+0000","last_active":"2024-09-21T09:14:15.504720+0000","last_peered":"2024-09-21T09:14:15.504720+0000","last_clean":"2024-09-21T09:14:15.504720+0000","last_became_active":"2024-09-21T09:10:56.848101+0000","last_became_peered":"2024-09-21T09:10:56.848101+0000","last_unstale":"2024-09-21T09:14:15.504720+0000","last_undegraded":"2024-09-21T09:14:15.504720+0000","last_fullsized":"2024-09-21T09:14:15.504720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-21T09:14:15.504520+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-21T09:14:15.504520+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.504520+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:11.748618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:26.160950+0000","last_change":"2024-09-21T09:14:26.161003+0000","last_active":"2024-09-21T09:14:26.160950+0000","last_peered":"2024-09-21T09:14:26.160950+0000","last_clean":"2024-09-21T09:14:26.160950+0000","last_became_active":"2024-09-21T09:10:49.045268+0000","last_became_peered":"2024-09-21T09:10:49.045268+0000","last_unstale":"2024-09-21T09:14:26.160950+0000","last_undegraded":"2024-09-21T09:14:26.160950+0000","last_fullsized":"2024-09-21T09:14:26.160950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:26.160748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:26.160748+0000","last_clean_scrub_stamp":"2024-09-21T09:14:26.160748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:05.168260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096597999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:22.454564+0000","last_change":"2024-09-21T09:14:22.454629+0000","last_active":"2024-09-21T09:14:22.454564+0000","last_peered":"2024-09-21T09:14:22.454564+0000","last_clean":"2024-09-21T09:14:22.454564+0000","last_became_active":"2024-09-21T09:13:19.152735+0000","last_became_peered":"2024-09-21T09:13:19.152735+0000","last_unstale":"2024-09-21T09:14:22.454564+0000","last_undegraded":"2024-09-21T09:14:22.454564+0000","last_fullsized":"2024-09-21T09:14:22.454564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:22.454366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:22.454366+0000","last_clean_scrub_stamp":"2024-09-21T09:14:22.454366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:36:57.221333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"91'51","reported_seq":219,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.202033+0000","last_change":"2024-09-21T09:13:55.202110+0000","last_active":"2024-09-21T09:13:55.202033+0000","last_peered":"2024-09-21T09:13:55.202033+0000","last_clean":"2024-09-21T09:13:55.202033+0000","last_became_active":"2024-09-21T09:11:02.855959+0000","last_became_peered":"2024-09-21T09:11:02.855959+0000","last_unstale":"2024-09-21T09:13:55.202033+0000","last_undegraded":"2024-09-21T09:13:55.202033+0000","last_fullsized":"2024-09-21T09:13:55.202033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'51","last_scrub_stamp":"2024-09-21T09:13:55.201857+0000","last_deep_scrub":"91'51","last_deep_scrub_stamp":"2024-09-21T09:13:55.201857+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.201857+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:49.637255+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.394550+0000","last_change":"2024-09-21T09:13:53.394609+0000","last_active":"2024-09-21T09:13:53.394550+0000","last_peered":"2024-09-21T09:13:53.394550+0000","last_clean":"2024-09-21T09:13:53.394550+0000","last_became_active":"2024-09-21T09:11:04.871984+0000","last_became_peered":"2024-09-21T09:11:04.871984+0000","last_unstale":"2024-09-21T09:13:53.394550+0000","last_undegraded":"2024-09-21T09:13:53.394550+0000","last_fullsized":"2024-09-21T09:13:53.394550+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.394338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.394338+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.394338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:38.938159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"71'2","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.703982+0000","last_change":"2024-09-21T09:13:54.704208+0000","last_active":"2024-09-21T09:13:54.703982+0000","last_peered":"2024-09-21T09:13:54.703982+0000","last_clean":"2024-09-21T09:13:54.703982+0000","last_became_active":"2024-09-21T09:13:19.140926+0000","last_became_peered":"2024-09-21T09:13:19.140926+0000","last_unstale":"2024-09-21T09:13:54.703982+0000","last_undegraded":"2024-09-21T09:13:54.703982+0000","last_fullsized":"2024-09-21T09:13:54.703982+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:13:54.703715+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:13:54.703715+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.703715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:43.202883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":426,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:21.407237+0000","last_change":"2024-09-21T09:14:21.407293+0000","last_active":"2024-09-21T09:14:21.407237+0000","last_peered":"2024-09-21T09:14:21.407237+0000","last_clean":"2024-09-21T09:14:21.407237+0000","last_became_active":"2024-09-21T09:11:06.899830+0000","last_became_peered":"2024-09-21T09:11:06.899830+0000","last_unstale":"2024-09-21T09:14:21.407237+0000","last_undegraded":"2024-09-21T09:14:21.407237+0000","last_fullsized":"2024-09-21T09:14:21.407237+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:21.407012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:21.407012+0000","last_clean_scrub_stamp":"2024-09-21T09:14:21.407012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:00.913093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"71'4","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.675739+0000","last_change":"2024-09-21T09:13:51.675798+0000","last_active":"2024-09-21T09:13:51.675739+0000","last_peered":"2024-09-21T09:13:51.675739+0000","last_clean":"2024-09-21T09:13:51.675739+0000","last_became_active":"2024-09-21T09:13:19.158305+0000","last_became_peered":"2024-09-21T09:13:19.158305+0000","last_unstale":"2024-09-21T09:13:51.675739+0000","last_undegraded":"2024-09-21T09:13:51.675739+0000","last_fullsized":"2024-09-21T09:13:51.675739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:51.675546+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:51.675546+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.675546+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:44.873979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"91'16","reported_seq":211,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:38.115543+0000","last_change":"2024-09-21T09:14:38.115682+0000","last_active":"2024-09-21T09:14:38.115543+0000","last_peered":"2024-09-21T09:14:38.115543+0000","last_clean":"2024-09-21T09:14:38.115543+0000","last_became_active":"2024-09-21T09:13:19.168562+0000","last_became_peered":"2024-09-21T09:13:19.168562+0000","last_unstale":"2024-09-21T09:14:38.115543+0000","last_undegraded":"2024-09-21T09:14:38.115543+0000","last_fullsized":"2024-09-21T09:14:38.115543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:38.115295+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:38.115295+0000","last_clean_scrub_stamp":"2024-09-21T09:14:38.115295+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:25.470005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.640276+0000","last_change":"2024-09-21T09:13:53.640428+0000","last_active":"2024-09-21T09:13:53.640276+0000","last_peered":"2024-09-21T09:13:53.640276+0000","last_clean":"2024-09-21T09:13:53.640276+0000","last_became_active":"2024-09-21T09:11:00.838505+0000","last_became_peered":"2024-09-21T09:11:00.838505+0000","last_unstale":"2024-09-21T09:13:53.640276+0000","last_undegraded":"2024-09-21T09:13:53.640276+0000","last_fullsized":"2024-09-21T09:13:53.640276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:53.640034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:53.640034+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.640034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:54.097218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"91'26","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.721123+0000","last_change":"2024-09-21T09:13:58.721193+0000","last_active":"2024-09-21T09:13:58.721123+0000","last_peered":"2024-09-21T09:13:58.721123+0000","last_clean":"2024-09-21T09:13:58.721123+0000","last_became_active":"2024-09-21T09:11:02.871664+0000","last_became_peered":"2024-09-21T09:11:02.871664+0000","last_unstale":"2024-09-21T09:13:58.721123+0000","last_undegraded":"2024-09-21T09:13:58.721123+0000","last_fullsized":"2024-09-21T09:13:58.721123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:13:58.720936+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:13:58.720936+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.720936+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:47.220103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":40,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.821127+0000","last_change":"2024-09-21T09:14:10.821180+0000","last_active":"2024-09-21T09:14:10.821127+0000","last_peered":"2024-09-21T09:14:10.821127+0000","last_clean":"2024-09-21T09:14:10.821127+0000","last_became_active":"2024-09-21T09:11:04.879258+0000","last_became_peered":"2024-09-21T09:11:04.879258+0000","last_unstale":"2024-09-21T09:14:10.821127+0000","last_undegraded":"2024-09-21T09:14:10.821127+0000","last_fullsized":"2024-09-21T09:14:10.821127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:10.820920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:10.820920+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.820920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:32.967322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"61'16","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.754318+0000","last_change":"2024-09-21T09:14:15.754381+0000","last_active":"2024-09-21T09:14:15.754318+0000","last_peered":"2024-09-21T09:14:15.754318+0000","last_clean":"2024-09-21T09:14:15.754318+0000","last_became_active":"2024-09-21T09:11:06.891642+0000","last_became_peered":"2024-09-21T09:11:06.891642+0000","last_unstale":"2024-09-21T09:14:15.754318+0000","last_undegraded":"2024-09-21T09:14:15.754318+0000","last_fullsized":"2024-09-21T09:14:15.754318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'16","last_scrub_stamp":"2024-09-21T09:14:15.754114+0000","last_deep_scrub":"61'16","last_deep_scrub_stamp":"2024-09-21T09:14:15.754114+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.754114+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:49.108804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"62'6","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.571510+0000","last_change":"2024-09-21T09:14:05.571575+0000","last_active":"2024-09-21T09:14:05.571510+0000","last_peered":"2024-09-21T09:14:05.571510+0000","last_clean":"2024-09-21T09:14:05.571510+0000","last_became_active":"2024-09-21T09:10:58.868496+0000","last_became_peered":"2024-09-21T09:10:58.868496+0000","last_unstale":"2024-09-21T09:14:05.571510+0000","last_undegraded":"2024-09-21T09:14:05.571510+0000","last_fullsized":"2024-09-21T09:14:05.571510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'6","last_scrub_stamp":"2024-09-21T09:14:05.571300+0000","last_deep_scrub":"62'6","last_deep_scrub_stamp":"2024-09-21T09:14:05.571300+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.571300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:07.501896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"91'16","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.986041+0000","last_change":"2024-09-21T09:14:07.986109+0000","last_active":"2024-09-21T09:14:07.986041+0000","last_peered":"2024-09-21T09:14:07.986041+0000","last_clean":"2024-09-21T09:14:07.986041+0000","last_became_active":"2024-09-21T09:10:56.852730+0000","last_became_peered":"2024-09-21T09:10:56.852730+0000","last_unstale":"2024-09-21T09:14:07.986041+0000","last_undegraded":"2024-09-21T09:14:07.986041+0000","last_fullsized":"2024-09-21T09:14:07.986041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:07.985822+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:07.985822+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.985822+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:53.134912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.396996+0000","last_change":"2024-09-21T09:13:57.397053+0000","last_active":"2024-09-21T09:13:57.396996+0000","last_peered":"2024-09-21T09:13:57.396996+0000","last_clean":"2024-09-21T09:13:57.396996+0000","last_became_active":"2024-09-21T09:11:00.838547+0000","last_became_peered":"2024-09-21T09:11:00.838547+0000","last_unstale":"2024-09-21T09:13:57.396996+0000","last_undegraded":"2024-09-21T09:13:57.396996+0000","last_fullsized":"2024-09-21T09:13:57.396996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:57.396794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:57.396794+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.396794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:48.120616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"91'8","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:27.519512+0000","last_change":"2024-09-21T09:14:27.519583+0000","last_active":"2024-09-21T09:14:27.519512+0000","last_peered":"2024-09-21T09:14:27.519512+0000","last_clean":"2024-09-21T09:14:27.519512+0000","last_became_active":"2024-09-21T09:13:19.154000+0000","last_became_peered":"2024-09-21T09:13:19.154000+0000","last_unstale":"2024-09-21T09:14:27.519512+0000","last_undegraded":"2024-09-21T09:14:27.519512+0000","last_fullsized":"2024-09-21T09:14:27.519512+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-09-21T09:14:27.519314+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-09-21T09:14:27.519314+0000","last_clean_scrub_stamp":"2024-09-21T09:14:27.519314+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:39.941071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.788437+0000","last_change":"2024-09-21T09:14:07.788490+0000","last_active":"2024-09-21T09:14:07.788437+0000","last_peered":"2024-09-21T09:14:07.788437+0000","last_clean":"2024-09-21T09:14:07.788437+0000","last_became_active":"2024-09-21T09:13:19.157523+0000","last_became_peered":"2024-09-21T09:13:19.157523+0000","last_unstale":"2024-09-21T09:14:07.788437+0000","last_undegraded":"2024-09-21T09:14:07.788437+0000","last_fullsized":"2024-09-21T09:14:07.788437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:07.788239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:07.788239+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.788239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:10.459985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.906568+0000","last_change":"2024-09-21T09:14:13.906626+0000","last_active":"2024-09-21T09:14:13.906568+0000","last_peered":"2024-09-21T09:14:13.906568+0000","last_clean":"2024-09-21T09:14:13.906568+0000","last_became_active":"2024-09-21T09:11:06.878198+0000","last_became_peered":"2024-09-21T09:11:06.878198+0000","last_unstale":"2024-09-21T09:14:13.906568+0000","last_undegraded":"2024-09-21T09:14:13.906568+0000","last_fullsized":"2024-09-21T09:14:13.906568+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:13.906374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:13.906374+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.906374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:18:01.622451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:19.451727+0000","last_change":"2024-09-21T09:14:19.451832+0000","last_active":"2024-09-21T09:14:19.451727+0000","last_peered":"2024-09-21T09:14:19.451727+0000","last_clean":"2024-09-21T09:14:19.451727+0000","last_became_active":"2024-09-21T09:10:58.857469+0000","last_became_peered":"2024-09-21T09:10:58.857469+0000","last_unstale":"2024-09-21T09:14:19.451727+0000","last_undegraded":"2024-09-21T09:14:19.451727+0000","last_fullsized":"2024-09-21T09:14:19.451727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:19.451429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:19.451429+0000","last_clean_scrub_stamp":"2024-09-21T09:14:19.451429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:34.392239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"91'24","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.752707+0000","last_change":"2024-09-21T09:14:09.752840+0000","last_active":"2024-09-21T09:14:09.752707+0000","last_peered":"2024-09-21T09:14:09.752707+0000","last_clean":"2024-09-21T09:14:09.752707+0000","last_became_active":"2024-09-21T09:13:19.160370+0000","last_became_peered":"2024-09-21T09:13:19.160370+0000","last_unstale":"2024-09-21T09:14:09.752707+0000","last_undegraded":"2024-09-21T09:14:09.752707+0000","last_fullsized":"2024-09-21T09:14:09.752707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:09.752476+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:09.752476+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.752476+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:38.513695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.712188+0000","last_change":"2024-09-21T09:14:03.712240+0000","last_active":"2024-09-21T09:14:03.712188+0000","last_peered":"2024-09-21T09:14:03.712188+0000","last_clean":"2024-09-21T09:14:03.712188+0000","last_became_active":"2024-09-21T09:13:19.142672+0000","last_became_peered":"2024-09-21T09:13:19.142672+0000","last_unstale":"2024-09-21T09:14:03.712188+0000","last_undegraded":"2024-09-21T09:14:03.712188+0000","last_fullsized":"2024-09-21T09:14:03.712188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:03.711998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:03.711998+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.711998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:48.861088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"91'24","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.855899+0000","last_change":"2024-09-21T09:13:54.855982+0000","last_active":"2024-09-21T09:13:54.855899+0000","last_peered":"2024-09-21T09:13:54.855899+0000","last_clean":"2024-09-21T09:13:54.855899+0000","last_became_active":"2024-09-21T09:11:02.869013+0000","last_became_peered":"2024-09-21T09:11:02.869013+0000","last_unstale":"2024-09-21T09:13:54.855899+0000","last_undegraded":"2024-09-21T09:13:54.855899+0000","last_fullsized":"2024-09-21T09:13:54.855899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:13:54.855688+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:13:54.855688+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.855688+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:13.221656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.946140+0000","last_change":"2024-09-21T09:14:13.946199+0000","last_active":"2024-09-21T09:14:13.946140+0000","last_peered":"2024-09-21T09:14:13.946140+0000","last_clean":"2024-09-21T09:14:13.946140+0000","last_became_active":"2024-09-21T09:11:04.893007+0000","last_became_peered":"2024-09-21T09:11:04.893007+0000","last_unstale":"2024-09-21T09:14:13.946140+0000","last_undegraded":"2024-09-21T09:14:13.946140+0000","last_fullsized":"2024-09-21T09:14:13.946140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:13.945950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:13.945950+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.945950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:14.369017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"71'7","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:35.028532+0000","last_change":"2024-09-21T09:14:35.028594+0000","last_active":"2024-09-21T09:14:35.028532+0000","last_peered":"2024-09-21T09:14:35.028532+0000","last_clean":"2024-09-21T09:14:35.028532+0000","last_became_active":"2024-09-21T09:13:19.167169+0000","last_became_peered":"2024-09-21T09:13:19.167169+0000","last_unstale":"2024-09-21T09:14:35.028532+0000","last_undegraded":"2024-09-21T09:14:35.028532+0000","last_fullsized":"2024-09-21T09:14:35.028532+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'7","last_scrub_stamp":"2024-09-21T09:14:35.028305+0000","last_deep_scrub":"71'7","last_deep_scrub_stamp":"2024-09-21T09:14:35.028305+0000","last_clean_scrub_stamp":"2024-09-21T09:14:35.028305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:47:27.214272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.818363+0000","last_change":"2024-09-21T09:14:08.818422+0000","last_active":"2024-09-21T09:14:08.818363+0000","last_peered":"2024-09-21T09:14:08.818363+0000","last_clean":"2024-09-21T09:14:08.818363+0000","last_became_active":"2024-09-21T09:10:58.851745+0000","last_became_peered":"2024-09-21T09:10:58.851745+0000","last_unstale":"2024-09-21T09:14:08.818363+0000","last_undegraded":"2024-09-21T09:14:08.818363+0000","last_fullsized":"2024-09-21T09:14:08.818363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:08.818156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:08.818156+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.818156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:01.320634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'18","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:15.073913+0000","last_change":"2024-09-21T09:14:15.073977+0000","last_active":"2024-09-21T09:14:15.073913+0000","last_peered":"2024-09-21T09:14:15.073913+0000","last_clean":"2024-09-21T09:14:15.073913+0000","last_became_active":"2024-09-21T09:10:56.858798+0000","last_became_peered":"2024-09-21T09:10:56.858798+0000","last_unstale":"2024-09-21T09:14:15.073913+0000","last_undegraded":"2024-09-21T09:14:15.073913+0000","last_fullsized":"2024-09-21T09:14:15.073913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:15.073708+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:15.073708+0000","last_clean_scrub_stamp":"2024-09-21T09:14:15.073708+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:12.740626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.129722+0000","last_change":"2024-09-21T09:13:57.129779+0000","last_active":"2024-09-21T09:13:57.129722+0000","last_peered":"2024-09-21T09:13:57.129722+0000","last_clean":"2024-09-21T09:13:57.129722+0000","last_became_active":"2024-09-21T09:13:19.152722+0000","last_became_peered":"2024-09-21T09:13:19.152722+0000","last_unstale":"2024-09-21T09:13:57.129722+0000","last_undegraded":"2024-09-21T09:13:57.129722+0000","last_fullsized":"2024-09-21T09:13:57.129722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:57.129492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:57.129492+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.129492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:05:20.856713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"91'22","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.996434+0000","last_change":"2024-09-21T09:14:08.996509+0000","last_active":"2024-09-21T09:14:08.996434+0000","last_peered":"2024-09-21T09:14:08.996434+0000","last_clean":"2024-09-21T09:14:08.996434+0000","last_became_active":"2024-09-21T09:11:02.871728+0000","last_became_peered":"2024-09-21T09:11:02.871728+0000","last_unstale":"2024-09-21T09:14:08.996434+0000","last_undegraded":"2024-09-21T09:14:08.996434+0000","last_fullsized":"2024-09-21T09:14:08.996434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:08.996243+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:08.996243+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.996243+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:41.831061+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.732185+0000","last_change":"2024-09-21T09:14:16.732238+0000","last_active":"2024-09-21T09:14:16.732185+0000","last_peered":"2024-09-21T09:14:16.732185+0000","last_clean":"2024-09-21T09:14:16.732185+0000","last_became_active":"2024-09-21T09:13:19.143577+0000","last_became_peered":"2024-09-21T09:13:19.143577+0000","last_unstale":"2024-09-21T09:14:16.732185+0000","last_undegraded":"2024-09-21T09:14:16.732185+0000","last_fullsized":"2024-09-21T09:14:16.732185+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:16.731983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:16.731983+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.731983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:13.970493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"61'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.264898+0000","last_change":"2024-09-21T09:14:07.264966+0000","last_active":"2024-09-21T09:14:07.264898+0000","last_peered":"2024-09-21T09:14:07.264898+0000","last_clean":"2024-09-21T09:14:07.264898+0000","last_became_active":"2024-09-21T09:10:58.838429+0000","last_became_peered":"2024-09-21T09:10:58.838429+0000","last_unstale":"2024-09-21T09:14:07.264898+0000","last_undegraded":"2024-09-21T09:14:07.264898+0000","last_fullsized":"2024-09-21T09:14:07.264898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-21T09:14:07.264688+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-21T09:14:07.264688+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.264688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:02.039746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"91'18","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.018370+0000","last_change":"2024-09-21T09:14:13.018428+0000","last_active":"2024-09-21T09:14:13.018370+0000","last_peered":"2024-09-21T09:14:13.018370+0000","last_clean":"2024-09-21T09:14:13.018370+0000","last_became_active":"2024-09-21T09:10:56.862290+0000","last_became_peered":"2024-09-21T09:10:56.862290+0000","last_unstale":"2024-09-21T09:14:13.018370+0000","last_undegraded":"2024-09-21T09:14:13.018370+0000","last_fullsized":"2024-09-21T09:14:13.018370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:13.018185+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:13.018185+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.018185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:50.804706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.642143+0000","last_change":"2024-09-21T09:13:52.642236+0000","last_active":"2024-09-21T09:13:52.642143+0000","last_peered":"2024-09-21T09:13:52.642143+0000","last_clean":"2024-09-21T09:13:52.642143+0000","last_became_active":"2024-09-21T09:11:00.852423+0000","last_became_peered":"2024-09-21T09:11:00.852423+0000","last_unstale":"2024-09-21T09:13:52.642143+0000","last_undegraded":"2024-09-21T09:13:52.642143+0000","last_fullsized":"2024-09-21T09:13:52.642143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:52.641939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:52.641939+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.641939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:06.854304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"91'33","reported_seq":188,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.942951+0000","last_change":"2024-09-21T09:14:12.943117+0000","last_active":"2024-09-21T09:14:12.942951+0000","last_peered":"2024-09-21T09:14:12.942951+0000","last_clean":"2024-09-21T09:14:12.942951+0000","last_became_active":"2024-09-21T09:11:02.879117+0000","last_became_peered":"2024-09-21T09:11:02.879117+0000","last_unstale":"2024-09-21T09:14:12.942951+0000","last_undegraded":"2024-09-21T09:14:12.942951+0000","last_fullsized":"2024-09-21T09:14:12.942951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'33","last_scrub_stamp":"2024-09-21T09:14:12.942702+0000","last_deep_scrub":"91'33","last_deep_scrub_stamp":"2024-09-21T09:14:12.942702+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.942702+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:48:26.118072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.699873+0000","last_change":"2024-09-21T09:13:56.699926+0000","last_active":"2024-09-21T09:13:56.699873+0000","last_peered":"2024-09-21T09:13:56.699873+0000","last_clean":"2024-09-21T09:13:56.699873+0000","last_became_active":"2024-09-21T09:13:19.165859+0000","last_became_peered":"2024-09-21T09:13:19.165859+0000","last_unstale":"2024-09-21T09:13:56.699873+0000","last_undegraded":"2024-09-21T09:13:56.699873+0000","last_fullsized":"2024-09-21T09:13:56.699873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:56.699679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:56.699679+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.699679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:13.215807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:23.071255+0000","last_change":"2024-09-21T09:14:23.071400+0000","last_active":"2024-09-21T09:14:23.071255+0000","last_peered":"2024-09-21T09:14:23.071255+0000","last_clean":"2024-09-21T09:14:23.071255+0000","last_became_active":"2024-09-21T09:11:06.895301+0000","last_became_peered":"2024-09-21T09:11:06.895301+0000","last_unstale":"2024-09-21T09:14:23.071255+0000","last_undegraded":"2024-09-21T09:14:23.071255+0000","last_fullsized":"2024-09-21T09:14:23.071255+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:23.071029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:23.071029+0000","last_clean_scrub_stamp":"2024-09-21T09:14:23.071029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:22.877642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"71'10","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.510259+0000","last_change":"2024-09-21T09:14:03.510421+0000","last_active":"2024-09-21T09:14:03.510259+0000","last_peered":"2024-09-21T09:14:03.510259+0000","last_clean":"2024-09-21T09:14:03.510259+0000","last_became_active":"2024-09-21T09:10:58.868007+0000","last_became_peered":"2024-09-21T09:10:58.868007+0000","last_unstale":"2024-09-21T09:14:03.510259+0000","last_undegraded":"2024-09-21T09:14:03.510259+0000","last_fullsized":"2024-09-21T09:14:03.510259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:14:03.509980+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:14:03.509980+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.509980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:56.009549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"91'10","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:13.464829+0000","last_change":"2024-09-21T09:14:13.464897+0000","last_active":"2024-09-21T09:14:13.464829+0000","last_peered":"2024-09-21T09:14:13.464829+0000","last_clean":"2024-09-21T09:14:13.464829+0000","last_became_active":"2024-09-21T09:10:56.826355+0000","last_became_peered":"2024-09-21T09:10:56.826355+0000","last_unstale":"2024-09-21T09:14:13.464829+0000","last_undegraded":"2024-09-21T09:14:13.464829+0000","last_fullsized":"2024-09-21T09:14:13.464829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-21T09:14:13.464613+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-21T09:14:13.464613+0000","last_clean_scrub_stamp":"2024-09-21T09:14:13.464613+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.234660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.795572+0000","last_change":"2024-09-21T09:14:05.795627+0000","last_active":"2024-09-21T09:14:05.795572+0000","last_peered":"2024-09-21T09:14:05.795572+0000","last_clean":"2024-09-21T09:14:05.795572+0000","last_became_active":"2024-09-21T09:13:19.158652+0000","last_became_peered":"2024-09-21T09:13:19.158652+0000","last_unstale":"2024-09-21T09:14:05.795572+0000","last_undegraded":"2024-09-21T09:14:05.795572+0000","last_fullsized":"2024-09-21T09:14:05.795572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:05.795378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:05.795378+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.795378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:12.074752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"91'32","reported_seq":225,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:37.098919+0000","last_change":"2024-09-21T09:14:37.099083+0000","last_active":"2024-09-21T09:14:37.098919+0000","last_peered":"2024-09-21T09:14:37.098919+0000","last_clean":"2024-09-21T09:14:37.098919+0000","last_became_active":"2024-09-21T09:13:19.167344+0000","last_became_peered":"2024-09-21T09:13:19.167344+0000","last_unstale":"2024-09-21T09:14:37.098919+0000","last_undegraded":"2024-09-21T09:14:37.098919+0000","last_fullsized":"2024-09-21T09:14:37.098919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'32","last_scrub_stamp":"2024-09-21T09:14:37.098690+0000","last_deep_scrub":"91'32","last_deep_scrub_stamp":"2024-09-21T09:14:37.098690+0000","last_clean_scrub_stamp":"2024-09-21T09:14:37.098690+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:44.713283+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.043595+0000","last_change":"2024-09-21T09:14:12.043651+0000","last_active":"2024-09-21T09:14:12.043595+0000","last_peered":"2024-09-21T09:14:12.043595+0000","last_clean":"2024-09-21T09:14:12.043595+0000","last_became_active":"2024-09-21T09:11:04.889945+0000","last_became_peered":"2024-09-21T09:11:04.889945+0000","last_unstale":"2024-09-21T09:14:12.043595+0000","last_undegraded":"2024-09-21T09:14:12.043595+0000","last_fullsized":"2024-09-21T09:14:12.043595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:12.043399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:12.043399+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.043399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:20.820974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"71'2","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.193736+0000","last_change":"2024-09-21T09:13:52.193764+0000","last_active":"2024-09-21T09:13:52.193736+0000","last_peered":"2024-09-21T09:13:52.193736+0000","last_clean":"2024-09-21T09:13:52.193736+0000","last_became_active":"2024-09-21T09:11:06.888007+0000","last_became_peered":"2024-09-21T09:11:06.888007+0000","last_unstale":"2024-09-21T09:13:52.193736+0000","last_undegraded":"2024-09-21T09:13:52.193736+0000","last_fullsized":"2024-09-21T09:13:52.193736+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:13:52.193636+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:13:52.193636+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.193636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:37:37.470983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"62'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.833452+0000","last_change":"2024-09-21T09:14:05.833512+0000","last_active":"2024-09-21T09:14:05.833452+0000","last_peered":"2024-09-21T09:14:05.833452+0000","last_clean":"2024-09-21T09:14:05.833452+0000","last_became_active":"2024-09-21T09:10:58.852034+0000","last_became_peered":"2024-09-21T09:10:58.852034+0000","last_unstale":"2024-09-21T09:14:05.833452+0000","last_undegraded":"2024-09-21T09:14:05.833452+0000","last_fullsized":"2024-09-21T09:14:05.833452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:05.833245+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:05.833245+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.833245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:16.336869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"91'20","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.846236+0000","last_change":"2024-09-21T09:14:09.846299+0000","last_active":"2024-09-21T09:14:09.846236+0000","last_peered":"2024-09-21T09:14:09.846236+0000","last_clean":"2024-09-21T09:14:09.846236+0000","last_became_active":"2024-09-21T09:10:56.862633+0000","last_became_peered":"2024-09-21T09:10:56.862633+0000","last_unstale":"2024-09-21T09:14:09.846236+0000","last_undegraded":"2024-09-21T09:14:09.846236+0000","last_fullsized":"2024-09-21T09:14:09.846236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:14:09.846044+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:14:09.846044+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.846044+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:42.680862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"91'2","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.778729+0000","last_change":"2024-09-21T09:14:16.778794+0000","last_active":"2024-09-21T09:14:16.778729+0000","last_peered":"2024-09-21T09:14:16.778729+0000","last_clean":"2024-09-21T09:14:16.778729+0000","last_became_active":"2024-09-21T09:13:19.165929+0000","last_became_peered":"2024-09-21T09:13:19.165929+0000","last_unstale":"2024-09-21T09:14:16.778729+0000","last_undegraded":"2024-09-21T09:14:16.778729+0000","last_fullsized":"2024-09-21T09:14:16.778729+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-21T09:14:16.778533+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-21T09:14:16.778533+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.778533+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:18.318541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"91'24","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.759353+0000","last_change":"2024-09-21T09:14:02.759443+0000","last_active":"2024-09-21T09:14:02.759353+0000","last_peered":"2024-09-21T09:14:02.759353+0000","last_clean":"2024-09-21T09:14:02.759353+0000","last_became_active":"2024-09-21T09:11:02.878545+0000","last_became_peered":"2024-09-21T09:11:02.878545+0000","last_unstale":"2024-09-21T09:14:02.759353+0000","last_undegraded":"2024-09-21T09:14:02.759353+0000","last_fullsized":"2024-09-21T09:14:02.759353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:02.759160+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:02.759160+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.759160+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:55.261638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":134,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.843099+0000","last_change":"2024-09-21T09:14:00.843157+0000","last_active":"2024-09-21T09:14:00.843099+0000","last_peered":"2024-09-21T09:14:00.843099+0000","last_clean":"2024-09-21T09:14:00.843099+0000","last_became_active":"2024-09-21T09:11:04.880036+0000","last_became_peered":"2024-09-21T09:11:04.880036+0000","last_unstale":"2024-09-21T09:14:00.843099+0000","last_undegraded":"2024-09-21T09:14:00.843099+0000","last_fullsized":"2024-09-21T09:14:00.843099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.842897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.842897+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.842897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:37.126044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"62'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.144792+0000","last_change":"2024-09-21T09:13:51.144825+0000","last_active":"2024-09-21T09:13:51.144792+0000","last_peered":"2024-09-21T09:13:51.144792+0000","last_clean":"2024-09-21T09:13:51.144792+0000","last_became_active":"2024-09-21T09:11:06.897694+0000","last_became_peered":"2024-09-21T09:11:06.897694+0000","last_unstale":"2024-09-21T09:13:51.144792+0000","last_undegraded":"2024-09-21T09:13:51.144792+0000","last_fullsized":"2024-09-21T09:13:51.144792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'10","last_scrub_stamp":"2024-09-21T09:13:51.144678+0000","last_deep_scrub":"62'10","last_deep_scrub_stamp":"2024-09-21T09:13:51.144678+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.144678+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:19.905897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":39,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.534284+0000","last_change":"2024-09-21T09:14:09.534342+0000","last_active":"2024-09-21T09:14:09.534284+0000","last_peered":"2024-09-21T09:14:09.534284+0000","last_clean":"2024-09-21T09:14:09.534284+0000","last_became_active":"2024-09-21T09:10:58.868073+0000","last_became_peered":"2024-09-21T09:10:58.868073+0000","last_unstale":"2024-09-21T09:14:09.534284+0000","last_undegraded":"2024-09-21T09:14:09.534284+0000","last_fullsized":"2024-09-21T09:14:09.534284+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:09.534080+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:09.534080+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.534080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:36.639543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"91'24","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.484076+0000","last_change":"2024-09-21T09:14:16.484148+0000","last_active":"2024-09-21T09:14:16.484076+0000","last_peered":"2024-09-21T09:14:16.484076+0000","last_clean":"2024-09-21T09:14:16.484076+0000","last_became_active":"2024-09-21T09:10:56.849228+0000","last_became_peered":"2024-09-21T09:10:56.849228+0000","last_unstale":"2024-09-21T09:14:16.484076+0000","last_undegraded":"2024-09-21T09:14:16.484076+0000","last_fullsized":"2024-09-21T09:14:16.484076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:16.483880+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:16.483880+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.483880+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:09.794271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.453959+0000","last_change":"2024-09-21T09:14:00.454139+0000","last_active":"2024-09-21T09:14:00.453959+0000","last_peered":"2024-09-21T09:14:00.453959+0000","last_clean":"2024-09-21T09:14:00.453959+0000","last_became_active":"2024-09-21T09:11:00.855955+0000","last_became_peered":"2024-09-21T09:11:00.855955+0000","last_unstale":"2024-09-21T09:14:00.453959+0000","last_undegraded":"2024-09-21T09:14:00.453959+0000","last_fullsized":"2024-09-21T09:14:00.453959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:00.453712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:00.453712+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.453712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:03.275108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"91'21","reported_seq":205,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:36.082647+0000","last_change":"2024-09-21T09:14:36.082737+0000","last_active":"2024-09-21T09:14:36.082647+0000","last_peered":"2024-09-21T09:14:36.082647+0000","last_clean":"2024-09-21T09:14:36.082647+0000","last_became_active":"2024-09-21T09:13:19.167321+0000","last_became_peered":"2024-09-21T09:13:19.167321+0000","last_unstale":"2024-09-21T09:14:36.082647+0000","last_undegraded":"2024-09-21T09:14:36.082647+0000","last_fullsized":"2024-09-21T09:14:36.082647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'21","last_scrub_stamp":"2024-09-21T09:14:36.082447+0000","last_deep_scrub":"91'21","last_deep_scrub_stamp":"2024-09-21T09:14:36.082447+0000","last_clean_scrub_stamp":"2024-09-21T09:14:36.082447+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:34.586673+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2406,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"91'105","reported_seq":283,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.984999+0000","last_change":"2024-09-21T09:14:10.985061+0000","last_active":"2024-09-21T09:14:10.984999+0000","last_peered":"2024-09-21T09:14:10.984999+0000","last_clean":"2024-09-21T09:14:10.984999+0000","last_became_active":"2024-09-21T09:11:04.869734+0000","last_became_peered":"2024-09-21T09:11:04.869734+0000","last_unstale":"2024-09-21T09:14:10.984999+0000","last_undegraded":"2024-09-21T09:14:10.984999+0000","last_fullsized":"2024-09-21T09:14:10.984999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'105","last_scrub_stamp":"2024-09-21T09:14:10.984812+0000","last_deep_scrub":"91'105","last_deep_scrub_stamp":"2024-09-21T09:14:10.984812+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.984812+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:04:18.107331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"58'2","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.191989+0000","last_change":"2024-09-21T09:13:54.192051+0000","last_active":"2024-09-21T09:13:54.191989+0000","last_peered":"2024-09-21T09:13:54.191989+0000","last_clean":"2024-09-21T09:13:54.191989+0000","last_became_active":"2024-09-21T09:11:06.882700+0000","last_became_peered":"2024-09-21T09:11:06.882700+0000","last_unstale":"2024-09-21T09:13:54.191989+0000","last_undegraded":"2024-09-21T09:13:54.191989+0000","last_fullsized":"2024-09-21T09:13:54.191989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:13:54.191786+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:13:54.191786+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.191786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:02.969361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"71'10","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.677726+0000","last_change":"2024-09-21T09:13:53.677785+0000","last_active":"2024-09-21T09:13:53.677726+0000","last_peered":"2024-09-21T09:13:53.677726+0000","last_clean":"2024-09-21T09:13:53.677726+0000","last_became_active":"2024-09-21T09:13:19.159904+0000","last_became_peered":"2024-09-21T09:13:19.159904+0000","last_unstale":"2024-09-21T09:13:53.677726+0000","last_undegraded":"2024-09-21T09:13:53.677726+0000","last_fullsized":"2024-09-21T09:13:53.677726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:13:53.677529+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:13:53.677529+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.677529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:17.824810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"91'22","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.867232+0000","last_change":"2024-09-21T09:14:08.867353+0000","last_active":"2024-09-21T09:14:08.867232+0000","last_peered":"2024-09-21T09:14:08.867232+0000","last_clean":"2024-09-21T09:14:08.867232+0000","last_became_active":"2024-09-21T09:10:56.851515+0000","last_became_peered":"2024-09-21T09:10:56.851515+0000","last_unstale":"2024-09-21T09:14:08.867232+0000","last_undegraded":"2024-09-21T09:14:08.867232+0000","last_fullsized":"2024-09-21T09:14:08.867232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:08.866992+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:08.866992+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.866992+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:54.016082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:54.808379+0000","last_change":"2024-09-21T09:13:54.808438+0000","last_active":"2024-09-21T09:13:54.808379+0000","last_peered":"2024-09-21T09:13:54.808379+0000","last_clean":"2024-09-21T09:13:54.808379+0000","last_became_active":"2024-09-21T09:11:00.839102+0000","last_became_peered":"2024-09-21T09:11:00.839102+0000","last_unstale":"2024-09-21T09:13:54.808379+0000","last_undegraded":"2024-09-21T09:13:54.808379+0000","last_fullsized":"2024-09-21T09:13:54.808379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:54.808158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:54.808158+0000","last_clean_scrub_stamp":"2024-09-21T09:13:54.808158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:12.602854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"91'31","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:57.145113+0000","last_change":"2024-09-21T09:13:57.145195+0000","last_active":"2024-09-21T09:13:57.145113+0000","last_peered":"2024-09-21T09:13:57.145113+0000","last_clean":"2024-09-21T09:13:57.145113+0000","last_became_active":"2024-09-21T09:11:02.856303+0000","last_became_peered":"2024-09-21T09:11:02.856303+0000","last_unstale":"2024-09-21T09:13:57.145113+0000","last_undegraded":"2024-09-21T09:13:57.145113+0000","last_fullsized":"2024-09-21T09:13:57.145113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'31","last_scrub_stamp":"2024-09-21T09:13:57.144916+0000","last_deep_scrub":"91'31","last_deep_scrub_stamp":"2024-09-21T09:13:57.144916+0000","last_clean_scrub_stamp":"2024-09-21T09:13:57.144916+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:50.267672+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.430683+0000","last_change":"2024-09-21T09:13:55.430833+0000","last_active":"2024-09-21T09:13:55.430683+0000","last_peered":"2024-09-21T09:13:55.430683+0000","last_clean":"2024-09-21T09:13:55.430683+0000","last_became_active":"2024-09-21T09:11:04.871535+0000","last_became_peered":"2024-09-21T09:11:04.871535+0000","last_unstale":"2024-09-21T09:13:55.430683+0000","last_undegraded":"2024-09-21T09:13:55.430683+0000","last_fullsized":"2024-09-21T09:13:55.430683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:55.430438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:55.430438+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.430438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:51:15.880700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"71'10","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.814870+0000","last_change":"2024-09-21T09:14:17.814930+0000","last_active":"2024-09-21T09:14:17.814870+0000","last_peered":"2024-09-21T09:14:17.814870+0000","last_clean":"2024-09-21T09:14:17.814870+0000","last_became_active":"2024-09-21T09:11:06.872905+0000","last_became_peered":"2024-09-21T09:11:06.872905+0000","last_unstale":"2024-09-21T09:14:17.814870+0000","last_undegraded":"2024-09-21T09:14:17.814870+0000","last_fullsized":"2024-09-21T09:14:17.814870+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'10","last_scrub_stamp":"2024-09-21T09:14:17.814659+0000","last_deep_scrub":"71'10","last_deep_scrub_stamp":"2024-09-21T09:14:17.814659+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.814659+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:26.592234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.736545+0000","last_change":"2024-09-21T09:14:02.736598+0000","last_active":"2024-09-21T09:14:02.736545+0000","last_peered":"2024-09-21T09:14:02.736545+0000","last_clean":"2024-09-21T09:14:02.736545+0000","last_became_active":"2024-09-21T09:13:19.143746+0000","last_became_peered":"2024-09-21T09:13:19.143746+0000","last_unstale":"2024-09-21T09:14:02.736545+0000","last_undegraded":"2024-09-21T09:14:02.736545+0000","last_fullsized":"2024-09-21T09:14:02.736545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:02.736334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:02.736334+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.736334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:06.609424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"91'30","reported_seq":184,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.227457+0000","last_change":"2024-09-21T09:13:53.227523+0000","last_active":"2024-09-21T09:13:53.227457+0000","last_peered":"2024-09-21T09:13:53.227457+0000","last_clean":"2024-09-21T09:13:53.227457+0000","last_became_active":"2024-09-21T09:11:34.170599+0000","last_became_peered":"2024-09-21T09:11:34.170599+0000","last_unstale":"2024-09-21T09:13:53.227457+0000","last_undegraded":"2024-09-21T09:13:53.227457+0000","last_fullsized":"2024-09-21T09:13:53.227457+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'30","last_scrub_stamp":"2024-09-21T09:13:53.227240+0000","last_deep_scrub":"91'30","last_deep_scrub_stamp":"2024-09-21T09:13:53.227240+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.227240+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:50.752780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.691148+0000","last_change":"2024-09-21T09:14:01.691205+0000","last_active":"2024-09-21T09:14:01.691148+0000","last_peered":"2024-09-21T09:14:01.691148+0000","last_clean":"2024-09-21T09:14:01.691148+0000","last_became_active":"2024-09-21T09:13:19.141404+0000","last_became_peered":"2024-09-21T09:13:19.141404+0000","last_unstale":"2024-09-21T09:14:01.691148+0000","last_undegraded":"2024-09-21T09:14:01.691148+0000","last_fullsized":"2024-09-21T09:14:01.691148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.690948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.690948+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.690948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:39.633204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"91'22","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.471406+0000","last_change":"2024-09-21T09:14:02.471502+0000","last_active":"2024-09-21T09:14:02.471406+0000","last_peered":"2024-09-21T09:14:02.471406+0000","last_clean":"2024-09-21T09:14:02.471406+0000","last_became_active":"2024-09-21T09:11:02.847156+0000","last_became_peered":"2024-09-21T09:11:02.847156+0000","last_unstale":"2024-09-21T09:14:02.471406+0000","last_undegraded":"2024-09-21T09:14:02.471406+0000","last_fullsized":"2024-09-21T09:14:02.471406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:02.471144+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:02.471144+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.471144+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:11.892110+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.134742+0000","last_change":"2024-09-21T09:13:59.134849+0000","last_active":"2024-09-21T09:13:59.134742+0000","last_peered":"2024-09-21T09:13:59.134742+0000","last_clean":"2024-09-21T09:13:59.134742+0000","last_became_active":"2024-09-21T09:11:04.880142+0000","last_became_peered":"2024-09-21T09:11:04.880142+0000","last_unstale":"2024-09-21T09:13:59.134742+0000","last_undegraded":"2024-09-21T09:13:59.134742+0000","last_fullsized":"2024-09-21T09:13:59.134742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:59.134483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:59.134483+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.134483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:40.830729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:25.060563+0000","last_change":"2024-09-21T09:14:25.060698+0000","last_active":"2024-09-21T09:14:25.060563+0000","last_peered":"2024-09-21T09:14:25.060563+0000","last_clean":"2024-09-21T09:14:25.060563+0000","last_became_active":"2024-09-21T09:11:06.898600+0000","last_became_peered":"2024-09-21T09:11:06.898600+0000","last_unstale":"2024-09-21T09:14:25.060563+0000","last_undegraded":"2024-09-21T09:14:25.060563+0000","last_fullsized":"2024-09-21T09:14:25.060563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:25.060262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:25.060262+0000","last_clean_scrub_stamp":"2024-09-21T09:14:25.060262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:34.673673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:06.847984+0000","last_change":"2024-09-21T09:14:06.848035+0000","last_active":"2024-09-21T09:14:06.847984+0000","last_peered":"2024-09-21T09:14:06.847984+0000","last_clean":"2024-09-21T09:14:06.847984+0000","last_became_active":"2024-09-21T09:10:58.851718+0000","last_became_peered":"2024-09-21T09:10:58.851718+0000","last_unstale":"2024-09-21T09:14:06.847984+0000","last_undegraded":"2024-09-21T09:14:06.847984+0000","last_fullsized":"2024-09-21T09:14:06.847984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:06.847793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:06.847793+0000","last_clean_scrub_stamp":"2024-09-21T09:14:06.847793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:54.140783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"91'22","reported_seq":230,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:26.985041+0000","last_change":"2024-09-21T09:14:26.985103+0000","last_active":"2024-09-21T09:14:26.985041+0000","last_peered":"2024-09-21T09:14:26.985041+0000","last_clean":"2024-09-21T09:14:26.985041+0000","last_became_active":"2024-09-21T09:13:19.169569+0000","last_became_peered":"2024-09-21T09:13:19.169569+0000","last_unstale":"2024-09-21T09:14:26.985041+0000","last_undegraded":"2024-09-21T09:14:26.985041+0000","last_fullsized":"2024-09-21T09:14:26.985041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:26.984826+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:26.984826+0000","last_clean_scrub_stamp":"2024-09-21T09:14:26.984826+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:06.739164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:49.711655+0000","last_change":"2024-09-21T09:13:49.711711+0000","last_active":"2024-09-21T09:13:49.711655+0000","last_peered":"2024-09-21T09:13:49.711655+0000","last_clean":"2024-09-21T09:13:49.711655+0000","last_became_active":"2024-09-21T09:11:00.836531+0000","last_became_peered":"2024-09-21T09:11:00.836531+0000","last_unstale":"2024-09-21T09:13:49.711655+0000","last_undegraded":"2024-09-21T09:13:49.711655+0000","last_fullsized":"2024-09-21T09:13:49.711655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:49.711547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:49.711547+0000","last_clean_scrub_stamp":"2024-09-21T09:13:49.711547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:08.077515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"91'16","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:18.929143+0000","last_change":"2024-09-21T09:14:18.929213+0000","last_active":"2024-09-21T09:14:18.929143+0000","last_peered":"2024-09-21T09:14:18.929143+0000","last_clean":"2024-09-21T09:14:18.929143+0000","last_became_active":"2024-09-21T09:13:19.150207+0000","last_became_peered":"2024-09-21T09:13:19.150207+0000","last_unstale":"2024-09-21T09:14:18.929143+0000","last_undegraded":"2024-09-21T09:14:18.929143+0000","last_fullsized":"2024-09-21T09:14:18.929143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:18.928398+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:18.928398+0000","last_clean_scrub_stamp":"2024-09-21T09:14:18.928398+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:09.856947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:58.159493+0000","last_change":"2024-09-21T09:13:58.159551+0000","last_active":"2024-09-21T09:13:58.159493+0000","last_peered":"2024-09-21T09:13:58.159493+0000","last_clean":"2024-09-21T09:13:58.159493+0000","last_became_active":"2024-09-21T09:11:04.886365+0000","last_became_peered":"2024-09-21T09:11:04.886365+0000","last_unstale":"2024-09-21T09:13:58.159493+0000","last_undegraded":"2024-09-21T09:13:58.159493+0000","last_fullsized":"2024-09-21T09:13:58.159493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:58.159293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:58.159293+0000","last_clean_scrub_stamp":"2024-09-21T09:13:58.159293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:00.285955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.140566+0000","last_change":"2024-09-21T09:14:01.140618+0000","last_active":"2024-09-21T09:14:01.140566+0000","last_peered":"2024-09-21T09:14:01.140566+0000","last_clean":"2024-09-21T09:14:01.140566+0000","last_became_active":"2024-09-21T09:13:19.157306+0000","last_became_peered":"2024-09-21T09:13:19.157306+0000","last_unstale":"2024-09-21T09:14:01.140566+0000","last_undegraded":"2024-09-21T09:14:01.140566+0000","last_fullsized":"2024-09-21T09:14:01.140566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.140359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.140359+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.140359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:42.381193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"71'4","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.716046+0000","last_change":"2024-09-21T09:13:59.716197+0000","last_active":"2024-09-21T09:13:59.716046+0000","last_peered":"2024-09-21T09:13:59.716046+0000","last_clean":"2024-09-21T09:13:59.716046+0000","last_became_active":"2024-09-21T09:13:19.161496+0000","last_became_peered":"2024-09-21T09:13:19.161496+0000","last_unstale":"2024-09-21T09:13:59.716046+0000","last_undegraded":"2024-09-21T09:13:59.716046+0000","last_fullsized":"2024-09-21T09:13:59.716046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:59.715805+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:59.715805+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.715805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:21.862207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"91'8","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.072526+0000","last_change":"2024-09-21T09:14:16.072589+0000","last_active":"2024-09-21T09:14:16.072526+0000","last_peered":"2024-09-21T09:14:16.072526+0000","last_clean":"2024-09-21T09:14:16.072526+0000","last_became_active":"2024-09-21T09:10:56.860727+0000","last_became_peered":"2024-09-21T09:10:56.860727+0000","last_unstale":"2024-09-21T09:14:16.072526+0000","last_undegraded":"2024-09-21T09:14:16.072526+0000","last_fullsized":"2024-09-21T09:14:16.072526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-09-21T09:14:16.072291+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-09-21T09:14:16.072291+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.072291+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:17.612299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"91'2","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.415530+0000","last_change":"2024-09-21T09:13:59.415662+0000","last_active":"2024-09-21T09:13:59.415530+0000","last_peered":"2024-09-21T09:13:59.415530+0000","last_clean":"2024-09-21T09:13:59.415530+0000","last_became_active":"2024-09-21T09:11:00.837466+0000","last_became_peered":"2024-09-21T09:11:00.837466+0000","last_unstale":"2024-09-21T09:13:59.415530+0000","last_undegraded":"2024-09-21T09:13:59.415530+0000","last_fullsized":"2024-09-21T09:13:59.415530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-09-21T09:13:59.415299+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-09-21T09:13:59.415299+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.415299+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:12.290157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"91'24","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.190973+0000","last_change":"2024-09-21T09:14:02.191055+0000","last_active":"2024-09-21T09:14:02.190973+0000","last_peered":"2024-09-21T09:14:02.190973+0000","last_clean":"2024-09-21T09:14:02.190973+0000","last_became_active":"2024-09-21T09:11:02.876303+0000","last_became_peered":"2024-09-21T09:11:02.876303+0000","last_unstale":"2024-09-21T09:14:02.190973+0000","last_undegraded":"2024-09-21T09:14:02.190973+0000","last_fullsized":"2024-09-21T09:14:02.190973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:02.190779+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:02.190779+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.190779+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:00:09.648803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":155,"num_write":18,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.362314+0000","last_change":"2024-09-21T09:13:51.362369+0000","last_active":"2024-09-21T09:13:51.362314+0000","last_peered":"2024-09-21T09:13:51.362314+0000","last_clean":"2024-09-21T09:13:51.362314+0000","last_became_active":"2024-09-21T09:11:04.895368+0000","last_became_peered":"2024-09-21T09:11:04.895368+0000","last_unstale":"2024-09-21T09:13:51.362314+0000","last_undegraded":"2024-09-21T09:13:51.362314+0000","last_fullsized":"2024-09-21T09:13:51.362314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:51.362073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:51.362073+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.362073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:33.156385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"58'2","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:14.985468+0000","last_change":"2024-09-21T09:14:14.985542+0000","last_active":"2024-09-21T09:14:14.985468+0000","last_peered":"2024-09-21T09:14:14.985468+0000","last_clean":"2024-09-21T09:14:14.985468+0000","last_became_active":"2024-09-21T09:13:19.153765+0000","last_became_peered":"2024-09-21T09:13:19.153765+0000","last_unstale":"2024-09-21T09:14:14.985468+0000","last_undegraded":"2024-09-21T09:14:14.985468+0000","last_fullsized":"2024-09-21T09:14:14.985468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-21T09:14:14.985207+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-21T09:14:14.985207+0000","last_clean_scrub_stamp":"2024-09-21T09:14:14.985207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:41.152678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"71'6","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.503346+0000","last_change":"2024-09-21T09:14:11.503406+0000","last_active":"2024-09-21T09:14:11.503346+0000","last_peered":"2024-09-21T09:14:11.503346+0000","last_clean":"2024-09-21T09:14:11.503346+0000","last_became_active":"2024-09-21T09:10:58.864294+0000","last_became_peered":"2024-09-21T09:10:58.864294+0000","last_unstale":"2024-09-21T09:14:11.503346+0000","last_undegraded":"2024-09-21T09:14:11.503346+0000","last_fullsized":"2024-09-21T09:14:11.503346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-09-21T09:14:11.503143+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-09-21T09:14:11.503143+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.503143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:59.824868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"91'14","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:50.681288+0000","last_change":"2024-09-21T09:13:50.681323+0000","last_active":"2024-09-21T09:13:50.681288+0000","last_peered":"2024-09-21T09:13:50.681288+0000","last_clean":"2024-09-21T09:13:50.681288+0000","last_became_active":"2024-09-21T09:13:19.143052+0000","last_became_peered":"2024-09-21T09:13:19.143052+0000","last_unstale":"2024-09-21T09:13:50.681288+0000","last_undegraded":"2024-09-21T09:13:50.681288+0000","last_fullsized":"2024-09-21T09:13:50.681288+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:13:50.681171+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:13:50.681171+0000","last_clean_scrub_stamp":"2024-09-21T09:13:50.681171+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:45.116569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"71'8","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.803558+0000","last_change":"2024-09-21T09:14:09.803621+0000","last_active":"2024-09-21T09:14:09.803558+0000","last_peered":"2024-09-21T09:14:09.803558+0000","last_clean":"2024-09-21T09:14:09.803558+0000","last_became_active":"2024-09-21T09:10:58.870546+0000","last_became_peered":"2024-09-21T09:10:58.870546+0000","last_unstale":"2024-09-21T09:14:09.803558+0000","last_undegraded":"2024-09-21T09:14:09.803558+0000","last_fullsized":"2024-09-21T09:14:09.803558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'8","last_scrub_stamp":"2024-09-21T09:14:09.803351+0000","last_deep_scrub":"71'8","last_deep_scrub_stamp":"2024-09-21T09:14:09.803351+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.803351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:11:22.726504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"91'16","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:03.828782+0000","last_change":"2024-09-21T09:14:03.828841+0000","last_active":"2024-09-21T09:14:03.828782+0000","last_peered":"2024-09-21T09:14:03.828782+0000","last_clean":"2024-09-21T09:14:03.828782+0000","last_became_active":"2024-09-21T09:10:56.847152+0000","last_became_peered":"2024-09-21T09:10:56.847152+0000","last_unstale":"2024-09-21T09:14:03.828782+0000","last_undegraded":"2024-09-21T09:14:03.828782+0000","last_fullsized":"2024-09-21T09:14:03.828782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:03.828580+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:03.828580+0000","last_clean_scrub_stamp":"2024-09-21T09:14:03.828580+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:27.975861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:12.326876+0000","last_change":"2024-09-21T09:14:12.326945+0000","last_active":"2024-09-21T09:14:12.326876+0000","last_peered":"2024-09-21T09:14:12.326876+0000","last_clean":"2024-09-21T09:14:12.326876+0000","last_became_active":"2024-09-21T09:10:58.837226+0000","last_became_peered":"2024-09-21T09:10:58.837226+0000","last_unstale":"2024-09-21T09:14:12.326876+0000","last_undegraded":"2024-09-21T09:14:12.326876+0000","last_fullsized":"2024-09-21T09:14:12.326876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:12.326655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:12.326655+0000","last_clean_scrub_stamp":"2024-09-21T09:14:12.326655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:32.984164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:16.343011+0000","last_change":"2024-09-21T09:14:16.343071+0000","last_active":"2024-09-21T09:14:16.343011+0000","last_peered":"2024-09-21T09:14:16.343011+0000","last_clean":"2024-09-21T09:14:16.343011+0000","last_became_active":"2024-09-21T09:10:56.861715+0000","last_became_peered":"2024-09-21T09:10:56.861715+0000","last_unstale":"2024-09-21T09:14:16.343011+0000","last_undegraded":"2024-09-21T09:14:16.343011+0000","last_fullsized":"2024-09-21T09:14:16.343011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:16.342810+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:16.342810+0000","last_clean_scrub_stamp":"2024-09-21T09:14:16.342810+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:53:32.019749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"58'4","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:27.951107+0000","last_change":"2024-09-21T09:14:27.951140+0000","last_active":"2024-09-21T09:14:27.951107+0000","last_peered":"2024-09-21T09:14:27.951107+0000","last_clean":"2024-09-21T09:14:27.951107+0000","last_became_active":"2024-09-21T09:13:19.169698+0000","last_became_peered":"2024-09-21T09:13:19.169698+0000","last_unstale":"2024-09-21T09:14:27.951107+0000","last_undegraded":"2024-09-21T09:14:27.951107+0000","last_fullsized":"2024-09-21T09:14:27.951107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'4","last_scrub_stamp":"2024-09-21T09:14:27.950996+0000","last_deep_scrub":"58'4","last_deep_scrub_stamp":"2024-09-21T09:14:27.950996+0000","last_clean_scrub_stamp":"2024-09-21T09:14:27.950996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:06.279478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"91'12","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:08.950158+0000","last_change":"2024-09-21T09:14:08.950286+0000","last_active":"2024-09-21T09:14:08.950158+0000","last_peered":"2024-09-21T09:14:08.950158+0000","last_clean":"2024-09-21T09:14:08.950158+0000","last_became_active":"2024-09-21T09:10:56.864593+0000","last_became_peered":"2024-09-21T09:10:56.864593+0000","last_unstale":"2024-09-21T09:14:08.950158+0000","last_undegraded":"2024-09-21T09:14:08.950158+0000","last_fullsized":"2024-09-21T09:14:08.950158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-09-21T09:14:08.949916+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-09-21T09:14:08.949916+0000","last_clean_scrub_stamp":"2024-09-21T09:14:08.949916+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:37.711136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"58'6","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:00.991436+0000","last_change":"2024-09-21T09:14:00.991495+0000","last_active":"2024-09-21T09:14:00.991436+0000","last_peered":"2024-09-21T09:14:00.991436+0000","last_clean":"2024-09-21T09:14:00.991436+0000","last_became_active":"2024-09-21T09:10:58.839336+0000","last_became_peered":"2024-09-21T09:10:58.839336+0000","last_unstale":"2024-09-21T09:14:00.991436+0000","last_undegraded":"2024-09-21T09:14:00.991436+0000","last_fullsized":"2024-09-21T09:14:00.991436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'6","last_scrub_stamp":"2024-09-21T09:14:00.991188+0000","last_deep_scrub":"58'6","last_deep_scrub_stamp":"2024-09-21T09:14:00.991188+0000","last_clean_scrub_stamp":"2024-09-21T09:14:00.991188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:38.933444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"91'16","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.808170+0000","last_change":"2024-09-21T09:14:07.808227+0000","last_active":"2024-09-21T09:14:07.808170+0000","last_peered":"2024-09-21T09:14:07.808170+0000","last_clean":"2024-09-21T09:14:07.808170+0000","last_became_active":"2024-09-21T09:10:56.858887+0000","last_became_peered":"2024-09-21T09:10:56.858887+0000","last_unstale":"2024-09-21T09:14:07.808170+0000","last_undegraded":"2024-09-21T09:14:07.808170+0000","last_fullsized":"2024-09-21T09:14:07.808170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:07.807970+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:07.807970+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.807970+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:52.957059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"71'4","reported_seq":157,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:56.178229+0000","last_change":"2024-09-21T09:13:56.178383+0000","last_active":"2024-09-21T09:13:56.178229+0000","last_peered":"2024-09-21T09:13:56.178229+0000","last_clean":"2024-09-21T09:13:56.178229+0000","last_became_active":"2024-09-21T09:10:58.835849+0000","last_became_peered":"2024-09-21T09:10:58.835849+0000","last_unstale":"2024-09-21T09:13:56.178229+0000","last_undegraded":"2024-09-21T09:13:56.178229+0000","last_fullsized":"2024-09-21T09:13:56.178229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:13:56.177990+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:13:56.177990+0000","last_clean_scrub_stamp":"2024-09-21T09:13:56.177990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:49.376423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"91'16","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:09.851375+0000","last_change":"2024-09-21T09:14:09.851439+0000","last_active":"2024-09-21T09:14:09.851375+0000","last_peered":"2024-09-21T09:14:09.851375+0000","last_clean":"2024-09-21T09:14:09.851375+0000","last_became_active":"2024-09-21T09:10:56.861805+0000","last_became_peered":"2024-09-21T09:10:56.861805+0000","last_unstale":"2024-09-21T09:14:09.851375+0000","last_undegraded":"2024-09-21T09:14:09.851375+0000","last_fullsized":"2024-09-21T09:14:09.851375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:09.851186+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:09.851186+0000","last_clean_scrub_stamp":"2024-09-21T09:14:09.851186+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:16.130560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"62'2","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:11.915466+0000","last_change":"2024-09-21T09:14:11.915637+0000","last_active":"2024-09-21T09:14:11.915466+0000","last_peered":"2024-09-21T09:14:11.915466+0000","last_clean":"2024-09-21T09:14:11.915466+0000","last_became_active":"2024-09-21T09:10:58.825684+0000","last_became_peered":"2024-09-21T09:10:58.825684+0000","last_unstale":"2024-09-21T09:14:11.915466+0000","last_undegraded":"2024-09-21T09:14:11.915466+0000","last_fullsized":"2024-09-21T09:14:11.915466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:14:11.915220+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:14:11.915220+0000","last_clean_scrub_stamp":"2024-09-21T09:14:11.915220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:14.586965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"91'18","reported_seq":78,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.731811+0000","last_change":"2024-09-21T09:14:10.731967+0000","last_active":"2024-09-21T09:14:10.731811+0000","last_peered":"2024-09-21T09:14:10.731811+0000","last_clean":"2024-09-21T09:14:10.731811+0000","last_became_active":"2024-09-21T09:13:19.161214+0000","last_became_peered":"2024-09-21T09:13:19.161214+0000","last_unstale":"2024-09-21T09:14:10.731811+0000","last_undegraded":"2024-09-21T09:14:10.731811+0000","last_fullsized":"2024-09-21T09:14:10.731811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:10.731581+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:10.731581+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.731581+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:36.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"62'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:51.736604+0000","last_change":"2024-09-21T09:13:51.736626+0000","last_active":"2024-09-21T09:13:51.736604+0000","last_peered":"2024-09-21T09:13:51.736604+0000","last_clean":"2024-09-21T09:13:51.736604+0000","last_became_active":"2024-09-21T09:10:58.871607+0000","last_became_peered":"2024-09-21T09:10:58.871607+0000","last_unstale":"2024-09-21T09:13:51.736604+0000","last_undegraded":"2024-09-21T09:13:51.736604+0000","last_fullsized":"2024-09-21T09:13:51.736604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:51.736518+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:51.736518+0000","last_clean_scrub_stamp":"2024-09-21T09:13:51.736518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:14.149656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"91'18","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:18.059723+0000","last_change":"2024-09-21T09:14:18.059791+0000","last_active":"2024-09-21T09:14:18.059723+0000","last_peered":"2024-09-21T09:14:18.059723+0000","last_clean":"2024-09-21T09:14:18.059723+0000","last_became_active":"2024-09-21T09:10:56.859717+0000","last_became_peered":"2024-09-21T09:10:56.859717+0000","last_unstale":"2024-09-21T09:14:18.059723+0000","last_undegraded":"2024-09-21T09:14:18.059723+0000","last_fullsized":"2024-09-21T09:14:18.059723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:18.059533+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:18.059533+0000","last_clean_scrub_stamp":"2024-09-21T09:14:18.059533+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:53.020993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"71'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:07.856039+0000","last_change":"2024-09-21T09:14:07.856104+0000","last_active":"2024-09-21T09:14:07.856039+0000","last_peered":"2024-09-21T09:14:07.856039+0000","last_clean":"2024-09-21T09:14:07.856039+0000","last_became_active":"2024-09-21T09:10:58.854525+0000","last_became_peered":"2024-09-21T09:10:58.854525+0000","last_unstale":"2024-09-21T09:14:07.856039+0000","last_undegraded":"2024-09-21T09:14:07.856039+0000","last_fullsized":"2024-09-21T09:14:07.856039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'2","last_scrub_stamp":"2024-09-21T09:14:07.855831+0000","last_deep_scrub":"71'2","last_deep_scrub_stamp":"2024-09-21T09:14:07.855831+0000","last_clean_scrub_stamp":"2024-09-21T09:14:07.855831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:24.371959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"91'14","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:20.280021+0000","last_change":"2024-09-21T09:14:20.280079+0000","last_active":"2024-09-21T09:14:20.280021+0000","last_peered":"2024-09-21T09:14:20.280021+0000","last_clean":"2024-09-21T09:14:20.280021+0000","last_became_active":"2024-09-21T09:10:56.847464+0000","last_became_peered":"2024-09-21T09:10:56.847464+0000","last_unstale":"2024-09-21T09:14:20.280021+0000","last_undegraded":"2024-09-21T09:14:20.280021+0000","last_fullsized":"2024-09-21T09:14:20.280021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'14","last_scrub_stamp":"2024-09-21T09:14:20.279832+0000","last_deep_scrub":"91'14","last_deep_scrub_stamp":"2024-09-21T09:14:20.279832+0000","last_clean_scrub_stamp":"2024-09-21T09:14:20.279832+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:15.343840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"62'2","reported_seq":152,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:52.135852+0000","last_change":"2024-09-21T09:13:52.135885+0000","last_active":"2024-09-21T09:13:52.135852+0000","last_peered":"2024-09-21T09:13:52.135852+0000","last_clean":"2024-09-21T09:13:52.135852+0000","last_became_active":"2024-09-21T09:10:58.851082+0000","last_became_peered":"2024-09-21T09:10:58.851082+0000","last_unstale":"2024-09-21T09:13:52.135852+0000","last_undegraded":"2024-09-21T09:13:52.135852+0000","last_fullsized":"2024-09-21T09:13:52.135852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:52.135752+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:52.135752+0000","last_clean_scrub_stamp":"2024-09-21T09:13:52.135752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:56.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"91'24","reported_seq":236,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:26.022884+0000","last_change":"2024-09-21T09:14:26.022947+0000","last_active":"2024-09-21T09:14:26.022884+0000","last_peered":"2024-09-21T09:14:26.022884+0000","last_clean":"2024-09-21T09:14:26.022884+0000","last_became_active":"2024-09-21T09:13:19.169480+0000","last_became_peered":"2024-09-21T09:13:19.169480+0000","last_unstale":"2024-09-21T09:14:26.022884+0000","last_undegraded":"2024-09-21T09:14:26.022884+0000","last_fullsized":"2024-09-21T09:14:26.022884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'24","last_scrub_stamp":"2024-09-21T09:14:26.022690+0000","last_deep_scrub":"91'24","last_deep_scrub_stamp":"2024-09-21T09:14:26.022690+0000","last_clean_scrub_stamp":"2024-09-21T09:14:26.022690+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:20.797748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":146,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:02.946506+0000","last_change":"2024-09-21T09:14:02.946557+0000","last_active":"2024-09-21T09:14:02.946506+0000","last_peered":"2024-09-21T09:14:02.946506+0000","last_clean":"2024-09-21T09:14:02.946506+0000","last_became_active":"2024-09-21T09:10:58.842894+0000","last_became_peered":"2024-09-21T09:10:58.842894+0000","last_unstale":"2024-09-21T09:14:02.946506+0000","last_undegraded":"2024-09-21T09:14:02.946506+0000","last_fullsized":"2024-09-21T09:14:02.946506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:02.946351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:02.946351+0000","last_clean_scrub_stamp":"2024-09-21T09:14:02.946351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:48.095441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:05.885130+0000","last_change":"2024-09-21T09:14:05.885193+0000","last_active":"2024-09-21T09:14:05.885130+0000","last_peered":"2024-09-21T09:14:05.885130+0000","last_clean":"2024-09-21T09:14:05.885130+0000","last_became_active":"2024-09-21T09:10:56.838368+0000","last_became_peered":"2024-09-21T09:10:56.838368+0000","last_unstale":"2024-09-21T09:14:05.885130+0000","last_undegraded":"2024-09-21T09:14:05.885130+0000","last_fullsized":"2024-09-21T09:14:05.885130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-21T09:14:05.884933+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-21T09:14:05.884933+0000","last_clean_scrub_stamp":"2024-09-21T09:14:05.884933+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:19.026961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"62'2","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:53.775875+0000","last_change":"2024-09-21T09:13:53.775933+0000","last_active":"2024-09-21T09:13:53.775875+0000","last_peered":"2024-09-21T09:13:53.775875+0000","last_clean":"2024-09-21T09:13:53.775875+0000","last_became_active":"2024-09-21T09:10:58.868793+0000","last_became_peered":"2024-09-21T09:10:58.868793+0000","last_unstale":"2024-09-21T09:13:53.775875+0000","last_undegraded":"2024-09-21T09:13:53.775875+0000","last_fullsized":"2024-09-21T09:13:53.775875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-21T09:13:53.775675+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-21T09:13:53.775675+0000","last_clean_scrub_stamp":"2024-09-21T09:13:53.775675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:56:07.988041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'26","reported_seq":244,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:25.502071+0000","last_change":"2024-09-21T09:14:25.502130+0000","last_active":"2024-09-21T09:14:25.502071+0000","last_peered":"2024-09-21T09:14:25.502071+0000","last_clean":"2024-09-21T09:14:25.502071+0000","last_became_active":"2024-09-21T09:13:19.153073+0000","last_became_peered":"2024-09-21T09:13:19.153073+0000","last_unstale":"2024-09-21T09:14:25.502071+0000","last_undegraded":"2024-09-21T09:14:25.502071+0000","last_fullsized":"2024-09-21T09:14:25.502071+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:25.501877+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:25.501877+0000","last_clean_scrub_stamp":"2024-09-21T09:14:25.501877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:04.290812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:55.828058+0000","last_change":"2024-09-21T09:13:55.828116+0000","last_active":"2024-09-21T09:13:55.828058+0000","last_peered":"2024-09-21T09:13:55.828058+0000","last_clean":"2024-09-21T09:13:55.828058+0000","last_became_active":"2024-09-21T09:10:58.839479+0000","last_became_peered":"2024-09-21T09:10:58.839479+0000","last_unstale":"2024-09-21T09:13:55.828058+0000","last_undegraded":"2024-09-21T09:13:55.828058+0000","last_fullsized":"2024-09-21T09:13:55.828058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:13:55.827822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:13:55.827822+0000","last_clean_scrub_stamp":"2024-09-21T09:13:55.827822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:50.263220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"91'26","reported_seq":177,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.093705+0000","last_change":"2024-09-21T09:14:01.093772+0000","last_active":"2024-09-21T09:14:01.093705+0000","last_peered":"2024-09-21T09:14:01.093705+0000","last_clean":"2024-09-21T09:14:01.093705+0000","last_became_active":"2024-09-21T09:10:56.840706+0000","last_became_peered":"2024-09-21T09:10:56.840706+0000","last_unstale":"2024-09-21T09:14:01.093705+0000","last_undegraded":"2024-09-21T09:14:01.093705+0000","last_fullsized":"2024-09-21T09:14:01.093705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'26","last_scrub_stamp":"2024-09-21T09:14:01.093485+0000","last_deep_scrub":"91'26","last_deep_scrub_stamp":"2024-09-21T09:14:01.093485+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.093485+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:17.609612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'2","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.863628+0000","last_change":"2024-09-21T09:13:59.863692+0000","last_active":"2024-09-21T09:13:59.863628+0000","last_peered":"2024-09-21T09:13:59.863628+0000","last_clean":"2024-09-21T09:13:59.863628+0000","last_became_active":"2024-09-21T09:10:58.873144+0000","last_became_peered":"2024-09-21T09:10:58.873144+0000","last_unstale":"2024-09-21T09:13:59.863628+0000","last_undegraded":"2024-09-21T09:13:59.863628+0000","last_fullsized":"2024-09-21T09:13:59.863628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-21T09:13:59.863431+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-21T09:13:59.863431+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.863431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:00.320615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"91'10","reported_seq":159,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:29.134328+0000","last_change":"2024-09-21T09:14:29.134390+0000","last_active":"2024-09-21T09:14:29.134328+0000","last_peered":"2024-09-21T09:14:29.134328+0000","last_clean":"2024-09-21T09:14:29.134328+0000","last_became_active":"2024-09-21T09:10:56.842258+0000","last_became_peered":"2024-09-21T09:10:56.842258+0000","last_unstale":"2024-09-21T09:14:29.134328+0000","last_undegraded":"2024-09-21T09:14:29.134328+0000","last_fullsized":"2024-09-21T09:14:29.134328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-09-21T09:14:29.134141+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-09-21T09:14:29.134141+0000","last_clean_scrub_stamp":"2024-09-21T09:14:29.134141+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:15.001650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"71'4","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:18.466107+0000","last_change":"2024-09-21T09:14:18.466171+0000","last_active":"2024-09-21T09:14:18.466107+0000","last_peered":"2024-09-21T09:14:18.466107+0000","last_clean":"2024-09-21T09:14:18.466107+0000","last_became_active":"2024-09-21T09:10:58.857394+0000","last_became_peered":"2024-09-21T09:10:58.857394+0000","last_unstale":"2024-09-21T09:14:18.466107+0000","last_undegraded":"2024-09-21T09:14:18.466107+0000","last_fullsized":"2024-09-21T09:14:18.466107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'4","last_scrub_stamp":"2024-09-21T09:14:18.465902+0000","last_deep_scrub":"71'4","last_deep_scrub_stamp":"2024-09-21T09:14:18.465902+0000","last_clean_scrub_stamp":"2024-09-21T09:14:18.465902+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:10:06.223698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"91'18","reported_seq":219,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:17.734470+0000","last_change":"2024-09-21T09:14:17.734528+0000","last_active":"2024-09-21T09:14:17.734470+0000","last_peered":"2024-09-21T09:14:17.734470+0000","last_clean":"2024-09-21T09:14:17.734470+0000","last_became_active":"2024-09-21T09:13:19.159408+0000","last_became_peered":"2024-09-21T09:13:19.159408+0000","last_unstale":"2024-09-21T09:14:17.734470+0000","last_undegraded":"2024-09-21T09:14:17.734470+0000","last_fullsized":"2024-09-21T09:14:17.734470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'18","last_scrub_stamp":"2024-09-21T09:14:17.734276+0000","last_deep_scrub":"91'18","last_deep_scrub_stamp":"2024-09-21T09:14:17.734276+0000","last_clean_scrub_stamp":"2024-09-21T09:14:17.734276+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:50:48.160931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"71'6","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:13:59.792880+0000","last_change":"2024-09-21T09:13:59.793061+0000","last_active":"2024-09-21T09:13:59.792880+0000","last_peered":"2024-09-21T09:13:59.792880+0000","last_clean":"2024-09-21T09:13:59.792880+0000","last_became_active":"2024-09-21T09:10:58.839410+0000","last_became_peered":"2024-09-21T09:10:58.839410+0000","last_unstale":"2024-09-21T09:13:59.792880+0000","last_undegraded":"2024-09-21T09:13:59.792880+0000","last_fullsized":"2024-09-21T09:13:59.792880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'6","last_scrub_stamp":"2024-09-21T09:13:59.792653+0000","last_deep_scrub":"71'6","last_deep_scrub_stamp":"2024-09-21T09:13:59.792653+0000","last_clean_scrub_stamp":"2024-09-21T09:13:59.792653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:19:48.291820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'22","reported_seq":171,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:22.251171+0000","last_change":"2024-09-21T09:14:22.251257+0000","last_active":"2024-09-21T09:14:22.251171+0000","last_peered":"2024-09-21T09:14:22.251171+0000","last_clean":"2024-09-21T09:14:22.251171+0000","last_became_active":"2024-09-21T09:10:56.845551+0000","last_became_peered":"2024-09-21T09:10:56.845551+0000","last_unstale":"2024-09-21T09:14:22.251171+0000","last_undegraded":"2024-09-21T09:14:22.251171+0000","last_fullsized":"2024-09-21T09:14:22.251171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'22","last_scrub_stamp":"2024-09-21T09:14:22.250962+0000","last_deep_scrub":"91'22","last_deep_scrub_stamp":"2024-09-21T09:14:22.250962+0000","last_clean_scrub_stamp":"2024-09-21T09:14:22.250962+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:09.182054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"91'16","reported_seq":211,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:33.086046+0000","last_change":"2024-09-21T09:14:33.086089+0000","last_active":"2024-09-21T09:14:33.086046+0000","last_peered":"2024-09-21T09:14:33.086046+0000","last_clean":"2024-09-21T09:14:33.086046+0000","last_became_active":"2024-09-21T09:13:19.155182+0000","last_became_peered":"2024-09-21T09:13:19.155182+0000","last_unstale":"2024-09-21T09:14:33.086046+0000","last_undegraded":"2024-09-21T09:14:33.086046+0000","last_fullsized":"2024-09-21T09:14:33.086046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-09-21T09:14:33.085907+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-09-21T09:14:33.085907+0000","last_clean_scrub_stamp":"2024-09-21T09:14:33.085907+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:54:38.287953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:01.450792+0000","last_change":"2024-09-21T09:14:01.450850+0000","last_active":"2024-09-21T09:14:01.450792+0000","last_peered":"2024-09-21T09:14:01.450792+0000","last_clean":"2024-09-21T09:14:01.450792+0000","last_became_active":"2024-09-21T09:10:58.871078+0000","last_became_peered":"2024-09-21T09:10:58.871078+0000","last_unstale":"2024-09-21T09:14:01.450792+0000","last_undegraded":"2024-09-21T09:14:01.450792+0000","last_fullsized":"2024-09-21T09:14:01.450792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T09:14:01.450595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T09:14:01.450595+0000","last_clean_scrub_stamp":"2024-09-21T09:14:01.450595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:47.258642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"91'20","reported_seq":170,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:19.039322+0000","last_change":"2024-09-21T09:14:19.039383+0000","last_active":"2024-09-21T09:14:19.039322+0000","last_peered":"2024-09-21T09:14:19.039322+0000","last_clean":"2024-09-21T09:14:19.039322+0000","last_became_active":"2024-09-21T09:10:56.861753+0000","last_became_peered":"2024-09-21T09:10:56.861753+0000","last_unstale":"2024-09-21T09:14:19.039322+0000","last_undegraded":"2024-09-21T09:14:19.039322+0000","last_fullsized":"2024-09-21T09:14:19.039322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'20","last_scrub_stamp":"2024-09-21T09:14:19.039101+0000","last_deep_scrub":"91'20","last_deep_scrub_stamp":"2024-09-21T09:14:19.039101+0000","last_clean_scrub_stamp":"2024-09-21T09:14:19.039101+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:34.090036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"62'4","reported_seq":155,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T09:14:10.879373+0000","last_change":"2024-09-21T09:14:10.879439+0000","last_active":"2024-09-21T09:14:10.879373+0000","last_peered":"2024-09-21T09:14:10.879373+0000","last_clean":"2024-09-21T09:14:10.879373+0000","last_became_active":"2024-09-21T09:10:58.828653+0000","last_became_peered":"2024-09-21T09:10:58.828653+0000","last_unstale":"2024-09-21T09:14:10.879373+0000","last_undegraded":"2024-09-21T09:14:10.879373+0000","last_fullsized":"2024-09-21T09:14:10.879373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-21T09:14:10.879175+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-21T09:14:10.879175+0000","last_clean_scrub_stamp":"2024-09-21T09:14:10.879175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:17.158549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":233,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":848,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":845,"ondisk_log_size":845,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1023,"num_read_kb":1069,"num_write":533,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":660,"num_keys_recovered":24,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5468,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":923,"ondisk_log_size":923,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":250,"num_read_kb":250,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":545,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":23,"num_write":1216,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":1149239296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335412,"statfs":{"total":96636764160,"available":96599461888,"internally_reserved":0,"allocated":1110016,"data_stored":600664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335416,"statfs":{"total":96636764160,"available":96599465984,"internally_reserved":0,"allocated":1105920,"data_stored":599726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509495,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41164,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330676,"statfs":{"total":96636764160,"available":96594612224,"internally_reserved":0,"allocated":1699840,"data_stored":1190185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335420,"statfs":{"total":96636764160,"available":96599470080,"internally_reserved":0,"allocated":1101824,"data_stored":599552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40564,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331276,"statfs":{"total":96636764160,"available":96595226624,"internally_reserved":0,"allocated":1085440,"data_stored":599593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41188,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330652,"statfs":{"total":96636764160,"available":96594587648,"internally_reserved":0,"allocated":1724416,"data_stored":1190679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509494,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1134592,"data_stored":601322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40592,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331248,"statfs":{"total":96636764160,"available":96595197952,"internally_reserved":0,"allocated":1114112,"data_stored":600299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T09:14:53.725 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T09:14:54.091 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T09:14:54.091 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T09:14:54.091 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T09:14:54.091 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:14:54.163 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T09:14:54.164 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T09:14:54.164 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:14:54.250 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T09:14:54.250 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T09:14:54.250 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:14:54.349 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T09:14:54.350 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T09:14:54.350 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:14:54.445 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T09:14:54.445 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T09:14:54.446 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:14:54.536 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T09:14:54.536 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T09:14:54.536 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:14:55.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-21T09:14:55.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-21T09:14:55.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-21T09:14:55.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-21T09:15:00.637 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T09:15:00.638 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T09:15:00.638 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:15:01.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-21T09:15:01.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-21T09:15:01.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-21T09:15:01.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-21T09:15:01.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-21T09:15:06.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-21T09:15:06.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-21T09:15:06.739 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T09:15:06.740 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T09:15:06.740 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:15:06.799 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T09:15:06.799 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T09:15:06.799 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T09:15:06.799 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:15:06.827 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T09:15:06.827 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T09:15:06.828 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:15:06.858 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T09:15:06.858 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T09:15:06.859 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T09:15:06.859 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:15:06.893 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T09:15:06.893 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T09:15:06.894 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:15:06.953 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T09:15:06.953 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T09:15:06.954 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T09:15:06.971 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T09:15:06.971 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T09:15:06.972 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-21T09:15:07.017 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T09:15:07.017 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T09:15:07.344 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T09:15:07.345 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T09:15:07.533 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T09:15:07.533 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T09:15:07.723 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T09:15:07.723 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T09:15:07.908 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T09:15:07.908 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T09:15:08.087 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T09:15:08.087 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T09:15:08.262 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T09:15:08.262 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T09:15:08.421 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T09:15:08.422 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T09:15:08.587 INFO:tasks.ceph:Archiving mon data... 2024-09-21T09:15:08.588 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225/data/mon.a.tgz 2024-09-21T09:15:08.589 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-21T09:15:08.594 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.cWChC4GPIC 2024-09-21T09:15:08.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.cWChC4GPIC 2024-09-21T09:15:08.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.cWChC4GPIC 2024-09-21T09:15:08.830 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.cWChC4GPIC is 487KB 2024-09-21T09:15:08.891 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.cWChC4GPIC 2024-09-21T09:15:08.897 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225/data/mon.c.tgz 2024-09-21T09:15:08.897 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-21T09:15:08.946 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.Xd9cfcLqx6 2024-09-21T09:15:08.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Xd9cfcLqx6 2024-09-21T09:15:09.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.Xd9cfcLqx6 2024-09-21T09:15:09.206 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.Xd9cfcLqx6 is 631KB 2024-09-21T09:15:09.268 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.Xd9cfcLqx6 2024-09-21T09:15:09.274 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225/data/mon.b.tgz 2024-09-21T09:15:09.274 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-21T09:15:09.281 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.Obv3EU7CR9 2024-09-21T09:15:09.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Obv3EU7CR9 2024-09-21T09:15:09.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.Obv3EU7CR9 2024-09-21T09:15:09.536 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.Obv3EU7CR9 is 631KB 2024-09-21T09:15:09.597 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.Obv3EU7CR9 2024-09-21T09:15:09.602 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T09:15:09.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T09:15:09.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T09:15:09.666 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T09:15:09.704 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T09:15:09.704 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T09:15:09.705 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225/remote/smithi007/crash 2024-09-21T09:15:09.706 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T09:15:09.722 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225/remote/smithi050/crash 2024-09-21T09:15:09.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T09:15:09.760 INFO:tasks.ceph:Compressing logs... 2024-09-21T09:15:09.760 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T09:15:09.767 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T09:15:09.830 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26299.log 2024-09-21T09:15:09.831 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26371.log 2024-09-21T09:15:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.26299.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T09:15:09.832 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26299.log.gz 2024-09-21T09:15:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.26371.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-21T09:15:09.832 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26371.log.gz 2024-09-21T09:15:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26323.log 2024-09-21T09:15:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-osd.6.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26450.log 2024-09-21T09:15:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.26323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26323.log.gz 2024-09-21T09:15:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26275.log 2024-09-21T09:15:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-21T09:15:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.26450.log: /var/log/ceph/ceph-client.admin.26275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26275.log.gz 2024-09-21T09:15:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T09:15:09.834 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26450.log.gz 2024-09-21T09:15:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T09:15:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T09:15:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26347.log 2024-09-21T09:15:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26395.log 2024-09-21T09:15:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.26347.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26426.log 2024-09-21T09:15:09.837 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26347.log.gz 2024-09-21T09:15:09.837 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.26395.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T09:15:09.838 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T09:15:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.26426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26395.log.gz 2024-09-21T09:15:09.838 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26426.log.gz 2024-09-21T09:15:09.838 INFO:teuthology.orchestra.run.smithi050.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T09:15:09.838 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T09:15:09.870 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32440.log 2024-09-21T09:15:09.871 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-21T09:15:09.871 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32440.log.gz 2024-09-21T09:15:09.871 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58630.log 2024-09-21T09:15:09.872 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32139.log 2024-09-21T09:15:09.873 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57145.log 2024-09-21T09:15:09.873 INFO:teuthology.orchestra.run.smithi007.stderr: 84.9% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-21T09:15:09.874 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58630.log.gz 2024-09-21T09:15:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T09:15:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32139.log.gz 2024-09-21T09:15:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57145.log.gz 2024-09-21T09:15:09.874 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57348.log 2024-09-21T09:15:09.875 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32414.log 2024-09-21T09:15:09.875 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57337.log 2024-09-21T09:15:09.875 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57348.log.gz 2024-09-21T09:15:09.875 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57550.log 2024-09-21T09:15:09.875 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32414.log.gz 2024-09-21T09:15:09.876 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57337.log.gz 2024-09-21T09:15:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52706.log 2024-09-21T09:15:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33477.log 2024-09-21T09:15:09.877 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57550.log: /var/log/ceph/ceph-client.admin.52706.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.57550.log.gz -5 2024-09-21T09:15:09.877 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58864.log 2024-09-21T09:15:09.877 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52706.log.gz 2024-09-21T09:15:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37415.log 2024-09-21T09:15:09.878 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33477.log.gz 2024-09-21T09:15:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58864.log.gz 2024-09-21T09:15:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57151.log 2024-09-21T09:15:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54309.log 2024-09-21T09:15:09.879 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37415.log.gz 2024-09-21T09:15:09.880 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55179.log 2024-09-21T09:15:09.880 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57151.log.gz 2024-09-21T09:15:09.880 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50240.log 2024-09-21T09:15:09.880 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54309.log.gz 2024-09-21T09:15:09.880 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55179.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.55179.log.gz 2024-09-21T09:15:09.880 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35429.log 2024-09-21T09:15:09.880 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50240.log: gzip -5 93.5% --verbose -- -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-21T09:15:09.880 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.34987.log 2024-09-21T09:15:09.881 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50240.log.gz 2024-09-21T09:15:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35429.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T09:15:09.882 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35429.log.gz 2024-09-21T09:15:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34987.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.32145.log -- replaced with /var/log/ceph/ceph-client.admin.34987.log.gz 2024-09-21T09:15:09.882 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.882 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31662.log 2024-09-21T09:15:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55000.log 0.0% 2024-09-21T09:15:09.883 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32145.log.gz 2024-09-21T09:15:09.883 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33278.log 2024-09-21T09:15:09.883 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31662.log.gz 2024-09-21T09:15:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32130.log 2024-09-21T09:15:09.885 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55000.log.gz 2024-09-21T09:15:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33278.log.gz 2024-09-21T09:15:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58838.log 2024-09-21T09:15:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39198.log 2024-09-21T09:15:09.885 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32130.log.gz 2024-09-21T09:15:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56735.log 2024-09-21T09:15:09.885 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58838.log.gz 2024-09-21T09:15:09.885 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49008.log 2024-09-21T09:15:09.886 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39198.log.gz 2024-09-21T09:15:09.886 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36183.log 2024-09-21T09:15:09.886 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56735.log.gz 2024-09-21T09:15:09.890 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52065.log 2024-09-21T09:15:09.890 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49008.log.gz 2024-09-21T09:15:09.890 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32158.log 2024-09-21T09:15:09.890 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36183.log.gz 2024-09-21T09:15:09.890 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34138.log 2024-09-21T09:15:09.890 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52065.log.gz 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56995.log 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32158.log.gz 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58942.log 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34138.log.gz 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33815.log 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56995.log.gz 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56839.log 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58942.log.gz 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36189.log 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33815.log.gz 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39788.log 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56839.log.gz 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.36189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31591.log 2024-09-21T09:15:09.891 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36189.log.gz 2024-09-21T09:15:09.892 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58708.log 2024-09-21T09:15:09.892 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39788.log.gz 2024-09-21T09:15:09.892 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31591.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31591.log.gz -5 2024-09-21T09:15:09.892 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56600.log 2024-09-21T09:15:09.896 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50850.log 2024-09-21T09:15:09.896 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58708.log.gz 2024-09-21T09:15:09.896 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33319.log 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56600.log.gz 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43358.log 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50850.log.gz 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58734.log 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33319.log.gz 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35172.log 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43358.log.gz 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58734.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58734.log.gz 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34611.log 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35172.log.gz 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34113.log 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40992.log 2024-09-21T09:15:09.897 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34611.log.gz 2024-09-21T09:15:09.898 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34113.log.gz 2024-09-21T09:15:09.898 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57566.log 2024-09-21T09:15:09.898 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44735.log 2024-09-21T09:15:09.898 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40992.log.gz 2024-09-21T09:15:09.898 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57566.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.57566.log.gz 2024-09-21T09:15:09.898 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32140.log 2024-09-21T09:15:09.898 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35587.log 2024-09-21T09:15:09.898 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44735.log.gz 2024-09-21T09:15:09.898 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56574.log 2024-09-21T09:15:09.898 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32140.log.gz 2024-09-21T09:15:09.899 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T09:15:09.903 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49010.log 2024-09-21T09:15:09.903 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35587.log.gz 2024-09-21T09:15:09.903 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56574.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T09:15:09.903 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56574.log.gz 2024-09-21T09:15:09.903 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34793.log 2024-09-21T09:15:09.903 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49010.log.gz 2024-09-21T09:15:09.903 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29901.log 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34793.log.gz 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52821.log 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57047.log 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.29901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29901.log.gz 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32464.log 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52821.log.gz 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55908.log 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57047.log.gz 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34455.log 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32464.log.gz 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32338.log 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55908.log.gz 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33667.log 2024-09-21T09:15:09.904 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34455.log.gz 2024-09-21T09:15:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53715.log 2024-09-21T09:15:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32338.log.gz 2024-09-21T09:15:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33196.log 2024-09-21T09:15:09.905 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33667.log.gz 2024-09-21T09:15:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33515.log 2024-09-21T09:15:09.908 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53715.log.gz 2024-09-21T09:15:09.908 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57553.log 2024-09-21T09:15:09.908 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33196.log.gz 2024-09-21T09:15:09.908 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32146.log 2024-09-21T09:15:09.908 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33515.log.gz 2024-09-21T09:15:09.908 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57134.log 2024-09-21T09:15:09.908 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57553.log.gz 2024-09-21T09:15:09.908 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31566.log 2024-09-21T09:15:09.908 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32146.log.gz 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58968.log 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57134.log.gz 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31566.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.31566.log.gz --verbose 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.33774.log 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21443.log 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58968.log.gz 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47799.log 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33774.log.gz 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35515.log 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.tmp-client.admin.21443.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21443.log.gz 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34908.log 2024-09-21T09:15:09.909 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47799.log.gz 2024-09-21T09:15:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57829.log 2024-09-21T09:15:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35515.log.gz 2024-09-21T09:15:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34908.log.gz 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55948.log 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.57829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57829.log.gz 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58786.log 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57347.log 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55948.log.gz 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57801.log 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58786.log.gz 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55138.log 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57347.log.gz 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34364.log 2024-09-21T09:15:09.913 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57801.log.gz 2024-09-21T09:15:09.914 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33592.log 2024-09-21T09:15:09.914 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55138.log.gz 2024-09-21T09:15:09.914 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40380.log 2024-09-21T09:15:09.914 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34364.log.gz 2024-09-21T09:15:09.916 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45964.log 2024-09-21T09:15:09.916 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33592.log.gz 2024-09-21T09:15:09.916 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56969.log 2024-09-21T09:15:09.916 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40380.log.gz 2024-09-21T09:15:09.916 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53593.log 2024-09-21T09:15:09.916 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45964.log.gz 2024-09-21T09:15:09.916 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56969.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.56969.log.gz 2024-09-21T09:15:09.916 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57564.log 2024-09-21T09:15:09.917 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59023.log 2024-09-21T09:15:09.917 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53593.log.gz 2024-09-21T09:15:09.917 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57564.log.gz 2024-09-21T09:15:09.917 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49632.log 2024-09-21T09:15:09.917 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34050.log 2024-09-21T09:15:09.917 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59023.log.gz 2024-09-21T09:15:09.917 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49632.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T09:15:09.917 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49632.log.gz 2024-09-21T09:15:09.918 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57150.log 2024-09-21T09:15:09.918 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34050.log.gz 2024-09-21T09:15:09.918 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52888.log 2024-09-21T09:15:09.918 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56626.log 2024-09-21T09:15:09.918 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57150.log.gz 2024-09-21T09:15:09.919 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44694.log 2024-09-21T09:15:09.919 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52888.log.gz 2024-09-21T09:15:09.919 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54963.log 2024-09-21T09:15:09.919 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56626.log.gz 2024-09-21T09:15:09.919 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50848.log 2024-09-21T09:15:09.920 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44694.log.gz 2024-09-21T09:15:09.920 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31740.log 2024-09-21T09:15:09.920 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54963.log.gz 2024-09-21T09:15:09.920 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58916.log 2024-09-21T09:15:09.921 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50848.log.gz 2024-09-21T09:15:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58422.log 2024-09-21T09:15:09.921 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31740.log.gz 2024-09-21T09:15:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42174.log 2024-09-21T09:15:09.921 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58916.log.gz 2024-09-21T09:15:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56891.log 2024-09-21T09:15:09.921 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58422.log.gz 2024-09-21T09:15:09.923 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26295.log 2024-09-21T09:15:09.923 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42174.log.gz 2024-09-21T09:15:09.923 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32156.log 2024-09-21T09:15:09.923 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56891.log.gz 2024-09-21T09:15:09.923 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.26295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56865.log 2024-09-21T09:15:09.923 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26295.log.gz 2024-09-21T09:15:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56657.log 2024-09-21T09:15:09.924 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32156.log.gz 2024-09-21T09:15:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57749.log 2024-09-21T09:15:09.924 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56865.log.gz 2024-09-21T09:15:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57361.log 2024-09-21T09:15:09.924 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56657.log.gz 2024-09-21T09:15:09.925 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57749.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T09:15:09.926 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57749.log.gz 2024-09-21T09:15:09.926 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31728.log 2024-09-21T09:15:09.926 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57361.log.gz 2024-09-21T09:15:09.926 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56917.log 2024-09-21T09:15:09.927 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44775.log 2024-09-21T09:15:09.927 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31728.log.gz 2024-09-21T09:15:09.927 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57334.log 2024-09-21T09:15:09.927 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56917.log.gz 2024-09-21T09:15:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48392.log 2024-09-21T09:15:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44775.log.gz 2024-09-21T09:15:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33436.log 2024-09-21T09:15:09.928 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57334.log.gz 2024-09-21T09:15:09.928 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44616.log 2024-09-21T09:15:09.928 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48392.log.gz 2024-09-21T09:15:09.929 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33436.log.gz 2024-09-21T09:15:09.929 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47150.log 2024-09-21T09:15:09.930 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31738.log 2024-09-21T09:15:09.930 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44616.log.gz 2024-09-21T09:15:09.930 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-09-21T09:15:09.930 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47150.log.gz 2024-09-21T09:15:09.930 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33930.log 2024-09-21T09:15:09.933 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31738.log: /var/log/ceph/ceph-client.admin.34752.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31636.log 2024-09-21T09:15:09.933 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-09-21T09:15:09.933 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31738.log.gz 2024-09-21T09:15:09.933 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33930.log.gz 2024-09-21T09:15:09.933 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57099.log 2024-09-21T09:15:09.934 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54930.log 2024-09-21T09:15:09.934 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31636.log: 0.0%/var/log/ceph/ceph-client.admin.57099.log: -- replaced with /var/log/ceph/ceph-client.admin.31636.log.gz 2024-09-21T09:15:09.934 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57099.log.gz 2024-09-21T09:15:09.934 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31741.log 2024-09-21T09:15:09.934 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56761.log 2024-09-21T09:15:09.934 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54930.log.gz/var/log/ceph/ceph-client.admin.31741.log: 2024-09-21T09:15:09.934 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57148.log 2024-09-21T09:15:09.934 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31741.log.gz 2024-09-21T09:15:09.936 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56761.log.gz 2024-09-21T09:15:09.936 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34269.log 2024-09-21T09:15:09.936 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35246.log 2024-09-21T09:15:09.936 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57148.log.gz 2024-09-21T09:15:09.936 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34269.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43987.log 2024-09-21T09:15:09.937 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34269.log.gz 2024-09-21T09:15:09.937 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33957.log 2024-09-21T09:15:09.937 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35246.log.gz 2024-09-21T09:15:09.937 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56709.log 2024-09-21T09:15:09.937 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43987.log: /var/log/ceph/ceph-client.admin.33957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43987.log.gz 2024-09-21T09:15:09.937 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33957.log.gz 2024-09-21T09:15:09.937 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31739.log 2024-09-21T09:15:09.939 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58552.log 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56709.log.gz 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31739.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26555.log 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31739.log.gz 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58552.log.gz 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34295.log 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.26555.log: /var/log/ceph/ceph.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26555.log.gz 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58760.log 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41584.log 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34295.log.gz 2024-09-21T09:15:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58760.log.gz 2024-09-21T09:15:09.942 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31616.log 2024-09-21T09:15:09.942 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56813.log 2024-09-21T09:15:09.942 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41584.log.gz 2024-09-21T09:15:09.942 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31616.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.31616.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.33248.log 2024-09-21T09:15:09.942 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.942 INFO:teuthology.orchestra.run.smithi007.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T09:15:09.943 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56813.log.gz 2024-09-21T09:15:09.943 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57568.log 2024-09-21T09:15:09.944 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31936.log 2024-09-21T09:15:09.944 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33248.log.gz 2024-09-21T09:15:09.944 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31949.log 2024-09-21T09:15:09.944 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57568.log.gz 2024-09-21T09:15:09.944 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51470.log 2024-09-21T09:15:09.945 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31936.log: /var/log/ceph/ceph-client.admin.31949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31942.log 2024-09-21T09:15:09.945 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31949.log.gz 2024-09-21T09:15:09.945 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31936.log.gz 2024-09-21T09:15:09.945 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51470.log.gz 2024-09-21T09:15:09.945 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35131.log 2024-09-21T09:15:09.947 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53634.log 2024-09-21T09:15:09.948 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35131.log.gz 2024-09-21T09:15:09.948 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52862.log 2024-09-21T09:15:09.948 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31942.log.gz 2024-09-21T09:15:09.948 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58578.log 2024-09-21T09:15:09.948 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53634.log.gz 2024-09-21T09:15:09.948 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T09:15:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52862.log: /var/log/ceph/ceph-client.admin.58578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33222.log 2024-09-21T09:15:09.950 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52862.log.gz 2024-09-21T09:15:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55268.log 2024-09-21T09:15:09.950 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58578.log.gz 2024-09-21T09:15:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33222.log.gz 2024-09-21T09:15:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57152.log 2024-09-21T09:15:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52931.log 2024-09-21T09:15:09.951 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55268.log.gz 2024-09-21T09:15:09.951 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57152.log.gz 2024-09-21T09:15:09.952 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35090.log 2024-09-21T09:15:09.952 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31940.log 2024-09-21T09:15:09.952 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52931.log.gz 2024-09-21T09:15:09.952 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35090.log.gz 2024-09-21T09:15:09.952 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57356.log 2024-09-21T09:15:09.953 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47209.log 2024-09-21T09:15:09.953 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31940.log.gz 2024-09-21T09:15:09.954 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57356.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34649.log 2024-09-21T09:15:09.954 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.954 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47209.log.gz 2024-09-21T09:15:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57569.log 2024-09-21T09:15:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58474.log 2024-09-21T09:15:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34649.log.gz 2024-09-21T09:15:09.955 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57569.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.57569.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.32490.log 2024-09-21T09:15:09.955 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58474.log.gz 2024-09-21T09:15:09.956 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33700.log 2024-09-21T09:15:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34464.log 2024-09-21T09:15:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32490.log.gz 2024-09-21T09:15:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33700.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48415.log 2024-09-21T09:15:09.957 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34464.log.gz 2024-09-21T09:15:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33170.log 2024-09-21T09:15:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-21T09:15:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48415.log: /var/log/ceph/ceph-client.admin.33170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48415.log.gz 2024-09-21T09:15:09.959 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33170.log.gz 2024-09-21T09:15:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38603.log 2024-09-21T09:15:09.960 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57357.log 2024-09-21T09:15:09.960 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.38603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38603.log.gz 2024-09-21T09:15:09.960 INFO:teuthology.orchestra.run.smithi007.stderr: 90.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-21T09:15:09.960 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57355.log 2024-09-21T09:15:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35363.log 2024-09-21T09:15:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57357.log: /var/log/ceph/ceph-client.admin.57355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57355.log.gz 2024-09-21T09:15:09.961 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57357.log.gz 2024-09-21T09:15:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T09:15:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58526.log 2024-09-21T09:15:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35363.log: /var/log/ceph/ceph.audit.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35363.log.gz 2024-09-21T09:15:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58812.log 2024-09-21T09:15:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58526.log.gz 2024-09-21T09:15:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53659.log 2024-09-21T09:15:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58812.log: 93.9% 0.0% -- replaced with /var/log/ceph/ceph.audit.log.gz -- replaced with /var/log/ceph/ceph-client.admin.58812.log.gz 2024-09-21T09:15:09.965 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34570.log 2024-09-21T09:15:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34830.log 2024-09-21T09:15:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53659.log: /var/log/ceph/ceph-client.admin.34570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53659.log.gz 2024-09-21T09:15:09.966 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34570.log.gz 2024-09-21T09:15:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56548.log 2024-09-21T09:15:09.967 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32390.log 2024-09-21T09:15:09.967 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34830.log: /var/log/ceph/ceph-client.admin.56548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34830.log.gz 2024-09-21T09:15:09.968 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56548.log.gz 2024-09-21T09:15:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55884.log 2024-09-21T09:15:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32390.log.gz 2024-09-21T09:15:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26454.log 2024-09-21T09:15:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56683.log 2024-09-21T09:15:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55884.log: /var/log/ceph/ceph-client.admin.26454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55884.log.gz 2024-09-21T09:15:09.970 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26454.log.gz 2024-09-21T09:15:09.970 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58448.log 2024-09-21T09:15:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53555.log 2024-09-21T09:15:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56683.log: /var/log/ceph/ceph-client.admin.58448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56683.log.gz 2024-09-21T09:15:09.971 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58448.log.gz 2024-09-21T09:15:09.971 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58682.log 2024-09-21T09:15:09.972 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52710.log 2024-09-21T09:15:09.972 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53555.log: /var/log/ceph/ceph-client.admin.58682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53555.log.gz 2024-09-21T09:15:09.972 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58682.log.gz 2024-09-21T09:15:09.972 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34914.log 2024-09-21T09:15:09.972 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58500.log 2024-09-21T09:15:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52710.log.gz 2024-09-21T09:15:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34914.log.gzgzip 2024-09-21T09:15:09.974 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31742.log 2024-09-21T09:15:09.974 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57153.log 2024-09-21T09:15:09.975 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58500.log.gz 2024-09-21T09:15:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31742.log.gz 2024-09-21T09:15:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59047.log 2024-09-21T09:15:09.975 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57153.log.gz 2024-09-21T09:15:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32364.log 2024-09-21T09:15:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34013.log 2024-09-21T09:15:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59047.log.gz 2024-09-21T09:15:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32364.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35043.log 2024-09-21T09:15:09.976 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32364.log.gz 2024-09-21T09:15:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34013.log.gz 2024-09-21T09:15:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31724.log 2024-09-21T09:15:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31925.log 2024-09-21T09:15:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35043.log.gz 2024-09-21T09:15:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31724.log.gz 2024-09-21T09:15:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58604.log 2024-09-21T09:15:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31925.log.gz 2024-09-21T09:15:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2024-09-21T09:15:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57137.log 2024-09-21T09:15:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58604.log.gz 2024-09-21T09:15:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35270.log 2024-09-21T09:15:09.980 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57137.log.gz 2024-09-21T09:15:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32157.log 2024-09-21T09:15:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55034.log 2024-09-21T09:15:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35270.log.gz 2024-09-21T09:15:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32157.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58890.log 2024-09-21T09:15:09.982 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55034.log.gz 2024-09-21T09:15:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57021.log 2024-09-21T09:15:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55088.log 2024-09-21T09:15:09.983 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58890.log.gz 2024-09-21T09:15:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57021.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33317.log 2024-09-21T09:15:09.984 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55088.log.gz 2024-09-21T09:15:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34405.log 2024-09-21T09:15:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57549.log 2024-09-21T09:15:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33317.log: /var/log/ceph/ceph-client.admin.34405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33317.log.gz 2024-09-21T09:15:09.986 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34405.log.gz 2024-09-21T09:15:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31950.log 2024-09-21T09:15:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42764.log 2024-09-21T09:15:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31950.log: /var/log/ceph/ceph-client.admin.57549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57549.log.gz 2024-09-21T09:15:09.987 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31950.log.gz 2024-09-21T09:15:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40382.log 2024-09-21T09:15:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33861.log 2024-09-21T09:15:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42764.log: /var/log/ceph/ceph-client.admin.40382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42764.log.gz 2024-09-21T09:15:09.989 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40382.log.gz 2024-09-21T09:15:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31930.log 2024-09-21T09:15:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36817.log 2024-09-21T09:15:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33861.log: /var/log/ceph/ceph-client.admin.31930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33861.log.gz 2024-09-21T09:15:09.989 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31930.log.gz 2024-09-21T09:15:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38009.log 2024-09-21T09:15:09.991 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56943.log 2024-09-21T09:15:09.991 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38009.log: /var/log/ceph/ceph-client.admin.36817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36817.log.gz 2024-09-21T09:15:09.991 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38009.log.gz 2024-09-21T09:15:09.992 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57775.log 2024-09-21T09:15:09.992 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56787.log 2024-09-21T09:15:09.992 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56943.log.gz 2024-09-21T09:15:09.992 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57775.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31935.log 2024-09-21T09:15:09.992 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57775.log.gz 2024-09-21T09:15:09.992 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56787.log.gz 2024-09-21T09:15:09.993 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2024-09-21T09:15:09.993 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57541.log 2024-09-21T09:15:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31935.log.gz 2024-09-21T09:15:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45369.log 2024-09-21T09:15:09.994 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.994 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57541.log.gz 2024-09-21T09:15:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34710.log 2024-09-21T09:15:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44607.log 2024-09-21T09:15:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45369.log: /var/log/ceph/ceph-client.admin.34710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45369.log.gz 2024-09-21T09:15:09.995 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34710.log.gz 2024-09-21T09:15:09.995 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33618.log 2024-09-21T09:15:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58995.log 2024-09-21T09:15:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44607.log: /var/log/ceph/ceph-client.admin.33618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44607.log.gz 2024-09-21T09:15:09.997 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33618.log.gz 2024-09-21T09:15:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58656.log 2024-09-21T09:15:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57073.log 2024-09-21T09:15:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58995.log: /var/log/ceph/ceph-client.admin.58656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58995.log.gz 2024-09-21T09:15:09.997 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58656.log.gz 2024-09-21T09:15:09.997 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52071.log 2024-09-21T09:15:09.999 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35329.log 2024-09-21T09:15:09.999 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57073.log.gz 2024-09-21T09:15:09.999 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52071.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34216.log 2024-09-21T09:15:09.999 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:09.999 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35329.log.gz 2024-09-21T09:15:09.999 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31688.log 2024-09-21T09:15:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31735.log 2024-09-21T09:15:10.000 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.34216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34216.log.gz 2024-09-21T09:15:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31688.log.gz 2024-09-21T09:15:10.001 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.31735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31735.log.gz 2024-09-21T09:15:10.027 INFO:teuthology.orchestra.run.smithi050.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T09:15:10.126 INFO:teuthology.orchestra.run.smithi007.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T09:15:10.195 INFO:teuthology.orchestra.run.smithi007.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T09:15:10.373 INFO:teuthology.orchestra.run.smithi050.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T09:15:10.422 INFO:teuthology.orchestra.run.smithi050.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T09:15:10.459 INFO:teuthology.orchestra.run.smithi050.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T09:15:10.488 INFO:teuthology.orchestra.run.smithi007.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T09:15:10.541 INFO:teuthology.orchestra.run.smithi050.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T09:15:10.543 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-21T09:15:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m0.736s 2024-09-21T09:15:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m2.661s 2024-09-21T09:15:10.543 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m0.086s 2024-09-21T09:15:10.601 INFO:teuthology.orchestra.run.smithi007.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T09:15:10.631 INFO:teuthology.orchestra.run.smithi007.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T09:15:10.700 INFO:teuthology.orchestra.run.smithi007.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T09:15:10.702 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T09:15:10.702 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m0.933s 2024-09-21T09:15:10.702 INFO:teuthology.orchestra.run.smithi007.stderr:user 0m3.378s 2024-09-21T09:15:10.702 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m0.191s 2024-09-21T09:15:10.703 INFO:tasks.ceph:Archiving logs... 2024-09-21T09:15:10.703 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225/remote/smithi007/log 2024-09-21T09:15:10.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T09:15:11.225 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225/remote/smithi050/log 2024-09-21T09:15:11.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T09:15:11.541 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T09:15:11.549 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T09:15:11.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T09:15:11.552 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T09:15:11.625 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T09:15:11.634 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T09:15:11.634 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T09:15:11.636 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T09:15:11.647 INFO:teuthology.orchestra.run.smithi007.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T09:15:11.647 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================== 2024-09-21T09:15:11.647 INFO:teuthology.orchestra.run.smithi007.stdout:*hv01.front.sepi 67.205.162.81 3 u 35 64 177 0.106 -0.488 0.518 2024-09-21T09:15:11.647 INFO:teuthology.orchestra.run.smithi007.stdout:+hv02.front.sepi 96.245.170.99 3 u 34 64 177 0.102 -0.832 0.500 2024-09-21T09:15:11.647 INFO:teuthology.orchestra.run.smithi007.stdout:+hv03.front.sepi 74.6.168.72 3 u 34 64 177 0.088 -1.109 0.920 2024-09-21T09:15:11.647 INFO:teuthology.orchestra.run.smithi007.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T09:15:11.649 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T09:15:11.649 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-09-21T09:15:11.649 INFO:teuthology.orchestra.run.smithi050.stdout:*hv01.front.sepi 67.205.162.81 3 u 33 64 177 0.096 -1.430 1.208 2024-09-21T09:15:11.650 INFO:teuthology.orchestra.run.smithi050.stdout:+hv02.front.sepi 96.245.170.99 3 u 31 64 177 0.072 -3.979 2.520 2024-09-21T09:15:11.650 INFO:teuthology.orchestra.run.smithi050.stdout:+hv03.front.sepi 74.6.168.72 3 u 37 64 177 0.072 -0.307 1.532 2024-09-21T09:15:11.650 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T09:15:11.650 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T09:15:11.659 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T09:15:11.659 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T09:15:11.667 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T09:15:11.675 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T09:15:11.685 INFO:teuthology.task.internal:Duration was 897.492314 seconds 2024-09-21T09:15:11.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T09:15:11.694 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T09:15:11.694 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T09:15:11.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-21T09:15:11.696 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T09:15:11.735 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T09:15:11.735 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T09:15:11.735 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T09:15:11.786 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-09-21T09:15:11.786 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T09:15:11.797 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T09:15:11.797 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T09:15:11.831 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T09:15:11.870 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T09:15:11.870 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T09:15:11.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T09:15:11.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T09:15:11.984 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T09:15:11.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T09:15:11.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T09:15:12.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T09:15:12.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T09:15:12.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T09:15:12.105 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-09-21T09:15:12.110 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-09-21T09:15:12.129 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T09:15:12.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:15:12.165 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T09:15:12.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T09:15:12.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T09:15:12.184 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T09:15:12.185 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225/remote/smithi007 2024-09-21T09:15:12.185 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T09:15:12.230 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-20_21:40:05-rgw-squid-distro-default-smithi/7913225/remote/smithi050 2024-09-21T09:15:12.230 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T09:15:12.251 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T09:15:12.251 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T09:15:12.275 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T09:15:12.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T09:15:12.309 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T09:15:12.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T09:15:12.318 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T09:15:12.318 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T09:15:12.323 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T09:15:12.326 INFO:teuthology.orchestra.run.smithi007.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 09:15 /home/ubuntu/cephtest 2024-09-21T09:15:12.344 INFO:teuthology.orchestra.run.smithi050.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 09:15 /home/ubuntu/cephtest 2024-09-21T09:15:12.345 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T09:15:12.355 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T09:15:12.377 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} duration: 897.4923136234283 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-21T09:15:12.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T09:15:12.471 INFO:teuthology.run:pass